ETL Developer Guide

Sequences

1. Ensuring data are loaded with Two Phase Commit
2. Extract
3. Transform
4. Extract

Two Phase Commit during ETL process

Extract

To implement your own extractor, extend the SPIN BASE ETL Extractor class.
Only one extractor can be used in a single pipeline.

Transform

To implement your own extractor, extend the SPIN BASE ETL Transformer class.
Many transformers may be used in sequence.

Load

To implement your own extractor, extend the SPIN BASE ETL Loader class.
Many loaders can be used in sequence, like the Two-Phase-Commit loader shown above.