Restore Pipeline Components

This module contains the interfaces for transformation restore pipelines. The primary interface here for users is the DataRestorePipeline which can be used to reverse the transforms done in a previous transform pipeline. It will only restore transforms for the transformers that have explicit restore capabilities.

class gretel_client.transformers.data_restore_pipeline.DataRestorePipeline(data_paths: List[gretel_client.transformers.data_pipeline.DataPath])

This class is a container for data paths describing a record restore transformation.

This class is used to reverse the transformations that were made previously. Not all transformations are reversable. This pipeline only acts on transformers that have a restore capability.

It constructs a data pipeline from a list of DataPath objects and is used to process records based on the order of the data path list. You can think of it as a bundle of data paths.

Parameters

data_paths – A list of DataPath instances.

transform_record(payload: dict)

Restore elligible fields to their original values. Only Transformations that have restore capabilities will be reversed. Any other transforms that were done that do not have a restore mode will remain the same.

Originally un-transformed fields will also remain the same