Each pipeline in Datazone has a context object that provides access to resources and configuration settings.
state
attribute that allows you to read and write key-value pairs.
The state is stored in database and can be accessed in any transform function in the pipeline.
Also you can access the state in the next executions of the pipeline.
success
, failure
, now
.
pyspark
attribute of the resources
object.