polars_cloud.LazyFrameRemote.with_lineage

LazyFrameRemote.with_lineage(

*,

job_namespace: str,

job_name: str,

parent_run_id: UUID | str | None = None,

parent_job_namespace: str | None = None,

parent_job_name: str | None = None,

) → LazyFrameRemote

Configure OpenLineage metadata for this query.

Note. Supported for on-premises infrastructure only. For lineage to work, the lineage transport must be set in the cluster configuration file in addition to configuring the job metadata here.

Warning

This functionality is considered unstable. It may be changed at any point without it being considered a breaking change.

Parameters:

job_namespace

The job namespace.

job_name

The job name to use in OpenLineage events.

parent_run_id

The run ID of the parent orchestrator run (e.g. Airflow task run UUID). To configure a parent run, every parent_run_* field must be set to a non-empty value.

parent_job_namespace

The namespace of the parent orchestrator job.

parent_job_name

The job name of the parent orchestrator job.