Spawn compute#

spawn is a low level API used internally by methods such as sink_parquet. It provides the user with maximum control over spawning queries onto remote compute.

spawn(lf, *, dst[, context, partitioned_by, ...])

Spawn a remote query and await it asynchronously.

spawn_blocking(lf, *, dst[, context, ...])

Spawn a remote query and block the thread until the result is ready.

spawn_many(lf, *, dst[, context, engine, ...])

Spawn multiple remote queries and await them asynchronously.

spawn_many_blocking(lf, *, dst[, context, ...])

Spawn multiple remote queries and await them while blocking the thread.