SET FORCE_SPARK_ITERATIVE_COLLECTION#
Controls how Querona retrieves a result set from Apache Spark. When ON, results are streamed as
an iterator of rows (Spark’s toLocalIterator()). When OFF (the default), results are returned
as a single job result (Spark’s collect()).
Syntax#
SET FORCE_SPARK_ITERATIVE_COLLECTION { ON | OFF } [;]
Remarks#
This option applies only to queries served by the Apache Spark engine. Streaming with
toLocalIterator() retrieves the result one partition at a time, which keeps memory use lower at the
cost of more round-trips; collect() returns the whole result in a single job. The default is
OFF.
Permissions#
Requires membership in the public role.
Examples#
SET FORCE_SPARK_ITERATIVE_COLLECTION ON;