ParquetCache

ParquetCache()

Cache expression results as Parquet files, re-hashing when source data changes.

Pairs ModificationTimeStrategy with ParquetStorage: results are written as Parquet files on local disk, and the cache key folds in source-data metadata so the cache invalidates automatically when the upstream data changes. Build it with :meth:from_kwargs.

Parameters

Name Type Description Default
source ibis.backends.BaseBackend Backend used to write the file on a miss and read it back on a hit. Defaults to xorq’s default backend. required
relative_path Path Subdirectory under the cache root. Defaults to xorq.config.options.cache.default_relative_path (parquet). required
base_path Path Cache root. Defaults to None, which resolves to XORQ_CACHE_DIR. required