ParquetStorage

ParquetStorage()

Storage that caches expressions as Parquet files using a modification time strategy.

This storage class saves intermediate results as Parquet files in a specified directory and uses a modification time-based approach for cache invalidation. The cache is invalidated when the modification time of the source data changes, making it suitable for data that changes periodically.

Parameters

Name Type Description Default
source ibis.backends.BaseBackend The backend to use for execution. Defaults to xorq’s default backend. required
relative_path Path The relative directory where Parquet files will be stored. Defaults to xorq.options.cache.default_path. required
base_path Path The base path where Parquet files will be stored. required