ParquetStorage
ParquetStorage()
Storage that caches expressions as Parquet files using a modification time strategy.
This storage class saves intermediate results as Parquet files in a specified directory and uses a modification time-based approach for cache invalidation. The cache is invalidated when the modification time of the source data changes, making it suitable for data that changes periodically.
Parameters
Name | Type | Description | Default |
---|---|---|---|
source | ibis.backends.BaseBackend | The backend to use for execution. Defaults to xorq’s default backend. | required |
relative_path | Path | The relative directory where Parquet files will be stored. Defaults to xorq.options.cache.default_path. | required |
base_path | Path | The base path where Parquet files will be stored. | required |