Module parquet

Functions

combine_parquet_files

Combines multiple Parquet files using object store with storage options

combine_parquet_files_from_object_store

Combines multiple Parquet files from object store

create_object_store_from_path

Creates an object store from a URI string with optional storage options.

min_max_from_parquet_metadata

Extracts the minimum and maximum i64 values for the specified column_name from a Parquet file’s metadata using object store with storage options.

min_max_from_parquet_metadata_object_store

Extracts the minimum and maximum i64 values for the specified column_name from a Parquet file’s metadata in object store.

normalize_path_to_uri

Normalizes a path to URI format for consistent object store usage.

write_batch_to_parquet

Writes a RecordBatch to a Parquet file using object store, with optional compression.

write_batches_to_object_store

Writes multiple RecordBatch items to an object store URI, with optional compression and row group sizing.

write_batches_to_parquet

Writes multiple RecordBatch items to a Parquet file using object store, with optional compression, row group sizing, and storage options.