Skip to content

Instantly share code, notes, and snippets.

@benmaier
Last active May 8, 2025 11:16
Show Gist options
  • Save benmaier/b348a9d41ee24c44f763e0f689e24450 to your computer and use it in GitHub Desktop.
Save benmaier/b348a9d41ee24c44f763e0f689e24450 to your computer and use it in GitHub Desktop.
Terminal command to inspect a parquet schema overview (with python-polars)
parq () {
python -c "import polars as po; schema = po.read_parquet_schema('$1'); n = max(map(len,schema.keys())); [ print(f'{k.ljust(n,\" \")}: {v}') for k, v in schema.items() ]"
}
@benmaier
Copy link
Author

benmaier commented May 8, 2025

usage:

parq data.parquet

out:

short_column_name              : String
long_very_very_long_column_name: Int64

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment