Skip to content

Instantly share code, notes, and snippets.

@PetrGlad

PetrGlad/Avro_Aws_Glue_Kafka.sh

Last active February 3, 2026 13:45
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save PetrGlad/187ea07aecf1eb4419369dd047ae91e6 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save PetrGlad/187ea07aecf1eb4419369dd047ae91e6 to your computer and use it in GitHub Desktop.
Download ZIP
Examples how to extract infomration from Kafka messages encoded for AWS Glue using Avro
Raw
Avro_Aws_Glue_Kafka.sh
# https://lenses.io/blog/aws_glue_schema_registry_that_binds_apache_kafka
# 16 bytes starting with 3rd contain UUID of AWS Glue schema.
cat message.base64 | base64 -d | tail -c+3 | head -c16 | uuid -d -F BIN -
# Bytes starting from 19 contain the message itself.
cat message.base64 | base64 -d | tail -c+19 | java -jar avro-tools-1.12.1.jar fragtojson --schema-file schema.avsc -
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment