Skip to content

Instantly share code, notes, and snippets.

@huasanyelao

huasanyelao/spark kryo 配置

Created December 11, 2015 12:56
Show Gist options
  • Save huasanyelao/c6d69ed47c5e38338ff0 to your computer and use it in GitHub Desktop.
Save huasanyelao/c6d69ed47c5e38338ff0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark kryo 配置
spark.serializer=org.apache.spark.serializer.KryoSerializer
spark.kryo.registrator=com.uebercomputing.mailrecord.MailRecordRegistrator
spark.kryoserializer.buffer.mb=128
spark.kryoserializer.buffer.max.mb=512
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment