Egor Borisov ehborisov

ehborisov / Spark Dataframe Cheat Sheet.py

Last active October 12, 2020 07:01 — forked from AlessandroChecco/Spark Dataframe Cheat Sheet.py

Cheat sheet for Spark Dataframes (using Python)

	# A simple cheat sheet of Spark Dataframe syntax
	# Current for Spark 1.6.1

	# import statements
	#from pyspark.sql import SQLContext
	#from pyspark.sql.types import *
	#from pyspark.sql.functions import *
	from pyspark.sql import functions as F

	#SparkContext available as sc, HiveContext available as sqlContext.