Daniel Thorn relud

relud / gist:6f77619181d8f556072e477c6ab4e929

Last active June 12, 2019 21:16 — forked from emtwo/gist:6bc4fa0ec93f2f2f37697fea01754b85

	-- Query generated by: sql/clients_daily_scalar_aggregates.sql.py
	CREATE TEMP FUNCTION
	udf_aggregate_map_sum(maps ANY TYPE) AS (STRUCT(ARRAY(
	SELECT
	AS STRUCT key,
	SUM(value) AS value
	FROM
	UNNEST(maps),
	UNNEST(key_value)
	GROUP BY

relud / test_repartition.scala

Last active January 23, 2018 22:55 — forked from mreid-moz/test_repartition.scala

Test repartitioning behaviour when writing parquet data.

	import java.util.UUID.randomUUID
	import scala.sys.process._
	import java.util.zip.CRC32
	import com.mozilla.telemetry.utils.getOrCreateSparkSession

	val spark = getOrCreateSparkSession("test")
	spark.sparkContext.setLogLevel("WARN")
	import spark.implicits._

	def getPartitionId(clientId: String, sampleId: Int, filesPerPartition: Int) = {