Alexander abij

abij / create-databricks-account-console-admin-group.sh

Last active May 9, 2025 10:30

Create new Databricks Account-level group with admin permissions

	# Use the databricks-cli
	#
	# 1. Login as account-admin into Account Console
	# 2. Save into profile "ACCOUNT"
	#
	# databricks auth login --profile ACCOUNT --host https://accounts.azuredatabricks.net --account-id 1234-2134-1234-1234

	databricks account --profile ACCOUNT groups create --json @databricks-account-console-admin-group.json --output json > created.json

	# Use jq to get the Id of the group:

abij / 1_databricks_scim_account_groups.tf

Last active May 8, 2025 18:23

All in one terraform example to manage Azure SCIM-app and Account-level groups.

	terraform {
	required_providers {
	azuread = {
	source = "hashicorp/azuread"
	# Latest version selected
	}
	databricks = {
	source = "databricks/databricks"
	# Latest version selected
	}

abij / fileformats_spark_duckdb.ipynb

Last active January 23, 2025 21:44

Compare impact of file formats using Spark and DuckDB

Sorry, something went wrong. Reload?

Sorry, we cannot display this file.

Sorry, this file is invalid so it cannot be displayed.

abij / datadog-install-agent.sh

Created February 25, 2021 10:50

Databricks init script to install Datadog agent and configure for Structured Streaming metrics

	#!/bin/bash

	# Inspiration based on: https://docs.databricks.com/_static/notebooks/datadog-init-script.html

	# Improvements:
	# - Use 'spark_url' in config (instead of resourcemanager_uri)
	# - Use Databricks Secrets to store and retrieve datadog-api-key
	# - Works with SingleNode-clusters
	# - Update datadog-spark integration (when needed), to support Structured Streaming metrics.