dacort

name	fable-chief-agent
description	Use when the active agent is Fable 5 or another expensive top-tier model. Defines Fable as the senior decision-maker who preserves premium reasoning for intent, architecture, decomposition, tradeoffs, final review, and synthesis, while lower-cost agents handle discovery, implementation, verification, logs, tests, and repetitive work.

Fable Chief Agent

You are Fable 5, the senior decision-maker.

Your value is judgment, not labor. Spend your reasoning on the parts where being the strongest model changes the outcome.

dacort

1. Download the JDBC driver from here: https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html - I used the JDBC driver with the Athena SDK, AthenaJDBC42-2.0.35.1000.jar.

2. Start pyspark with the --jars option.

pyspark --jars AthenaJDBC42-2.0.35.1000.jar

3. Use spark.read.jdbc to connect to Athena. You need to specify either a User/Password in the properties or set the AwsCredentialsProviderClass property.

dacort

import json
import sys

BS = "0123456789abcdefghijklmnopqrstuvwxyz"

def parse_input():
    input = sys.stdin.read()
    return json.loads(input)

def to_base(n, b): 

dacort

In The Zone

When you're in the zone, nothing can stop you. Let your coworkers know what tunes you were listening to in the moment.

Overview

There are two modes in life:

• (R)ecord - when you want to make a mixtape for somebody
• (P)layback - when you want to feel the mood

dacort

FROM 895885662937.dkr.ecr.us-west-2.amazonaws.com/spark/emr-6.3.0:latest

### Switch to root for installation
USER root

### setup for conda
RUN  yum install -y wget

### Install Conda into shared location
RUN wget https://repo.anaconda.com/miniconda/Miniconda3-py39_4.10.3-Linux-x86_64.sh \

dacort

Athena CTAS Update

An approach for updating partitions in an existing table using CTAS queries.

Overview

With the release of CTAS functionality for Athena, you're now able to create derivative tables in Athena with different data formats or S3 locations.

Sometimes, though, you want to be able to add data to a partition of an existing table. As long as that partition doesn't already exist, you can do this with Athena by using CTAS with a temporary table.

dacort

import sys
import boto3
from slacker import Slacker
import ConfigParser

import csv
from datetime import datetime

reload(sys)
sys.setdefaultencoding('utf8')

dacort

#!/bin/sh
#
#
# Poor man's version. Good 'ol bash and shell commands.

# Initialize stat counters
COPIES=0
FROM_APPS=()
TO_APPS=()

dacort

sqlite3 ~/Library/Application\ Support/Google/Chrome/Default/History "SELECT date(visit_time/1000000-11644473600, 'unixepoch'),urls.url,count(*) FROM visits INNER JOIN urls ON visits.url = urls.id WHERE urls.url LIKE '%github.com/%' GROUP BY date(visit_time/1000000-11644473600, 'unixepoch'),urls.url ORDER BY date(visit_time/1000000-11644473600, 'unixepoch') DESC,count(*);"

dacort

package main

import (
	"code.google.com/p/go.crypto/pbkdf2"
	"crypto/aes"
	"crypto/cipher"
	"crypto/sha1"
	"database/sql"
	"fmt"
	"log"