ifuller1

[
    {
        "equity-pricing": {
            "steps": [
                {
                    "check-out-of-hours": {
                        "steps": [
                            {
                                "get-current-time": {
                                    "assign": [

ifuller1

//import "google-apps-script";
const doCleanup = false;
const doSync = true;
const isProduction = true;
const debug = false;

const id = "[email protected]";
const tagName = "sourceId";
const copyTitle = true;
const preappendString = `Booked for ${id} - `;

ifuller1

import logging
import datetime
import json
import glob

from airflow import DAG
from airflow import models
from airflow.hooks.http_hook import HttpHook
from airflow.operators.slack_operator import SlackAPIPostOperator
from airflow.operators.python_operator import PythonOperator

ifuller1

import logging
import datetime
import json

from airflow import DAG
from airflow import models
from airflow.hooks.http_hook import HttpHook
from airflow.operators.python_operator import PythonOperator

SYMBOLS = ['AAPL', 'GOOGL', 'SNAP']

ifuller1

import logging
import datetime

from airflow import DAG
from airflow import models
from airflow.operators.python_operator import PythonOperator

YESTERDAY = datetime.datetime.combine(
    datetime.datetime.today() - datetime.timedelta(1),
    datetime.datetime.min.time())

ifuller1

#!/bin/zsh
if [[ $1 == "" ]]; then 
    echo "Please provide a project id e.g. ./scripts/setup your-project-id"
    exit
fi

#define variables
PROJECT_ID=$1
COMPOSER_ID="$1-composer"

ifuller1

#!/bin/zsh
if [[ $1 == "" ]]; then 
    echo "Please provide a project id e.g. ./scripts/setup your-project-id"
    exit
fi

#define variables
PROJECT_ID=$1
COMPOSER_ID="$1-composer"

ifuller1

At Trail we've been using [Pentaho's open source data integration (Kettle) app]
(http://community.pentaho.com/projects/data-integration/) to design ETL jobs that are used to provide our partner
integrations. As we integrate with more partners we've found some of the more complex integrations harder to achieve. 
Using a GUI to design jobs provides a useful abstraction when they're made up of basic joins and transformations 
but, as some of our jobs have become more complex, working with and understanding the tooling has produced diminishing returns.
 
### AWS Lambda
[AWS Lambda](https://aws.amazon.com/lambda/) is a stateless computation-as-a-service (CaaS?) platform, or as Amazon put it: 
> AWS Lambda is a compute service where you can upload your code to AWS Lambda and the service can run the code on your behalf using
> AWS infrastructure. After you upload your code and create what we call a Lambda function, AWS Lambda takes