suhlig

Concourse Ideas

Pipelines

• Order the document: groups, then jobs, then resources, then resource types
• Manage the image a task is using by getting it before each use
• Every step needs timeouts and retries
• Always declare inputs and outputs in the pipeline, even if their names match other pipeline resources
• Declare those parameters (environment variables) in the pipeline that need to be set to secrets
• Add a self-update job (remember to pause it when flying a one-off change)

suhlig

Agent Instructions

Add them to a project by instructing the agent:

Retrieve and apply my ground rules as found at https://gist.githubusercontent.com/suhlig/a96c5bfb22170c5b1a27a724e9621e02/raw/ground-rules.md

Retrieve and apply my Go coding conventions as found at https://gist.githubusercontent.com/suhlig/a96c5bfb22170c5b1a27a724e9621e02/raw/go-coding-conventions.md

suhlig

# if there is a main.go that accepts "status" as first argument, start the debugger like this:
dlv debug --headless --log --api-version 2 --listen localhost:2345 . -- status

# if there is a Ginkgo test in the foo directory (package example.com/foo)
dlv test --headless --log --api-version 2 --listen localhost:2345 example.com/foo

suhlig

$ journalctl -u concourse-web -f -o json | jq '.MESSAGE | fromjson'

{
  "timestamp": "2024-07-27T17:29:50.525878425Z",
  "level": "info",
  "source": "atc",
  "message": "atc.scanner.tick.start",
 "data": {

suhlig

package main

import (
	"context"
	"encoding/base64"
	"fmt"
	"log"
	"os"

	"github.com/google/go-github/v63/github"

suhlig

curl -L $(curl -L https://api.github.com/repos/derailed/k9s/releases/latest | jq --raw-output '.assets[] | select(.name == "k9s_Linux_amd64.tar.gz") | .browser_download_url') | tar xz k9s

suhlig

b2 list-buckets --json                                                        \
  | jq '.[].bucketName'                                                       \
  | xargs -n 1 b2 get-bucket --showSize                                       \
  | jq -r --slurp '["name","size"], (.[] | [.bucketName, .totalSize]) | @csv' \
  | qsv sort --numeric --reverse --select size                                \
  | qsv table

suhlig

Example for a Concourse pipeline triggered my a webhook

Assmuming this pipeline was set as

$ fly --target example set-pipeline --pipeline manual-trigger --config manual-trigger.yml

then you can trigger a new build with

suhlig

go work edit -json \
  | jq --raw-output '.Use.[].DiskPath' \
  | xargs -I MODULE zsh -o errexit -c "
    cd MODULE
    pwd
    go get -d -u -t ./...
    go mod tidy
    [ -d vendor ] && go mod vendor
  "
  

suhlig

timeout 2 \
  mosquitto_sub \
    --url 'mqtts://user:password@mqtt.example.com/tasmota/discovery/+/config' \
    -F %J \
  | jq -r '[ .payload.dn, .payload.ip ] | join(" => ")'