hneiva

Update-Verify I/O Performance Investigation

Date: 2026-03-20 to 2026-03-24

TL;DR

Update-verify tasks run ~6 minutes slower on AMD workers (b-linux-docker-amd) because those GCP machines (c3d-standard-16-lssd) only get 1 NVMe SSD, while Intel workers (c2-standard-16) get 2 NVMe SSDs in an LVM stripe, giving ~2x I/O throughput for the large-file copy pattern.

It's a provisioning asymmetry, not a CPU/Docker/image issue. AMD machines with 2 NVMe drives (c3d-standard-30-lssd) match Intel IO performance exactly.

---

hneiva

# From firefox checkout, run:
# docker run -it --rm -v $(pwd):/work --platform linux/amd64 debian:13-slim bash

# Install requirements
apt update && apt install python3 python3-pip zstd wget -y
pip install -r /work/taskcluster/docker/partials-zucchini/requirements.txt --break-system-packages

mkdir /workspace

# This is the "to-mar" complete

hneiva

#!/usr/bin/env python3
"""
procio_monitor.py
A lightweight 'iotop-like' Python script to continuously list processes
with the highest disk read/write activity in bytes/sec over a sampling interval.

Requirements: psutil

Usage examples:
  python procio_monitor.py                # default: interval=1.0s, top 15, sort by write

hneiva

{
  "version": "0.2.0",
  "configurations": [
    {
      "name": "Taskgraph full",
      "type": "python",
      "request": "launch",
      "program": "",  // <---- Add value from `pyenv which taskgraph` (or just `which taskgraph` if you don't use pyenv)
      "console": "integratedTerminal",
      "args": ["full", "-p", "taskcluster/test/params"], // Adjust these as needed

hneiva

Docker rcodesign instructions

Note: Apple Transporter is only required for notarizing software

Resources

• PyOxidizer - Install instructions
• Apple Transporter - Install instructions
• Rust apple_codesign - Docs

Requirements

hneiva

[Unit]
Description=TeamCity Server
After=network.target

[Service]
Type=forking
PIDFile=/opt/teamcity/logs/teamcity.pid
; Make sure the CATALINA_PID env variable is setup in $TEAMCITY_HOME/bin/catalina.sh
User=teamcity
ExecStart=/opt/teamcity/bin/teamcity-server.sh start

hneiva

-- Create extensions
create extension postgis;
create extension hstore;
create extension fuzzystrmatch;
create extension postgis_tiger_geocoder;
create extension postgis_topology;

-- Change owner of schemas
alter schema tiger owner to rds_superuser;
alter schema topology owner to rds_superuser;