This is the roadmap for the Speedshop Ruby on Rails performance retainer service. It was last updated March 28th, 2025. Items are in rough priority order.
In-Progress:
- Alerting and dashboard scorecards: We want everyone to be on the same footing with SLOs for queues and tracking our core set of 20 metrics, plus your app's specific key metrics (see next bullet). The output will be a scorecard page that's pass/fail on each point.
- Formalizing key metrics with everyone: Since we started the retainer, we learned it's helpful to have a set of 3 or fewer key metrics to monitor and improve upon over the course of the retainer. If we haven't already formalized these with you, we'll do so.
- Automated checks: jemalloc, YJIT, RMP, SQL comments, bcrypt version. We have a few automated checks that can be implemented just by reading your source code and doing a couple of static checks. We'll also ship some detailed guides for