GCP Without Static Keys: How to Authenticate EC2 and GitHub Actions
We run OpenVPN so employees can reach internal resources. Authentication goes through Google Workspace. An employee with a Google account …
Read More// blog
Infrastructure Engineering
Deep dives into AWS, Terraform, CI/CD, and the craft of building reliable infrastructure for startups and growing teams.
A Container That Couldn't See Its GPU: Autoscaling GPU Workloads on ECS
We shipped GPU autoscaling for our ECS module. Version 8.3.0 added a target-tracking policy that scales the service on GPU utilization, and …
Read More
Your model download is disk-bound, not network-bound
The last post ended with a number and a promise. We had …
Read More
The database is the adult in the room when you build with an AI agent
An AI coding agent gives you velocity: ship the feature, reshape the schema, keep moving. A relational database gives you consistency: ACID …
Read More
The classic model-distribution answer, and what happened when we measured it
The last post ended with a loose thread. The fetch step downloads the whole model to every node, every time a node comes up. That is fine …
Read More
Serving a 7B Model on ECS GPU Instances You Own
An ML developer came to me with a model to serve. He had already made the decisions that matter most: an open model tuned for his use case, …
Read More
CI Was Failing Every Other Day for Months. We Couldn't Debug It Without Our Audit Logs.
On January 30 this year, I filed an issue against our self-hosted GitHub Actions runner module
Read More
ISO 27001 on AWS: Building Compliance Into the Architecture
The startup I work with builds AI agents for enterprises. I handle the infrastructure. The founders and their engineers build the product.
Read More
Nobody Wants to Create a New Repo
I run infrastructure for a startup. Over the past two years I’ve built a system that manages the company’s entire GitHub …
Read MoreOne Repo to Rule Them All: Managing 100+ GitHub Repos With Terraform
I run infrastructure for a startup. When I joined, the GitHub organization had a handful of repos created by hand through the web UI. …
Read More