Speed is a feature. Today, we go behind the scenes with 6 infrastructure and performance improvements our team shipped to make working with data faster and more reliable. Tinybird engineers solve the hard problems so you can go fast without worrying about scaling. Here's what we shipped ↓ 📈 KEDA + Tinybird Autoscaling We ditched Prometheus for autoscaling, and we don't miss it. Instead of Prometheus, we use a real-time metrics from a Tinybird API + KEDA for faster, simpler autoscaling. Now we avoid all the service hops and scraping delays, with no extra monitoring stack to manage. Read more -> tbrd.co/keda 🪚 EKS + Karpenter Optimization We cut AWS costs by 20% overall (90% on CI!) with intelligent node provisioning using Karpenter. We eliminated hundreds of NodeGroups that we used to manage manually. Read more -> tbrd.co/karpenter ☯️ Compute-Compute Separation We isolated resource-intensive populate operations so they never impact your production queries, regardless of data volume. Read more -> tbrd.co/csquared ⫚ Multi-Writer Ingestion We built a distributed, multi-writer ingestion service. Even with compute-compute separation, single writers can hit capacity limits at petabyte scale. Now, we smartly and safely distribute the load across multiple writers. Read more -> tbrd.co/multiwriter 🚣 25% less CPU usage for ClickHouse streaming ingestion We rewrote our JSON to ClickHouse RowBinary conversion in C++ using ClickHouse internals plus some of our own magic for a big performance improvement in the critical ingestion path. We learned a ton. Read more -> tbrd.co/rowbinary 🧠 Making automatic ClickHouse schema migrations safer and smaller Tinybird handles all of the details of schema migrations in ClickHouse. Our prior approach was a bit brute force. It worked, but it was inefficient. We optimized the deployment algorithm to avoid migrating terabytes of unnecessary data. What used to take days now takes minutes. Read more -> tbrd.co/smartdeploy --- Each improvement emerged from real production challenges at scale. The infrastructure complexity we solve is the complexity you don't have to build. Speed wins.
