Running LLM Inference on Kubernetes: What It Actually Takes
Teams run their own LLM inference for a range of reasons: data privacy, cost control at volume, latency, the ability to fine-tune, or just the need to operate independently of third-party rate limits and pricing changes. When they say they want to run inference on Kubernetes, they usually mean they ... Read More
How Do I Run AI Workloads on Kubernetes Without Wasting GPUs?
Many teams want to run AI and ML workloads on Kubernetes but are worried about wasting GPUs, overcomplicating the platform, or breaking reliability for the rest of their services. The good news is that Kubernetes can work very well for model training, batch jobs, and real time inference, including LLM ... Read More
Can You Hear Kubernetes Sing—Sonifying Cluster Events For Curious SREs
On-call rarely feels quiet, even when your dashboards are green. There is fan noise, Slack pings, the hum of your laptop, and that subtle tension when you are watching graphs during a deployment. I started wondering what would happen if my Kubernetes clusters added their own soundtrack to that mix, ... Read More
Kubernetes Is Moving On From ingress‑nginx: How Are You Planning Your 2026 Migration?
Kubernetes’ community ingress‑nginx controller is officially retiring in March 2026, and that deadline is now squarely on the radar for platform and DevOps teams. This post distills what’s happening and what real teams are doing into a concrete, opinionated guide you can walk through with your stakeholders ... Read More
Rewriting the Rules of Platform Engineering with IDPs and EKS
Recently, we joined Amazon Web Services (AWS) to talk about one of the fastest-moving transformations in the cloud industry: how Internal Developer Platforms (IDPs) are streamlining modern software delivery. Andy Suderman joined me and Eli Peveto, AWS Partner Solutions Architect to walk through a strategic framework for building an IDP ... Read More
Top 5 Hard-Earned Lessons from the Experts on Managing Kubernetes
Kubernetes has transformed how modern organizations deploy and operate scalable infrastructure, and the hype around automated cloud-native orchestration has made its adoption nearly ubiquitous over the past 10+ years. Yet behind the scenes, most teams embarking on their Kubernetes journey quickly encounter operational complexity, configuration challenges, and costly maintenance that ... Read More
How to Streamline Your Kubernetes Add-On Updates and Stay Secure
Kubernetes add-ons are the backbone of modern clusters, powering everything from ingress and networking to observability, security, and automation. Without them, clusters aren’t production-ready. But as organizations scale, maintaining these add-ons stops being a small task and turns into a logistical nightmare ... Read More
Love Your Kubernetes Add-Ons: Securing Kubernetes Beyond the Core
Kubernetes has come a long way, from early pain points around cluster upgrades to more streamlined processes enforced by managed cloud providers. But one area still lagging behind in maturity, security, and operational best practices? Add-ons ... Read More
Kubernetes Add-Ons Need Love Too: Increasing Cluster Security
This is the transcript of a talk presented at KubeCon Japan titled "Add-Ons Need Love Too: Increasing Cluster Security Through Add-On Maintenance." ... Read More
Why Cause Chaos? The Benefits of Having a “Chaos Day”
“The best-laid plans of mice and men often go awry.” - Robert Burns, Scottish poet ... Read More

