Challenge For more than ten years, HDFC Bank’s payments infrastructure reliably supported the organization’s growing digital banking ecosystem. However, the rapid acceleration of digital payment adoption and the emergence of real-time financial services created new requirements…
How a vector database platform eliminated manual operations and cut costs by 40% The organization operated their infrastructure with manual processes on Google Cloud Platform (GCP). As the platform scaled to support enterprise AI/ML workloads, the…
Why your agent needs access to your documentation
What 1,192 agent conversations taught us about knowledge base search A few months ago we shipped an agent inside our own product. It lives in our web app and lets users ask questions about their deployment,…
Why goodput matters more than throughput for LLM serving
When we benchmark an LLM serving setup, the number almost everyone reaches for first is throughput: how many requests per second the system can push through. It is easy to measure, easy to compare, and it…
Collaboration with CNCF reflects Broadcom’s continued investment in open source innovation, cloud native resilience and the technologies powering the next generation of AI workloads Key Highlights SAN FRANCISCO, California — July 16, 2026 — The Cloud…
HAMi becomes a CNCF incubating project
The CNCF Technical Oversight Committee (TOC) has voted to accept HAMi as a CNCF incubating project. About HAMi Modern AI infrastructure teams run into the same problem over and over: expensive GPUs often sit fragmented and…
The 4-body problem of SRE: Why autonomous operations depend on context
What a room full of senior SREs confirmed about the trust gap, and where the actual work begins I spent a day last week at an event in Bengaluru asking a room full of senior SREs,…
Challenge: Scaling Infrastructure Without Linear Team Growth Operating Kubernetes at large scale required more than deploying clusters. Manual provisioning and ad-hoc operations would not scale, and planned maintenance could not be disruptive. As internal adoption increased,…
Kepler, re-architected: Improved power accuracy and a community call to action!
Thank you to Laura Llinares, Mary Baldwin Hughes, Vimal Kumar, and Sunil Thaha for their significant contributions to this blog post and the Kepler project. Data centers accounted for 1.5% of global electricity demand in 2024,…
OTel and mesh-derived metrics: A 2026 reference
If you already run an OpenTelemetry pipeline, you have good visibility into what your applications are doing. This blog post is about what you don’t see yet: the east-west traffic between your services, measured at the…