The Pulse of LLMOps, FinOps
& AI Infrastructure
Intelligence for engineers building and operating AI infrastructure at scale. LLMOps, FinOps, Kubernetes, and the tools that keep production AI running.
Deep Technical Guides
Benchmarks run on real infrastructure. Config files you can copy-paste. No vendor fluff.
Cost Optimization Playbooks
Datadog to Grafana migrations. GPU budget triage. Reserved instance strategy. Real savings.
Production Incident Frameworks
Postmortem templates for AI failures. Runbooks your on-call team will actually use.
Latest Articles
View all →MCP Proxy Observability: NGINX, Kong, Envoy at L7
How to get real MCP telemetry at the proxy hop when you did not write the servers — JSON-RPC method extraction, SSE metrics, NGINX, Kong and Envoy configs.
HAMi CNCF Incubating: Heterogeneous GPU Sharing 2026
HAMi moved from CNCF Sandbox to Incubating on 2026-07-02. Vendor-neutral GPU sharing for NVIDIA, AMD, Ascend, Cambricon, Hygon, Iluvatar.
Detecting Rogue AI Agents on Your API: Reverse-Engineering Cloudflare Precursor's Threat Model
Server-side signals fail: agents now look identical to humans on the wire. The 5 client-side signal categories Precursor uses, the open-source stack to add them, and the inverse problem — legitimate agents looking less like bots.
ClickHouse + HyperDX for Full-Fidelity LLM Traces 2026
Self-hosted ClickHouse + HyperDX: $180/mo vs Helicone $4,200/mo, OTel gen_ai.* schema, 26.7.4 LTS vs 26.3.19 LTS compatibility.
Claude Opus 5 Cost-Aware Agent Orchestration on AWS
Route agent work across Claude model tiers without hiding cost, quality, fallback, or data-retention decisions. Includes an OTel contract and rollout playbook.
AI Coding Agent Observability 2026: Six Tools
Claude Code 1.0, Gemini CLI, Codex CLI, OpenCode, GitHub Copilot, AWS Kiro: per-tool OTel hooks, normalized schema, Concord coordination, Gomaa shared_db.
Stay ahead of the stack.
Weekly intelligence on LLMOps, FinOps, and AI infrastructure. No fluff, no vendor pitches. Written by practitioners, for practitioners.