Observability

2 posts tagged

Published on: 8 min read

Observing LLM Inference: The Metrics That Actually Matter

Observability AI Platform-Engineering Kubernetes Architecture-Patterns

TTFT is your SLO, not throughput. Here is what to measure for LLM inference, and what Google ADK, LangChain, and LangGraph give you out of the box.

Published on: 8 min read

Multi-Tenant Observability: LGTM at Platform Scale

Kubernetes Observability Platform-Engineering Multi-Tenancy Architecture-Patterns

Your tenants want dashboards. Your security team wants isolation. Your SREs want a single pane of glass. Here is how to build all three with the LGTM stack.