Observability for LLM Traffic: Collect, Filter, Enrich, Route
TL;DR
* An observability pipeline for LLM traffic moves telemetry through four stages: collect at the AI gateway, filter payloads and low-value spans, enrich with cost and routing context, and route each signal to the backend that can use it.
* LLM telemetry breaks conventional pipelines on four axes: multi-