Who it’s for
AI and platform engineers who:- Ship LLM-powered applications or agents to production
- Need observability over non-deterministic model behavior
- Want inline security — PII detection and blocklist matching applied in the request path, before anything reaches the provider
- Run more than one provider and want a single interface in front of them
What you get
Gateway
An LLM proxy between your application and your providers, adding under a millisecond of overhead. One endpoint for every provider you connect, each called with the SDK whose wire format it speaks, plus inline security and streaming. See Deploy.Observability
Point your SDK at the gateway and every call becomes an OpenTelemetry-native trace: model, tokens, latency, and optionally the prompt and completion. See Instrument and Observe.Evaluation
Coming soon — score and compare your application against recorded traces. See Evaluate.
How it’s organized
Everything nests into Organization → Workspace → Project. See Core Concepts.Next steps
Quickstart
Send your first traced request.
Core concepts
How to11 is organized.