Agents & architecture · Concept
AI gateway
Also called: AI gateways
A service that centralizes model routing, policy, observability, and provider access for AI applications.
Example
Route model requests through a gateway when shared policy, telemetry, or provider failover is an explicit requirement.
The distinction that matters
Product capabilities vary; verify routing, policy, privacy, logging, and failover behavior before relying on a gateway.
Related terms
Primary references
Reference definition