Cloudflare AI Gateway is a free AI observability and control layer that proxies requests to OpenAI, Anthropic, Google, and 25+ providers with caching, rate limiting, logging, DLP, and Guardrails.
Cloudflare AI Gateway is a free AI observability and control layer that proxies requests to OpenAI, Anthropic, Google, and 25+ providers with caching, rate limiting, logging, DLP, and Guardrails.
Cloudflare AI Gateway sits in front of your LLM calls and gives you a single endpoint that proxies to OpenAI, Anthropic, Google AI Studio, Vertex AI, Workers AI, Amazon Bedrock, Azure OpenAI, Cohere, DeepSeek, ElevenLabs, Fal AI, Groq, HuggingFace, Mistral, OpenRouter, Perplexity, Replicate, xAI, and more — with one line of code change in your existing SDK call. The product is free on all Cloudflare plans for the core features (analytics dashboard, caching, rate limiting, persistent logs, DLP scanning, BYOK), with log storage capped at 100,000 logs total on Workers Free and 10,000,000 logs per gateway on Workers Paid. Guardrails (input/output safety scanning with @cf/meta/llama-guard-3-8b) is billed through Workers AI Neurons. The killer feature is Unified Billing: one Cloudflare invoice for every model you call, with provider-native APIs preserved. Dynamic routing (beta) lets you A/B providers or fail over from one model to another. Compare with <a href="/tools/portkey">Portkey</a> and <a href="/tools/openrouter">OpenRouter</a> for routing-first alternatives, <a href="/tools/helicone">Helicone</a> and <a href="/tools/langfuse">Langfuse</a> for observability-first alternatives, and <a href="/tools/litellm">LiteLLM</a> for the self-hosted gateway pattern.
Was this helpful?
Cloudflare AI Gateway provides essential observability and control for production AI applications. The combination of caching, rate limiting, and analytics makes it valuable for any organization running AI at scale.
Free
$5/month base (Workers Paid plan) — AI Gateway features themselves free
Variable — billed at provider rates
Ready to get started with Cloudflare AI Gateway?
View Pricing Options →Cloudflare AI Gateway works with these platforms and services:
We believe in transparent reviews. Here's what Cloudflare AI Gateway doesn't handle well:
Weekly insights on the latest AI tools, features, and trends delivered to your inbox.
Enhanced A/B testing capabilities for model comparison, improved caching algorithms with semantic understanding, expanded provider support including latest AI services, and advanced cost optimization recommendations based on usage patterns.
LLM Observability
Open-source LLM observability, gateway, and cost analytics platform — proxy your OpenAI, Anthropic, or Bedrock calls through Helicone and get traces, caching, retries, rate limiting, and cost tracking in one line of code.
AI Observability
LangSmith is LangChain's commercial observability, evaluation and prompt management platform for LLM apps and agents in production.
LLM Observability
Langfuse is an open-source LLM observability and engineering platform providing tracing, prompt management, evaluations, and dataset management for production AI applications.
No reviews yet. Be the first to share your experience!
Get started with Cloudflare AI Gateway and see if it's the right fit for your needs.
Get Started →Take our 60-second quiz to get personalized tool recommendations
Find Your Perfect AI Stack →Explore 20 ready-to-deploy AI agent templates for sales, support, dev, research, and operations.
Browse Agent Templates →An autonomous agent at a Fortune 500 company dropped a production database table at 3am on a Saturday. The guardrail that was supposed to prevent it? A hardcoded if-statement. Here's how to actually govern AI agents in production — with the frameworks, tools, and patterns that work.
Compare Firecrawl and Cloudflare's new Browser Rendering crawl endpoint for AI agent web scraping. Features, pricing, performance analysis for RAG pipelines and data extraction.