Cloudflare Unifies Workers AI and AI Gateway into a Single AI Control Plane

Cloudflare Unifies Workers AI and AI Gateway into a Single AI Control Plane Cloudflare is integrating Workers AI and AI Gateway into a unified control plane, combining managed GPU inference with proxy observability, consolidated billing, and future model-first routing capabilities. A shared AI binding and unified /ai/ REST endpoint allow requests to automatically generate and route through a default gateway for logging and token tracking. AI Gateway credits can now be used for Workers AI usage, and unified billing grants elevated rate limits on Workers AI models. A forthcoming model-first routing system will automatically load balance and fail over identical model workloads across multiple vetted providers. An upcoming intelligent routing system will use prompt classification running on Workers AI to autonomously pick the optimal model for a given task. Unified Entrypoints and Observability Developers can now access Workers AI and AI Gateway via a unified AI binding or the /ai/ REST endpoint. Specifying 'default' as the gateway identifier automatically provisions an AI Gateway instance on the first authenticated request, immediately capturing full request and response payloads, token counts, error rates, and cost attribution without manual dashboard setup. Consolidated Billing and Elevated Rate Limits Cloudflare has unified billing, allowing users to draw from a single pool of AI Gateway credits to pay for external providers such as OpenAI and Anthropic alongside Workers AI. Customers who adopt pre-paid unified billing for Workers AI also receive elevated model rate limits. Model-First and Intelligent Routing Roadmap Cloudflare is testing model-first routing, which abstracts the underlying host so users request a specific model while AI Gateway manages transparent failover and capacity load balancing among vetted providers respecting Zero Data Retention policies. In addition, an internal pilot uses a Workers AI prompt classifier and heuristic scorer to evaluate task complexity and autonomously route queries to the most suitable model without configuration.

Cloudflare 整合 Workers AI 与 AI Gateway，构建统一 AI 控制平面 Cloudflare 宣布将 Workers AI 与 AI Gateway 整合至统一控制平面，实现接入入口、流量观测与预付费计费的打通，并公布了后续以模型为核心与意图驱动的智能路由演进规划。 开发者可通过统一的 Workers binding 或 `/ai/` REST API 调用模型，传入 default 网关 ID 即可自动开启可观测性与日志。 AI Gateway 积分现已支持用于 Workers AI，实现跨外部厂商与托管服务的统一计费，并提供更高的速率限制。 未来将推行以模型为中心的路由机制，在 Workers AI 与外部提供商之间透明实现负载均衡与故障转移，同时遵守零数据保留要求。 正在内测基于任务分类的智能路由，由 Workers AI 分析提示词复杂度并自动匹配性价比最优的模型。 入口统一与开箱即用的观测能力 Workers AI 和 AI Gateway 的接入入口已通过统一的 Workers binding 和 `/ai/` REST API 完成整合。开发者无需预先在后台配置 AI Gateway，只需在调用中指定 default 网关 ID，系统便会在收到首个已认证请求时自动创建网关，提供包含完整请求响应内容、按模型统计的 Token 消耗、错误率及成本归属在内的全链路监控。 跨提供商统一计费与提额 AI Gateway 积分现已覆盖 Workers AI。此前积分仅限用于 OpenAI、Anthropic 等第三方提供商，如今开发者可通过单个钱包余额统一支付各类模型推理费用。为了鼓励采用该预付费路径，Cloudflare 还为使用统一计费的用户提供了提升后的 Workers AI 模型速率限制。 模型优先路由与智能任务匹配 Cloudflare 计划在未来数月测试“模型优先”路由：用户只需指定所需模型权重，网关会自动在 Workers AI 基础设施与其他合规第三方提供商之间处理容灾与负载均衡，且遵循零数据保留（ZDR）规则。此外，团队正在内部测试免配置的智能路由，利用运行在 Workers AI 上的分类器预判提示词任务类型与上下文需求，自动从模型池中调度最优模型以平衡性能与成本。

AI Gateway and Workers AI first started as distinct products, but over time, we noticed our users were converging. With AI Gateway, you can proxy requests to any model provider and get built-in observability, logging, access, and security. On Workers AI, we host models on the GPU infrastructure that we manage, exposing an API endpoint you can leverage to access inference-as-a-service. The architecture of these products looks different, but to an end user, it achieves the same goal: connecting you to models with a sophisticated control plane. Today, we're excited to share our plans on how these products converge into one unified path, so you can connect to any model provider (including Workers AI), while managing things like observability, billing, security, and logging from a single control plane. It’s the next step toward some big plans we have — read on to learn what a unified control plane means for the future of model routing. We've been hinting at the fact that these products are becoming more unified through our entrypoints: the Workers binding and the REST API. We have an AI binding that you can use to call AI Gateway and Workers AI. There's no concept of a separate AI Gateway and Workers AI binding: it all goes through the same path. We shipped the idea of a “default” gateway a few months ago, so that if you have never set up an AI Gateway before, you could still automatically inherit the AI Gateway observability and logging. Of course, you can still specify your own gateway if you'd like to split up applications into multiple projects. Here's what the binding call looks like, if you are calling Workers AI via AI Gateway: We’ve also announced a single unified REST API — the /ai/ endpoint that allows you to make similar calls to Workers AI via AI Gateway. Doing this allows us to unify the entrypoints to AI Gateway and Workers AI, so you don't need to make a choice between which product to use first: it all comes with batteries included. One of the most immediate benefits of this convergence is that you no longer need to explicitly create an AI Gateway before you start getting visibility into your inference traffic. If you've never set up a gateway before, just pass default as the gateway ID in your binding or REST API calls, and AI Gateway will create it automatically on the first authenticated request. With this, every request is logged with full request and response payloads, token counts are tracked per model, and you get cost attribution without any dashboard setup. If you later outgrow the default gateway — if you want custom caching rules or to split traffic by application — you can create a named gateway and point your requests at it with a single parameter change. Here's how it looks in the binding. Before, you called Workers AI directly: Now, add a third argument to route through AI Gateway and get full observability: Head to the Cloudflare AI Gateway dashboard and you'll see every request: latency breakdowns, token usage, error rates, and the exact prompts and responses. For teams debugging model behavior or auditing AI output, this is a huge upgrade from flying blind. A new thing we're launching today is the ability to use AI Gateway credits for Workers AI. Before, you could only use AI Gateway credits on external model providers (e.g., OpenAI, Anthropic) but you couldn't apply your AI Gateway credits to Workers AI usage just yet. We've finally enabled our systems to allow unified billing for Workers AI. This means that you can load a wallet full of credits, and then choose to spend that across OpenAI, Anthropic, Workers AI, or any provider that we support. Since we're now offering pre-paid billing for Workers AI and want to encourage users to use this new path, we're also offering elevated rate limits on Workers AI models if you use AI Gateway unified billing. Please refer to the [developer docs](https://developers.cloudflare.com/changelog/post/2026-08-07-workers-ai-unified-billing/) for up-to-date information regarding rate limits, as well as how to request a higher rate limit. With all your inference traffic flowing through a single control plane, we can start making smarter decisions about how to serve each request starting with the model you want, not the provider you have to manage. Provider-first routing forces you to think about infrastructure: "Which provider do I call? What if they're down?" Model-first routing flips that. You think about what you need — a capable reasoning model, a fast summarizer, a cheap embedding model — and the control plane handles provider selection, failover, and load balancing. Today, if you want to call a model, you have to know which provider hosts it. If that provider is down or rate-limiting you, your application breaks. We're moving toward a world where you specify the model, and AI Gateway handles the rest. This way, you can request Kimi K2.7 Code and not care whether it comes from Workers AI, Moonshot's own API, or another provider that hosts the same weights. If Workers AI has capacity, you get the benefit of our managed infrastructure. If Workers AI is at capacity, the gateway transparently load balances you to another provider that can serve the same model. You can still choose to stick to a single provider if you’d like, but model-first routing enables you to get more flexibility if you care about resiliency. We work with vetted providers, so the quality of model outputs remains top priority, and will also be able to respect requirements such as Zero Data Retention (ZDR). This also means better resiliency by default. If one provider's version of a model is having issues, traffic shifts to another without application-level retries or complex fallback logic in your Workers. The gateway treats model availability as a routing problem. We hope to pilot this in the coming months for all AI Gateway and Workers AI users. The next evolution of routing goes beyond simple failover. We're building intelligent routing that understands what you're asking for and picks the right model for the job without any configuration required. Instead of specifying a model, you can let the gateway decide. Under the hood, a classifier running on Workers AI reads your prompt and predicts what kind of task it is (coding, research, summarization, general Q&A), how complex it is, and how much context matters. A heuristic scorer then maps that to the best model from a curated pool. For teams that want control, you can still specify exact models. For everyone else, the zero-config path means you get better economics and performance without maintaining your own routing logic. We are currently piloting this internally, and we’ll be actively testing and iterating in the next few weeks before release. If you're already using Workers AI, the easiest way to try this out is to start routing your existing calls through a default gateway. You'll immediately get request logging, token tracking, and cost attribution without changing anything else about how you call the models. If you're already using AI Gateway, adding Workers AI to the mix is as simple as calling a Workers AI model. Load up your AI Gateway wallet and you'll get unified billing across every provider we support, plus elevated rate limits on Workers AI models. [Set up your first gateway](https://developers.cloudflare.com/ai-gateway/get-started/), browse the [Workers AI model catalog](https://developers.cloudflare.com/workers-ai/models/), and get started building today.