The beauty in markets is the pattern of large, diverse groups of independent individuals collectively making better judgments and decisions than any single expert. OpenRouter sees trillions of tokens every day, and we’ve been working on a new way to share the collective wisdom of these millions of people making model decisions.
Today we’re launching a major update to our Auto router：https://openrouter.ai/openrouter/auto ( openrouter/auto ) that’s informed by the over 55T in weekly token spend on OpenRouter. We’ve found that model selection driven by market spend outperforms the choices of our old Auto router across a wide spectrum of tasks and cost levels. By referencing the past 7 days of OpenRouter usage, it always stays up to date with new model releases.
We’ve been testing this approach in beta with thousands of people over the past few weeks and today we deployed it for everyone using the Auto router. Try it now by sending "model": "openrouter/auto" to any of our inference endpoints, or read the docs：https://openrouter.ai/docs/guides/routing/routers/auto-router for details.
We designed the router for versatility, so we evaluated it against a deliberately diverse set of benchmarks: MMLU Pro (Knowledge), τ³-bench Banking (Agents), WideSearch (Search), DSQA (Research), and SWE-Atlas QnA：https://github.com/scaleapi/SWE-Atlas (Coding).
To be confident in the new router’s selections at the default cost level, we needed to see it achieve the same level of performance as the old router while reducing costs. We saw this in most domains, with a few exceptions where the old Auto router was underperforming modern budget models. At the max cost level, our bar was frontier performance even if it ended up costing more than the old router.
Default on the new router is cost_tier=low and cost_quality_tradeoff=7 on the old router. Max compares cost_tier=max to cost_quality_tradeoff=0 .
These results capture a moment in time and will shift as community preferences change over time. We’re using benchmarking to understand relative performance between routing strategies to build confidence that the wisdom of the crowd truly is getting you improved results. Our hypothesis is that efficient model selection will improve with time as more people adopt OpenRouter.
The new router’s default cost tier will be cost-efficient across a range of workloads, while max allows a broader range of high-cost models for when performance matters more than spend.
Any routing strategy that switches between multiple models will incur some increased costs when input cache is rebuilt. Often this cost is worthwhile in order to move to a model better suited to a new task, but can be wasteful if the model switches too frequently. The Auto router implements “sticky” behaviors to keep multi-turn conversations on one model until the model being used is no longer a leading choice for your task.
The new Auto router makes decisions based on what the people using OpenRouter, in aggregate, are using for exactly the kind of task your prompt represents. Think of it like a market index that always stays up to date and gets more efficient the more people use OpenRouter.
The model mixture below shows how the new Auto router’s routing curve maps each task type to the cost_tier settings: low, medium, high, xhigh, and max. It is a point-in-time view: the routing curve shifts as new models launch and the OpenRouter community’s usage patterns change.
This snapshot is current as of August 10. See the rankings page：https://openrouter.ai/rankings for the latest.
Classify the task. A fast, lightweight classifier assigns each prompt one of ~30 fine-grained task types, such as code debugging, multi-step agent planning, knowledge Q&A, math, customer support, or research reports.
Rank by real-world spend share. For that task type, the new Auto router looks up which models the OpenRouter community actually spends on over the past 7 days, similar to the “Share of Spend” view from our rankings page：https://openrouter.ai/rankings. This is a live signal: when people migrate a workload to a new model, the router follows within days.
Apply your cost tier. The cost_tier setting (low, medium, high, xhigh, or max) sets how much you’re willing to spend and selects the matching cost band of candidates. At low, routing stays with the cheapest capable models for each task; at max, it picks from the most capable, priciest models.
Route with fallbacks. The selected models become the primary pick plus fallbacks, ordered by their share of usage. Routing respects the model and provider restrictions on your request and account, like allowed models, guardrails, and ZDR policies. If classification or rankings are ever unavailable, the router falls back to a default model set, so a request never fails because of a routing problem.
Across turns, the router remembers the model a conversation landed on and prefers it on later turns. It identifies a conversation from an explicit session_id when provided, or from a fingerprint of the messages otherwise. Candidates are still ranked from scratch each turn, and the remembered model is reused only while it remains among the top candidates, so a better-suited model can take over when the task changes.
The Auto router works wherever you’d normally put a model string:
Or set your cost tier and restrict the candidate set:
The cost_tier parameter accepts low, medium, high, xhigh, or max, and sets how much you’re willing to spend: low routes to the cheapest capable models, max always picks from the most capable ones. The old Auto router exposes a numeric cost_quality_tradeoff setting where 0 is the high-quality setting and higher values are more cost-sensitive, defaulting to 7. The cost_quality_tradeoff parameter is still accepted for backwards compatibility and keeps its original cost-ceiling behavior, and it takes precedence if you send both.
The response’s model field tells you which model was selected, and there’s no additional fee; you pay the standard rate for whichever model runs. See the new Auto router docs：https://openrouter.ai/docs/guides/routing/routers/auto-router for details, including session stickiness for multi-turn conversations.
We’ll continue improving this router to optimize model selection and cache performance over time. Anyone who wants to try the newest routing behaviors first can use openrouter/auto-beta , where those changes land before they reach openrouter/auto . The new router has been running here for a couple of weeks, with thousands of people using it for real workloads. Tell us what you see in our Discord：https://discord.gg/openrouter or through your account representative.
情报判断
Aioga 编辑摘要
Aioga 编辑摘要：OpenRouter 基于每周超 55T token 的社区消费数据，推出新版 Auto 路由器（openrouter/auto），其模型选择在多数任务和成本档位上优于旧版。 Aioga 将其归入「行业动态」方向，重点关注它对真实使用和行业竞争的影响。
扫码直达文章详情