Martian发布AI Frontier：多模型路由优化成本与质量
Picking one "best model" is starting to look like the wrong unit of optimization…
打破单模型迷信的工程实践，用真实数据证明多模型路由在降本增效上的显著优势，适合Agent开发者参考架构设计。
Picking one "best model" is starting to look like the wrong unit of optimization.
挑选一个“最佳模型”正开始显得不是正确的优化单元。
@withmartian just released AI Frontier, a dashboard for comparing LLMs by task, quality, actual cost, and reliability, then seeing whether combining different models gives better results.
@withmartian 刚刚发布了 AI Frontier，这是一个用于按任务、质量、实际成本和可靠性比较 LLM 的仪表板，并查看组合使用不同模型是否能带来更好的结果。
Across 16 benchmarks, Martian’s oracle routing cut average error 54% at matched cost, or matched each benchmark’s top-model quality at 85% lower API cost.
在 16 个基准测试中，Martian 的预言机路由在成本相当的情况下将平均错误率降低了 54%，或以低 85% 的 API 成本达到了每个基准测试中顶级模型的质量水平。
The idea is that there may be no single "best" LLM: Different models perform better on different workloads, so AI Frontier shows when choosing or combining models can produce a better mix of quality, cost, and reliability than using one model for everything.
其理念在于，可能并不存在单一的“最佳”LLM：不同模型在不同工作负载下表现更佳，因此 AI Frontier 展示了在选择或组合模型时，如何能产生比单一模型通吃所有场景更优的质量、成本与可靠性组合。
Output length, reasoning behavior, retries, and reliability all affect what you eventually pay to get a usable answer.
输出长度、推理行为、重试次数和可靠性都会影响你最终获得可用答案所付出的代价。
Martian is also measuring how consistently models solve the same kinds of problems, which makes the cost picture more useful. A cheap model that needs several attempts may not be cheap at the system level.
Martian 还在衡量模型解决同类问题的一致性，这使得成本图景更具参考价值。一个便宜但需要多次尝试的模型，在系统层面可能并不便宜。
Model economics should probably be measured as cost per acceptable result, not simply dollars per million tokens.
模型经济学或许应该以“可接受结果的单位成本”来衡量，而不仅仅是每百万美元的代币费用。
更进一步：量化金融体系
看懂新闻只是起点——沿量化金融路径，把它变成能交付的工程能力