Omar Sar实测Jev Router:成本减半且延迟更低
This is one of the strongest use cases I've seen for System One models like Jev.
Agent开发者必看,实测数据证明Jev Router能显著降低调用成本并提升响应速度,为构建高效自定义Harness提供了可落地的路由方案参考。
This is one of the strongest use cases I've seen for System One models like Jev.
这是我见过的 System One 模型(如 Jev)最强大的用例之一。
Pay close attention if you build custom harnesses.
如果你构建自定义 harness,请密切关注。
Jev is now available as a packaged router.
Jev 现在作为打包好的路由器提供。
What is it?
它是什么?
You send the conversation to typesafe/jev-router, and OpenRouter picks the model and reasoning effort for each request.
你将对话发送到 typesafe/jev-router,OpenRouter 为每个请求选择模型和推理强度。
Choosing the right model and reasoning effort is an art, and doing it manually is inefficient, to say the least.
选择合适的模型和推理强度是一门艺术,至少可以说,手动操作效率低下。
It makes sense to offload reasoning effort, but you want to do it efficiently, smartly, and cheaply. System One Models like Jev are a great fit for this.
外包推理强度是合理的,但你希望以高效、智能且低成本的方式完成。像 Jev 这样的 System One 模型非常适合这一需求。
Does it work?
它有效吗?
I tested Jev Router on a small support agent built with a custom harness I built with the Pi SDK.
我在一个使用 Pi SDK 构建的自定义 harness 的小型支持代理上测试了 Jev Router。
I ran the same 8 cases against a fixed GPT-6 Sol baseline, 32 real calls in total.
我将相同的 8 个案例与固定的 GPT-6 Sol 基线进行了对比,总共进行了 32 次真实调用。
Both got every case right.
两者都正确回答了所有案例。
The router cost less than half as much ($0.008 vs $0.018) and had a lower median response time (1.5s vs 1.9s).
路由器的成本不到一半(0.008 美元 vs 0.018 美元),中位响应时间也更短(1.5 秒 vs 1.9 秒)。
The sample is small, but it's clear that, at scale, this could make a huge difference in cost and efficiency.
样本量虽小,但很明显,在大规模应用时,这会在成本和效率方面带来巨大差异。
One of my biggest concerns about Jev-as-a-Router is caching. While it's not fully solved, Jev Router gives me hope for smarter, more efficient routing patterns in custom harnesses that leads to better tradeoffs.
我对 Jev-as-a-Router 最大的担忧之一是缓存问题。虽然尚未完全解决,但 Jev Router 让我对自定义 harness 中更智能、更高效的路由模式充满希望,从而带来更好的权衡。
I have shared an implementation of a routing pattern I'm excited about here: https://academy.dair.ai/resources/jev-decisions-in-a-pi-sdk-harness
我在这里分享了一个我兴奋不已的路由模式实现:https://academy.dair.ai/resources/jev-decisions-in-a-pi-sdk-harness
The takeaway here is that Jev is unlocking interesting new patterns (routing, verification, guardrails, dynamic workflows, judges, and more) that you can tap into in your custom harness.
这里的要点是,Jev 正在解锁有趣的新模式(路由、验证、护栏、动态工作流、裁判等),你可以在你的自定义 harness 中利用这些模式。
I expect this trend to continue growing. And harnesses that are easier to customize, like Pi, will benefit even more.
我预计这一趋势将持续增长。而更容易定制的 harness(如 Pi)将受益更多。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力