决策AI模型解析:Jev、GLiDE与开源竞品对比
Decision AI Models Explained: TypeSafe Jev vs Fastino GLiDE, GLiNER2.5-Decide and Open-Source Competitors
决策模型是Agent架构的关键基础设施,Jev的极低延迟与成本优势可能重塑工具调用链路,做Agent的同学值得重点关注这一新范式。
What are Decision AI Models?
什么是决策 AI 模型?
Decision AI models are a new class of model that returns a decision, not a paragraph. You send text with typed questions. The model returns choices, scores or yes/no probabilities your code can branch on directly.
决策 AI 模型是一类新型模型,它返回的是决策而非段落。你发送带有明确问题的文本,模型返回选项、评分或 yes/no 概率,你的代码可直接据此进行分支判断。
The category went mainstream when TypeSafe AI launched Jev after 2 years in stealth. TypeSafe calls it a ‘System One model,’ after Daniel Kahneman’s fast, intuitive System 1 thinking.
在 TypeSafe AI 经过两年秘密研发后推出 Jev 时,该类别进入了主流视野。TypeSafe 将其称为“System One 模型”,灵感来源于丹尼尔·卡尼曼(Daniel Kahneman)提出的快速、直觉式的系统 1 思维。
Within 3 weeks, Fastino Labs shipped 2 rival models, and open-source developers published several Jev-style reproductions. This article covers how the category works, where it fits, and how the options compare.
在短短三周内,Fastino Labs 推出了两款竞争模型,开源开发者也发布了多个 Jev 风格的复现版本。本文将介绍该类别的工作原理、适用场景以及各选项的对比。
How Jev Works
Jev 的工作原理
Jev accepts a ‘state’ (a string, array or set of name-value pairs) and one or more questions. According to the TypeSafe docs, it supports 3 primitives:
Jev 接受一个“状态”(字符串、数组或一组键值对)以及一个问题或多个问题。根据 TypeSafe 的文档,它支持三种基本原语:
- Choice: pick one option from a list, with probabilities and confidence. TypeSafe says Jev supports up to 255 options.
- Score: rate the state on a rubric of ordered levels, with probabilities and confidence.
- Noul: a 0 to 1 probability that a statement is true. The name is short for Bernoulli.
- Choice(选择):从列表中选择一个选项,并附带概率和置信度。TypeSafe 表示 Jev 最多支持 255 个选项。
- Score(评分):根据有序等级的量表对状态进行评级,并附带概率和置信度。
- Noul:一个 0 到 1 之间的概率值,表示某个陈述为真的可能性。该名称是 Bernoulli(伯努利)的缩写。
Every question is evaluated in parallel and in isolation against the same state. Adding questions barely changes response time. Because Jev never generates strings, TypeSafe says it cannot return a type error.
每个问题都针对同一状态并行且独立地进行评估。增加问题数量对响应时间的影响微乎其微。由于 Jev 从不生成字符串,TypeSafe 表示它不会返回类型错误。
Under the hood, TypeSafe describes a new architecture, a parallel sampler and a training method called Reinforcement Learning for Calibrated Decisions (RLCD). RLHF optimizes for human preference. RLCD optimizes for calibrated probabilities, where higher confidence should mean higher accuracy.
在底层,TypeSafe 描述了一种新架构、一种并行采样器以及一种名为“校准决策强化学习”(Reinforcement Learning for Calibrated Decisions, RLCD)的训练方法。RLHF(基于人类反馈的强化学习)优化的是人类偏好,而 RLCD 优化的是校准后的概率,即更高的置信度应意味着更高的准确性。
Pricing is the key thing to watch. Jev costs $0.042 per million input tokens, and output is free. OpenRouter lists a 32K context window. TypeSafe reports end-to-end responses in 70 to 500 milliseconds.
定价是关键关注点。Jev 每百万输入 token 收费 0.042 美元,输出免费。OpenRouter 列出的上下文窗口为 32K。TypeSafe 报告端到端响应时间为 70 至 500 毫秒。
Interactive Explainer
交互式解释器
Benchmarks: What TypeSafe’s Workflow Evals Show
基准测试:TypeSafe 的工作流评估结果揭示了什么
TypeSafe built workflow evals across 4 tasks: security incidents, agent trace observability, invoice processing and customer service. Reference labels come from averaging GPT-6 Astra and Claude Fable 5.1 at high thinking.
TypeSafe 在四项任务上构建了工作流评估:安全事件、智能体追踪可观测性、发票处理和客户服务。参考标签来自在高思考模式下 GPT-6 Astra 和 Claude Fable 5.1 的平均值。
- Jev: 67.8% mean accuracy, $0.0004 per case, 0.4 seconds.
- Claude Sonnet 5 (same workflow): 67.8%, $0.1174 per case, 78.1 seconds.
- Best comparison model (OpenAI “sol”): 74.1%, $0.0836 per case, 23.3 seconds.
- Jev:平均准确率 67.8%,每案例成本 0.0004 美元,耗时 0.4 秒。
- Claude Sonnet 5(相同工作流):准确率 67.8%,每案例成本 0.1174 美元,耗时 78.1 秒。
- 最佳对比模型(OpenAI “sol”):准确率 74.1%,每案例成本 0.0836 美元,耗时 23.3 秒。
Jev matched Sonnet 5 on accuracy at a fraction of the cost and latency. It still trails the top frontier configuration by 6.3 points. Per task, Jev scored 76.0% on customer service but only 61.8% on invoice processing.
Jev 在准确率上与 Sonnet 5 持平,但成本和延迟仅为其一小部分。它仍落后于顶级前沿配置 6.3 个百分点。按任务细分,Jev 在客户服务上得分为 76.0%,但在发票处理上仅为 61.8%。
Use Cases: Where Decision Models Fit
应用场景:决策模型的适用场景
The rule of thumb is simple. If your code needs a bounded answer it will branch on, a decision model is a candidate. If a human needs to read the output, use an LLM.
经验法则很简单。如果你的代码需要一个有界的答案来进行分支选择,那么决策模型是一个候选方案。如果人类需要阅读输出结果,请使用大语言模型(LLM)。
Agent control flow
智能体控制流
- Choosing the next tool or subagent: Vercel lists this as a primary use.
- Continue, retry, ask the user, or stop: A single Choice question replaces a fragile JSON-parsing step.
- Model routing: Send easy requests to a cheap model and hard ones to a frontier model. Fastino lists routing by destination, complexity or escalation level.
- 选择下一个工具或子智能体:Vercel 将其列为主要用途。
- 继续、重试、询问用户或停止:单个选择题可以取代脆弱的 JSON 解析步骤。
- 模型路由:将简单请求发送给廉价模型,将复杂请求发送给前沿模型。Fastino 列出了按目的地、复杂度或升级级别进行的路由。
Classification and triage
分类与分诊
- Support ticket routing, email triage and intent detection: These make up much of Fastino’s 17-dataset benchmark.
- Spam detection, label suggestions and prioritization: Simon Willison calls these natural classification fits.
- Security alert triage: TypeSafe’s simplest published workflow decides whether to close an alert, pass it to an analyst, or contain it.
- 支持工单路由、邮件分诊和意图检测:这些构成了 Fastino 17 个数据集基准测试的大部分。
- 垃圾邮件检测、标签建议和优先级排序:Simon Willison 称这些是自然分类的合适场景。
- 安全警报分诊:TypeSafe 发布的 simplest workflow 决定是关闭警报、将其转交给分析师还是对其进行隔离。
Verification and safety
验证与安全
- Guardrails and jailbreak detection: TypeSafe pitches Jev for scoring prompts, reasoning traces and outputs.
- Joint safety checks: GLiNER2.5-Decide can decode “safety” and “harm type” together so the answers never contradict.
- Verified cascades: OpenRouter’s Jev guide describes drafting with a cheap model, checking with Jev, and escalating only on failure.
- 护栏与越狱检测:TypeSafe 推广使用 Jev 对提示词、推理轨迹和输出进行评分。
- 联合安全检查:GLiNER2.5-Decide 可以同时解码“安全性”和“危害类型”,以确保答案从不矛盾。
- 已验证的级联流程:OpenRouter 的 Jev 指南描述了先用廉价模型起草,再用 Jev 进行检查,仅在失败时升级的处理方式。
Evaluation and observability
评估与可观测性
- LLM-as-a-judge replacement: Arize and Langfuse now run Jev evaluators on traces.
- CI/CD gates: Buddy lets pipelines score, classify or gate runs with a Jev action.
- 替代 LLM 作为裁判:Arize 和 Langfuse 现在在轨迹上运行 Jev 评估器。
- CI/CD 门禁:Buddy 允许管道通过 Jev 操作对运行进行评分、分类或设置门禁。
Search and data processing
搜索与数据处理
- Reranking: Score 100 BM25 candidates for relevance in one parallel call.
- Map-reduce over large datasets: TypeSafe pitches turning bulk data into features at low cost.
- Context pruning: Fastino lists choosing which context to keep before an LLM call.
- 重排序:在一次并行调用中对 100 个 BM25 候选项的相关性进行评分。
- 大规模数据集上的 Map-Reduce:TypeSafe 推广以低成本将批量数据转化为特征。
- 上下文剪枝:Fastino 列出了在调用 LLM 之前选择保留哪些上下文。
Real-time applications
实时应用
- Games and simulations: TypeSafe demoed Jev playing Doom and Wikiracing.
- Latency-critical UX: Sub-second decisions make AI usable inside interactive flows.
- 游戏与模拟:TypeSafe 演示了 Jev 玩《毁灭战士》(Doom)和维基百科竞速(Wikiracing)。
- 延迟关键型用户体验:亚秒级的决策使 AI 能够用于交互式流程中。
When not to use a decision model
何时不应使用决策模型
- You need generated text, summaries or explanations.
- The task needs exact arithmetic, counting or date math. TypeSafe’s Jev 1.13 jaggedness guide flags all 3.
- The decision affects people’s livelihoods, such as hiring. Willison warns that hidden bias is hard to inspect.
- 你需要生成文本、摘要或解释。
- 任务需要精确的算术运算、计数或日期计算。TypeSafe 的 Jev 1.13 锯齿状指南标记了全部这 3 项。
- 该决策会影响人们的生计,例如招聘。Willison 警告称,隐藏偏见难以审查。
Case Studies: Where Decision Models Are Already Working
案例研究:决策模型已发挥作用的场景
1. Vercel AI Gateway adoption
1. Vercel AI Gateway 的采用
Vercel reports that Jev became the fastest-adopted model in AI Gateway history. Within 24 hours, nearly 13% of paid teams were using it. That was 2x the GPT-5.6 family’s share and more than 6x Fable 5.1’s.
Vercel 报告称,Jev 成为 AI Gateway 历史上采用速度最快的模型。在 24 小时内,近 13% 的付费团队正在使用它。这一比例是 GPT-5.6 系列的 2 倍,也是 Fable 5.1 的 6 倍以上。
2. Search reranking
2. 搜索重排序
Simon Willison fetched 100 candidates with BM25, then had Jev score each for relevance. This pattern replaces an expensive LLM reranker with cheap, parallel Score questions.
Simon Willison 使用 BM25 获取了 100 个候选项,然后让 Jev 对每个候选项进行相关性评分。这种模式用廉价且并行的 Score 问题替代了昂贵的 LLM 重排序器。
3. LLM evaluation pipelines
3. LLM 评估管道
Arize and Langfuse both shipped Jev-as-a-judge evaluators. Langfuse labels the feature “decision-model evaluators” so other models can be added later. Its Jev support is still marked experimental.
Arize 和 Langfuse 都推出了基于 Jev 的裁判评估器。Langfuse 将该功能标记为“决策模型评估器”,以便后续添加其他模型。其对 Jev 的支持目前仍被标记为实验性。
4. 6G edge network orchestration
4. 6G 边缘网络编排
A new arXiv paper used Jev to interpret service contracts at the network edge. At matched correctness, Jev cut median decision latency by 22.4% versus DeepSeek and 61.9% versus Gemini.
一篇新的 arXiv 论文使用 Jev 来解析网络边缘的服务合同。在正确率相当的情况下,与 DeepSeek 相比,Jev 将中位决策延迟降低了 22.4%,与 Gemini 相比降低了 61.9%。
5. Real-time game agents
5. 实时游戏智能体
TypeSafe’s Doom demo ran Jev at 10 queries per second. The team estimated the cost at roughly $7 per hour.
TypeSafe 的 Doom 演示以每秒 10 次查询的速度运行 Jev。团队估算成本约为每小时 7 美元。
Competitor Landscape: 7 Decision Models Compared
竞争格局:对比 7 款决策模型
The table below covers Jev, its closest commercial rival, and the leading open-weight options. All specs come from each project’s own release page or model card.
下表涵盖了 Jev、其最接近的商业竞争对手以及领先的开源权重选项。所有规格均来自各项目自身的发布页面或模型卡片。
| Model | Developer | License / access | Size and architecture | Question types | Reported latency | Runs locally |
|---|---|---|---|---|---|---|
| Jev 1.13 | TypeSafe AI | Closed; hosted API at $0.042/M input, output free | Not disclosed; new architecture, parallel sampler, RLCD | Choice, Score, Noul (up to 255 options) | 70 to 500 ms | No |
| GLiDE | Fastino Labs | Closed; Fastino API, 40K context | Not disclosed; adaptive thinking on uncertain cases | Selected action, confidence and option probabilities | Not disclosed | No |
| GLiNER2.5-Decide | Fastino Labs | Apache 2.0 open weights; also on Fastino API | 340M DeBERTa-v3-large encoder | Typed decisions with joint constraints, plus spans and relations | 38.3 ms p50 (V100), 167.3 ms (48-vCPU CPU) | Yes, CPU or GPU |
| Laya | Convai Innovations | Apache 2.0 open weights | 421M ModernBERT-large (English); 322M mmBERT-base (multilingual) | Choice, Score, Noul; 100+ languages | ~33 ms per question on GPU | Yes |
| JevK5 | Independent developer | Apache 2.0 open weights | 4B, Qwen3.5-4B with merged LoRA | Probability for every option in one pass | Not stated | Yes, GPU |
| OpenJev | Theo Lee | MIT | Frozen Qwen3.5-4B, reads option logits | Typed options in one pass | 5.21x faster than autoregressive JSON | Yes, consumer GPU |
| kev-0.5b | Jared Palmer | Apache 2.0 (base under Qwen license) | LoRA plus readout head on Qwen2.5-0.5B; Jev-compatible API | Noul, Choice (2 to 255), Score | ~160 ms for 6 questions (Apple M5) | Yes, laptop |
| General LLM + structured output | Many | Mostly closed; input plus output tokens | Autoregressive decoder | Anything, as generated text | Typically seconds | Depends |
| 模型 | 开发者 | 许可/访问方式 | 规模与架构 | 问题类型 | 报告延迟 | 是否支持本地运行 |
|---|---|---|---|---|---|---|
| Jev 1.13 | TypeSafe AI | 闭源;托管 API,输入费用为 $0.042/M,输出免费 | 未披露;新架构、并行采样器、RLCD | 选择、评分、Noul(最多 255 个选项) | 70 至 500 毫秒 | 否 |
| GLiDE | Fastino Labs | 闭源;Fastino API,支持 40K 上下文 | 未披露;在不确定情况下采用自适应推理 | 选定动作、置信度及选项概率 | 未披露 | 否 |
| GLiNER2.5-Decide | Fastino Labs | Apache 2.0 开源权重;亦提供于 Fastino API | 340M DeBERTa-v3-large 编码器 | 带联合约束的类型化决策,以及跨度与关系 | 38.3 毫秒 p50(V100),167.3 毫秒(48-vCPU CPU) | 是,CPU 或 GPU |
| Laya | Convai Innovations | Apache 2.0 开源权重 | 421M ModernBERT-large(英语);322M mmBERT-base(多语言) | 选择、评分、Noul;支持 100 多种语言 | GPU 上每题约 33 毫秒 | 是 |
| JevK5 | 独立开发者 | Apache 2.0 开源权重 | 4B,Qwen3.5-4B 合并 LoRA | 单次前向传播中每个选项的概率 | 未说明 | 是,GPU |
| OpenJev | Theo Lee | MIT | 冻结的 Qwen3.5-4B,读取选项 logits | 单次前向传播中输出类型化选项 | 比自回归 JSON 快 5.21 倍 | 是,消费级 GPU |
| kev-0.5b | Jared Palmer | Apache 2.0(基础模型遵循 Qwen 许可) | Qwen2.5-0.5B 上的 LoRA 加读取头;兼容 Jev API | Noul、选择(2 至 255)、评分 | Apple M5 上 6 题约 160 毫秒 | 是,笔记本电脑 |
| 通用 LLM + 结构化输出 | 众多 | 大多闭源;输入和输出 token 均计费 | 自回归解码器 | 任意内容,作为生成文本 | 通常为秒级 | 取决于配置 |
Head-to-head numbers (each vendor’s own benchmark)
逐一对比数据(各厂商自行基准测试)
These scores come from different test suites. Do not compare numbers across rows.
这些分数来自不同的测试套件。请勿跨行比较数值。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力