TypeSafe发布Jev模型:专为软件决策优化,速度超LLM数百倍
Another brilliant launch for developers: and its 20-200x faster than LLMs becaus…
为Agent落地提供了一条避开LLM延迟瓶颈的新路径,做自动化决策的同学值得重点关注这种非自回归架构的性能表现。
Another brilliant launch for developers: and its 20-200x faster than LLMs because it skips token-by-token generation entirely.
开发者迎来又一次惊艳发布:其速度比大语言模型快20-200倍,因为它完全跳过了逐词元生成的过程。
TypeSafe AI just launched Jev,
TypeSafe AI 刚刚发布了 Jev,
> 20-200x faster >40-400x cheaper (w/ output tokens free) > Frontier composable intelligence optimized for decisions
> 速度快20-200倍 > 成本低40-400倍(输出词元免费) > 面向决策优化的前沿组合式智能
So Jev is an AI model built to make software decisions instead of writing text for people.
因此,Jev 是一个专为做出软件决策而非为人撰写文本而构建的 AI 模型。
A normal LLM answers by generating tokens sequentially, so software often has to request structured output, parse it, validate it, and decide what happens next.
普通的大语言模型通过顺序生成词元来回答问题,因此软件通常必须请求结构化输出、解析它、验证它,并决定下一步该做什么。
Jev removes that translation layer: give it some data and a predefined question, and it returns a typed choice or score with probabilities and confidence.
Jev 去除了这一翻译层:给它一些数据和预定义的问题,它会返回带有概率和置信度的类型化选择或评分。
For example, a support app can ask whether a ticket is urgent, whether it violates policy, and which queue should receive it, then act on those answers directly.
例如,一个支持应用可以询问工单是否紧急、是否违反政策以及应分配给哪个队列,然后直接根据这些答案采取行动。
In code, Jev behaves like a smart if-statement: ordinary software controls the workflow while the model handles fuzzy judgments that rigid rules struggle with.
在代码中,Jev 表现得像一个智能 if 语句:普通软件控制工作流,而模型处理那些僵化规则难以处理的模糊判断。
Jev evaluates multiple structured questions in parallel rather than writing an answer token by token.
Jev 并行评估多个结构化问题,而不是逐个词元地撰写答案。
TypeSafe reports 70-500ms responses and 40-200x faster performance than comparable LLMs
TypeSafe 报告称响应时间为 70-500 毫秒,性能比同类大语言模型快 40-200 倍
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力