跳到主内容
@wquguru
精选88Hacker News Best(web_list)产品发布/更新

Desert Ant Labs 发布端侧专用模型与 SDK

Desert Ant Labs 发布本地快速端侧模型

原文
发到 X
推荐理由

端侧 AI 落地的重要基础设施更新,提供了可复用的专用模型 SDK 与实测对比数据,适合关注降本增效与隐私计算的开发者参考。

Today we're launching Desert Ant Labs, a European frontier AI lab building opinionated on-device intelligence. We believe the best path to efficient intelligence starts on-device.

今天我们推出 Desert Ant Labs,这是一家欧洲前沿人工智能实验室,致力于构建具有明确立场的端侧智能。我们相信,高效智能的最佳路径始于设备端。

We're building small, specialized models for audio, vision, and text – each model answers in milliseconds, and costs nothing to run, so you can put intelligence in every product interaction, without being limited by token cost or inference speed. Small enough to run on a five-year-old phone, fast enough to use on every frame or keystroke, and better than the API call you're already paying for.

我们正在为音频、视觉和文本构建小型专用模型——每个模型都能在毫秒级响应,且运行成本为零,因此你可以在每次产品交互中融入智能,而不受令牌成本或推理速度的限制。这些模型小到能在五年前的手机上运行,快到能用于每一帧画面或每一次按键,性能优于你已付费调用的 API。

The first 18 models are live today (12 stable and six in beta), accessible via one SDK for Swift, Kotlin, and JavaScript. One model per task, each built to be the fastest way to complete that task on a device:

首批 18 个模型今天正式上线(12 个稳定版,6 个测试版),通过一个支持 Swift、Kotlin 和 JavaScript 的 SDK 即可访问。每个任务对应一个模型,专为在设备上以最快方式完成该任务而打造:

  • Voz: transcribe 10 minutes of audio in two seconds on an iPhone – 4.7x faster than Whisper – with a start and end time on every word.
  • Clear: a 9MB model that can turn a five-minute laptop recording into studio quality audio in one second.
  • Redact: mask names, addresses, and card numbers, in real time, in 27 languages, so they never reach your servers.
  • Tongue: identify 84 languages from three words, with a 2MB model.
  • Voz:在 iPhone 上两秒内转录十分钟音频——比 Whisper 快 4.7 倍——并为每个单词提供起止时间。
  • Clear:一个 9MB 的模型,能将五分钟笔记本电脑录音在一秒内转化为录音室级音质。
  • Redact:实时屏蔽姓名、地址和卡号,支持 27 种语言,确保这些数据永远不会到达你的服务器。
  • Tongue:使用 2MB 模型从三个词中识别 84 种语言。

Language ID accuracy, three words in

语言 ID 准确率,仅用三个词

Tongue · 2MB 0.933

Tongue · 2MB 0.933

293MB detector 0.887

293MB 检测器 0.887

Tongue names the language from three words, scoring 0.933 at 2MB against 0.887 for a 293MB detector.

Tongue 能从三个词中命名语言,在 2MB 规模下得分 0.933,而 293MB 的检测器得分为 0.887。

And that's just to name a few. You can find full specs and benchmarks for the other fourteen, on desertant.com/models and Hugging Face. Every model is free up to 100k monthly active devices. No tokens, no logins.

这还只是其中几个例子。你可以在 desertant.com/models 和 Hugging Face 上找到其他十四个模型的完整规格和基准测试结果。每个模型每月最多可免费供 10 万活跃设备使用。无需令牌,无需登录。

Personal data caught, by system

按系统捕获的个人数据

Redact · 12MB 88.8

Redact · 12MB 88.8

GLiNER-PII · 2.3GB 91.1

GLiNER-PII · 2.3GB 91.1

Rampart · 14.7MB 61.4

Rampart · 14.7MB 61.4

OpenAI filter · 3GB 60.2

OpenAI 过滤器 · 3GB 60.2

Redact catches 88.8% of the personal data in a text, close to the 2.3GB GLiNER-PII, from a 12MB model.

Redact 能捕获文本中 88.8% 的个人数据,接近 2.3GB 的 GLiNER-PII,而它本身仅重 12MB。

We're building this in Europe, where "on-device" is the sovereign default. The data never leaves your customer's hands, the feature never depends on someone else's cloud, and what's never been uploaded can never be compelled.

我们在欧洲构建这一体系,在那里“端侧”是主权默认选项。数据永不离开客户手中,功能从不依赖他人的云服务,而未上传的数据永远无法被强制获取。

How we got here

我们如何走到这一步

For five years we've been building our video app, Detail, with an on-device first approach. But when we introduced features like Auto Edit to create short clips, or audio enhancement for podcasts, we had to fall back to cloud APIs. And as the popularity of Detail grew, so did our infrastructure bills.

五年来,我们始终采用端侧优先的方式构建视频应用 Detail。但当我们引入自动剪辑以创建短视频片段,或播客音频增强等功能时,不得不回退到云端 API。随着 Detail 的流行度增长,我们的基础设施账单也随之增加。

Every few months I'd hunt for useful on-device models. I'd surf Hugging Face for a model that could find filler words or clean up a recording. And, every June, we'd get great new tools to build with but the industry wasn't moving fast enough. The foundation was there: the chips, Core ML, the research. What was missing was everything between that foundation and actually implementing a feature in your app: a model you could drop in and ship with a few lines of code.

每隔几个月,我就会寻找有用的端侧模型。我会在 Hugging Face 上搜索能够识别填充词或清理录音的模型。每年六月,我们都能获得很棒的新工具来构建应用,但行业进展还不够快。基础已经具备:芯片、Core ML 以及研究成果。缺少的正是从这些基础到在应用中实际实现功能之间的环节:一个只需几行代码即可嵌入并随应用发布的模型。

So, we trained the models ourselves. It turns out training a model is a product design challenge, and product is what we know. We designed models and local inference that beat cloud services on speed, quality, and cost, and outperform other local and cloud models on the task itself, at a fraction of their size.

因此,我们自己训练了这些模型。事实证明,训练模型是一个产品设计挑战,而产品正是我们的专长。我们设计了模型和本地推理方案,它们在速度、质量和成本上优于云服务,并在任务本身的表现上超越其他本地和云端模型,同时体积仅为后者的零头。

We replaced Dolby for better, faster audio enhancement with Clear, and made our on-device transcriptions 5x faster with Voz. We also replaced Claude Sonnet with Clips, our 284MB model that turns a 10-minute video into a dozen clips in 5 seconds – 10x faster and using 470x less energy than Sonnet, with the same quality.

我们用 Clear 取代了 Dolby,提供更优、更快的音频增强功能;并用 Voz 使我们的端侧转录速度提升了 5 倍。我们还用 Clips 取代了 Claude Sonnet,Clips 是我们的 284MB 模型,能在 5 秒内将 10 分钟的视频转化为十几个片段——比 Sonnet 快 10 倍,能耗降低 470 倍,且质量相同。

Clear audio enhancement speed, 5 minutes of audio

Clear 音频增强速度,5 分钟音频

iPhone 16 Pro 302x

iPhone 16 Pro 302x

MacBook Pro (M5) 345x

MacBook Pro (M5) 345x

Clear enhances, masters, and re-encodes a clip on the device, best of three, from a 9MB model. 302x realtime on a phone.

Clear 在设备上增强、母带处理和重新编码片段,三次测试中的最佳结果,来自 9MB 模型。在手机上的实时处理倍率为 302 倍。

Transcription speed, 30 minutes of audio

转录速度,30 分钟音频

Voz 319x

Voz 319x

Apple SpeechAnalyzer 78x

Apple SpeechAnalyzer 78x

Whisper large-v3-turbo 50x

Whisper large-v3-turbo 50x

Realtime factor over 30 continuous minutes on an M3 Ultra. Voz reaches 298x on an iPhone 17 Pro.

在 M3 Ultra 上连续运行 30 分钟的实时因子。Voz 在 iPhone 17 Pro 上达到 298 倍。

Detail 6, which will launch with iOS 27, replaces all of our cloud APIs with our own models, running entirely on the device.

Detail 6 将与 iOS 27 一同发布,它用我们自己的模型取代了所有云端 API,完全在设备上运行。

We've all spent the past few years building with LLMs as if they were just another API. And, amid the hype around generalist frontier brains, we almost forgot they're not the only option.

过去几年里,我们都像使用普通 API 一样构建基于 LLM 的应用。而在围绕通用前沿大模型的炒作中,我们几乎忘记了它们并非唯一的选择。

Every developer I talk to has a wishlist of on-device models they'd build if cost wasn't a factor, or a feature they're bleeding tokens on that they'd happily swap for a local model. A call that runs the same way a hundred thousand times a day: cleaning a recording, tagging a photo, pulling a date out of a sentence, catching a name before the text hits your servers. None of these needs a frontier model.

我交谈过的每位开发者都有一份他们希望构建的端侧模型愿望清单(如果成本不是因素的话),或者一个他们正在大量消耗 token 的功能,他们很乐意将其替换为本地模型。例如每天运行十万次却方式相同的调用:清理录音、标记照片、从句子中提取日期、在文本到达服务器之前捕获人名。这些都不需要前沿模型。

NVIDIA's own researchers pulled apart three agent systems and estimated that 40 to 70% of their calls to a large model could go to a small, specialized one instead.

NVIDIA 自己的研究人员拆解了三个智能体系统,估计其中 40% 到 70% 的大模型调用可以改为由小型专用模型处理。

The compute is already paid for

计算资源已经付费

The industry will spend about $450 billion on data centers this year. Meanwhile, the world ships more than a billion phones, tablets, and laptops with increasingly capable chips, perfectly suited to these kinds of tasks. There's more compute available in people's hands than in every AI data center on earth.

今年,行业将在数据中心上花费约4500亿美元。与此同时,全球出货了超过十亿部手机、平板电脑和笔记本电脑,它们配备了日益强大的芯片,非常适合这类任务。人们手中的计算能力超过了地球上所有AI数据中心的总和。

We have an unfair advantage with free inference. No per-call cost, so a feature runs on every message instead of the ones you can afford to check. No round-trip, and your customer's data never leaves the device. When inference costs nothing, the way we build products changes entirely.

我们拥有免费推理带来的不公平优势。没有按次调用成本,因此功能会在每条消息上运行,而不是仅在你负担得起检查的消息上运行。没有往返延迟,且客户的数据永远不会离开设备。当推理成本为零时,我们构建产品的方式将发生根本性改变。

Little brains in every product

每个产品中的小脑

To build with local models, the developer experience has to get a lot better. You need models you can use commercially, that beat the alternatives on your task in speed and quality, that you can drop into your app with a few lines of code, and are easy to discover.

要基于本地模型进行开发,开发者体验必须大幅改善。你需要能够商业使用的模型,它们在速度和质量上优于你任务中的替代方案,只需几行代码即可嵌入你的应用,并且易于发现。

Think of the first hundred models as the cerebellum, the little brain. The little brain handles the always-on work – balance, timing, the skills you never think about, so the rest of the brain is free to think. That's what we're building first: fast, specialized models for the work that runs all day, on the device, for free.

将最初的一百个模型视为小脑(cerebellum)。小脑处理那些持续运行的工作——如平衡、计时以及你从不假思索的技能,从而使大脑的其他部分得以自由思考。这正是我们首先构建的内容:快速、专用的模型,用于在设备上全天候免费运行的工作。

Then comes the cortex, the layer that decides which model answers. A small local model first, a bigger one when the job requires it, and the cloud only when the work has to leave the device. As open research advances and device silicon becomes more capable, the local models grow, and we'll train larger ones ourselves. Frontier intelligence, built from the small end up.

随后是大脑皮层(cortex),即决定由哪个模型回答的层级。先使用小型本地模型,当任务需要时使用更大的模型,只有当工作必须离开设备时才使用云端。随着开放研究的进展和设备硅片能力的提升,本地模型不断壮大,我们自己也将训练更大的模型。前沿智能,从小处构建。

Cloud labs ship neutral models because per-token pricing needs a neutral model. Every Desert Ant model ships with a default we choose, and the levers you need to change that default. We optimize the model and the runtime together: on an iPhone, Clear and Voz run on the Neural Engine, and in the browser, Clear's same weights run through WebAssembly.

云实验室交付中立模型,因为按token定价需要中立模型。每个Desert Ant模型都附带我们选择的默认设置,以及你需要用来更改该默认设置的杠杆。我们将模型和运行时一起优化:在iPhone上,Clear和Voz在神经引擎(Neural Engine)上运行;在浏览器中,Clear的相同权重通过WebAssembly运行。

The SDK

SDK

Ready to get started? You can implement Desert Ant models in your app with our native Swift, Kotlin, and JavaScript SDK, available on GitHub.

准备好开始了吗?你可以使用我们在GitHub上提供的原生Swift、Kotlin和JavaScript SDK,在你的应用中集成Desert Ant模型。

Our docs are written for developers and agents and you can try the models on your Mac with the CLI, or in your browser on Hugging Face.

我们的文档是为开发者和智能体编写的,你可以在Mac上使用CLI试用这些模型,或在Hugging Face的浏览器中进行尝试。

Building something cool with our models, or want to build them with us? Get in touch.

正在用我们的模型构建有趣的东西,或者想与我们一起构建?请联系我们要。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件