跳到主内容
@wquguru
精选90Rohan Paul模型发布/更新

阿里发布Qwen3.8-Max:2.4万亿参数MoE

Alibaba released Qwen3.8-Max, a 2.4 trillion parameter model that activates only…

原文
发到 X
推荐理由

Qwen3.8-Max是阿里最新旗舰模型,2.4万亿参数MoE架构和自主编程能力极具突破性,做模型选型和Agent开发的同学建议重点关注其技术报告。

Alibaba released Qwen3.8-Max, a 2.4 trillion parameter model that activates only about 95 bn parameters per token. A thread 🧵

阿里巴巴发布了Qwen3.8-Max,这是一个2.4万亿参数的模型,每个token仅激活约950亿参数。一条线程🧵

  • Blank folder to live-ready app. No step-by-step hand-holding. Full GitHub trace.
  • Sparse mixture-of-experts, i.e. a small router picks a handful of experts for each token, so you pay for 95B worth of compute while the model holds 2.4T worth of stored knowledge.
  • Context window is 1 million tokens, the longest single reply can run to 131,072 tokens, and the private thinking budget stretches to 262,000 tokens before it commits to an answer.
  • Pricing lands at $2.00 per million input tokens and $6.00 per million output tokens, with cached reads down to $0.17 per million, so reusing a stable prompt prefix instead of resending it costs roughly 8 times less.
  • On Terminal Bench 2.1, which checks whether a model can actually drive a real command line through a task end to end, it scored 86.6 against 84.6 for Opus 4.8 and 88.8 for GPT-5.6 Sol.
  • It also posted 93.0 on PaperBench, a test of rebuilding a research paper's experiments in working code, and 92.6 on GPQA Diamond, a set of science questions written so that search engines do not help.
  • 从空白文件夹到可运行的应用程序。没有逐步指导。完整的GitHub痕迹。
  • 稀疏混合专家,即一个小型路由器为每个token选择少数专家,因此你只需支付950亿参数的计算量,而模型拥有2.4万亿参数的存储知识。
  • 上下文窗口为100万token,单次回复最长可达131,072个token,私人思考预算在给出答案前可延伸至262,000个token。
  • 定价为每百万输入token 2.00美元,每百万输出token 6.00美元,缓存读取降至每百万0.17美元,因此重用稳定的提示前缀而不是重新发送,成本大约降低8倍。
  • 在Terminal Bench 2.1上,该测试检查模型是否能够端到端地驱动真实命令行完成任务,它得分86.6,而Opus 4.8为84.6,GPT-5.6 Sol为88.8。
  • 它还在PaperBench上获得93.0分,该测试要求用可运行的代码重建研究论文的实验,在GPQA Diamond上获得92.6分,这是一组科学问题,设计得使搜索引擎无法提供帮助。

Some huge revelation from their official technical report.

来自其官方技术报告的一些重大启示。

  • Given nothing but a research paper and some GPUs, it wrote about 7,600 lines of code over 5 days and ran 33 rounds of training to reproduce all 6 of the paper's findings.
  • It was handed an empty folder and a command line tool to build, then left alone. After roughly 16 days of unattended operation the repository held 265 commits and 127 pull requests, with the model triggering its own builds, unit tests and end-to-end checks after every change.
  • On a cryptographic chip design task it ran about 500 turns of edit, simulate and lay out, with no reference design to copy. Its first working circuit used 8,298 logic gates and it squeezed that down to 678, cutting physical chip area by 81% while still meeting timing at 500 MHz.
  • A simulated year of running online stores: 600 suppliers, 7,000 products, and 152 fraudulent merchants hidden among them. It ended the year with a balance of 416,252 yuan from 100,000 yuan of starting capital, about 38% ahead of the next best model.
  • 仅凭一篇研究论文和一些GPU,它在5天内编写了约7,600行代码,并运行了33轮训练,以复现论文的所有6项发现。
  • 它被交给一个空文件夹和一个要构建的命令行工具,然后被单独留下。经过大约16天的无人值守操作,仓库中包含了265次提交和127个拉取请求,模型在每次更改后触发自己的构建、单元测试和端到端检查。
  • 在密码芯片设计任务中,它运行了约500轮编辑、模拟和布局,没有参考设计可复制。它的第一个工作电路使用了8,298个逻辑门,并将其压缩到678个,物理芯片面积减少了81%,同时仍满足500 MHz的时序要求。
  • 模拟运行一年的在线商店:600家供应商,7,000种产品,其中隐藏着152家欺诈商户。它从10万元启动资金开始,年底余额为416,252元,比次优模型高出约38%。

🧵 1.

🧵 1.

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

关联信息,但可能不是同一事件