跳到主内容
@wquguru
精选88Latent Space(RSS)模型发布/更新多源精选 ×10

Google DeepMind发布Gemini 4 Carbon主打网络安全

[AINews] Gemini 4 Carbon tops leaderboards, launches for cyber defenders

原文
发到 X
推荐理由

全新旗舰模型发布,明确切入垂直安全场景,定价与性能数据详实,值得从业者关注其差异化策略。

a quiet day.

安静的一天。

AI News for 10/27/2026-10/28/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

2026年10月27日至10月28日AI新闻。我们检查了12个Subreddit、544条Twitter帖子,以及零个Discord频道。AINews的网站允许你搜索所有过往期号。提醒一下,AINews现已成为Latent Space的一个板块。你可以选择订阅或退订邮件频率!

AI Twitter Recap

AI Twitter回顾

Gemini 4 Carbon Tops Independent Leaderboards, with Access Limited to Cyber Defenders

Gemini 4 Carbon登顶独立排行榜,访问权限仅限网络防御者

  • Launch: Google DeepMind announced Gemini 4 Carbon two weeks after Argon. It is positioned as state of the art on cybersecurity and long-horizon tasks (@sundarpichai, @GoogleDeepMind).
  • Claimed cyber results: 88.2% on SEC-bench Pro for vulnerability finding, 54.8% on ExploitGym for exploitation and 71.0% on CWE-bench for patching (@sundarpichai).
  • Availability: Carbon first goes to trusted cyber defenders through the Fairwind Program, with wider developer access promised "as soon as possible" (@GoogleAI).
  • Pricing: Phil Schmid quotes $2/$10 per million input/output tokens with an asterisk (@_philschmid). Artificial Analysis lists $4/$20 standard pricing with a 50% launch discount that has no end date. Cached input costs $0.20 per million tokens (@ArtificialAnlys).
  • Specs: The model has a 1M-token context window and 1M max output. Inputs are text, image, video and speech; output is text (@ValsAI).
  • Safety claims (Google): Successful cheating on Terminal-Bench 4.0 fell to 0.0%, and cheating attempts fell to 0.4%. Unsupported claims are down about 2x versus Argon. Overreach fell 26% and under-service fell 29% (@OfficialLoganK).
  • Artificial Analysis: Carbon is #1 on Intelligence Index v5 with a score of 59. It leads 4 of the 9 index evals: HLE-Diamond, TB-Science, AA-Omniscience and AutomationBench (@ArtificialAnlys).
  • Coding: On the Coding Agent Index, Carbon scores 59 using Antigravity CLI, versus 62 for Claude Code with Opus 5.5 [max]. It scores 51% on FrontierCode v1.1, versus 56% for Opus.
  • Knowledge work: Carbon reaches 1609 Elo on AA-Briefcase, up 126 points from Argon. It still trails Grok 4.7, Muse Wonder and Kimi K3.1 Pro (1678).
  • Cost: Carbon costs $7.76 per index task, versus $10.04 for Opus 5.5 and $6.25 for GPT-6 Astra. It uses 123k output tokens per task, 29% fewer than Opus.
  • Hallucination: Carbon leads Omniscience with 54. Its hallucination rate rose from Argon's 4% to 11%, which is still the second lowest measured. Opus 5.5 and Astra are both at 50%.
  • Other independent evals:
  • Arena: Carbon is #1 in Text Arena (1528), #2 in Agent Arena at a $1.80 median cost per task, and #4 in Code Arena: WebDev (1768) (@arena). Arena attributes the gains over Argon to more praise, more confirmed successes and better steerability (@arena).
  • Vals: Carbon is #2 on the Vals Index and #1 on the Finance Index and Legal Research Benchmark. It produces 64% more output tokens than Argon, mostly on finance, tax and legal tasks (@ValsAI, tokens).
  • Coding benchmarks: Carbon scores 61.2% on FrontierSWE, behind GPT-6 Astra (65.5), Opus 5.5 (62.3) and Sonnet 5.5 (61.9) (@ProximalHQ). It sets a narrow state of the art of 9.6% on SWE-sweep (@KLieret).
  • Andon Labs: Carbon is #1 on Vending-Bench 2 (@andonlabs). It is also #1 on Blueprint-Bench 2, where it ties the human baseline for 3D spatial understanding (@andonlabs).
  • Caveats and reactions:
  • Harness: The coding-agent results were measured in Antigravity CLI, so results in other harnesses are untested (@Yuchenj_UW).
  • Hallucination risk: Some users are concerned about hallucination in cyber use (@scaling01).
  • Lab gap: scaling01 thinks Google remains about two months behind the next OpenAI and Anthropic releases (@scaling01).
  • RSI framing: On the earnings call, Sundar Pichai said AI is increasing training and launch velocity. He expects "continued acceleration because of RSI" over the next twelve months (@AndrewCurran_).
  • Unconfirmed: Claims of a stronger unreleased Gemini model are not confirmed (@kimmonismus).
  • Internal workflow: A Gemini engineer describes overnight agent loops and swarms that inspect RL data. In that workflow, launches now feel like "periodic checkpoints" (@zhangqiaorjc).
  • 发布:Google DeepMind在Argon发布两周后宣布推出Gemini 4 Carbon。它被定位为网络安全和长程任务方面的最先进水平(@sundarpichai, @GoogleDeepMind)。
  • 声称的网络成果:在SEC-bench Pro漏洞发现任务中达到88.2%,在ExploitGym利用任务中达到54.8%,在CWE-bench补丁任务中达到71.0%(@sundarpichai)。
  • 可用性:Carbon首先通过Fairwind计划向受信任的网络防御者开放,并承诺“尽快”向更广泛的开发者开放访问(@GoogleAI)。
  • 定价:Phil Schmid引用每百万输入/输出token价格为$2/$10,并带有星号说明(@_philschmid)。Artificial Analysis列出标准价格为$4/$20,并提供无截止日期的50%首发折扣。缓存输入成本为每百万token $0.20(@ArtificialAnlys)。
  • 规格:该模型拥有1M token的上下文窗口和1M最大输出长度。输入支持文本、图像、视频和语音;输出为文本(@ValsAI)。
  • 安全声明(Google):在Terminal-Bench 4.0上成功作弊率降至0.0%,作弊尝试降至0.4%。未经支持的声明相比Argon减少约2倍。过度干预下降26%,服务不足下降29%(@OfficialLoganK)。
  • Artificial Analysis:Carbon以59分位居Intelligence Index v5榜首。它在9项指数评估中的4项领先:HLE-Diamond、TB-Science、AA-Omniscience和AutomationBench(@ArtificialAnlys)。
  • 编码:在Coding Agent Index上,使用Antigravity CLI时Carbon得分为59,而Claude Code with Opus 5.5 [max]得分为62。在FrontierCode v1.1上,Carbon得分为51%,而Opus为56%。
  • 知识工作:Carbon在AA-Briefcase上达到1609 Elo,较Argon提升126分。但仍落后于Grok 4.7、Muse Wonder和Kimi K3.1 Pro(1678)。
  • 成本:Carbon每项指数任务成本为$7.76,而Opus 5.5为$10.04,GPT-6 Astra为$6.25。每项任务使用123k输出token,比Opus少29%。
  • 幻觉:Carbon在Omniscience指标上领先,得分为54。其幻觉率从Argon的4%上升至11%,仍是测得的第二低水平。Opus 5.5和Astra均为50%。
  • 其他独立评估:
  • 竞技场:Carbon在Text Arena(1528)中排名第1,在Agent Arena中以每项任务1.80美元的中位数成本排名第2,在Code Arena: WebDev(1768)中排名第4(@arena)。Arena将相对于Argon的提升归因于更多的赞誉、更多被确认的成功案例以及更好的可控性(@arena)。
  • Vals指数:Carbon在Vals指数中排名第2,在Finance指数和法律研究基准测试中排名第1。它在金融、税务和法律任务上产生的输出token比Argon多64%(@ValsAI, tokens)。
  • 编码基准测试:Carbon在FrontierSWE上的得分为61.2%,落后于GPT-6 Astra(65.5)、Opus 5.5(62.3)和Sonnet 5.5(61.9)(@ProximalHQ)。它在SWE-sweep上创造了9.6%的狭义最先进水平(@KLieret)。
  • Andon Labs:Carbon在Vending-Bench 2上排名第1(@andonlabs)。它在Blueprint-Bench 2上也排名第1,在该基准中与人类基线在3D空间理解方面持平(@andonlabs)。
  • 注意事项与反应:
  • Harness:编码代理的结果是在Antigravity CLI中测量的,因此其他harness中的结果尚未经过测试(@Yuchenj_UW)。
  • 幻觉风险:一些用户担心在网络使用中存在幻觉问题(@scaling01)。
  • 实验室差距:scaling01认为Google落后于下一轮OpenAI和Anthropic发布约两个月(@scaling01)。
  • RSI框架:在财报电话会议上,Sundar Pichai表示AI正在提高训练和发布速度。他预计未来十二个月“由于RSI将继续加速”(@AndrewCurran_)。
  • 未证实:关于更强但未发布的Gemini模型的声明尚未得到证实(@kimmonismus)。
  • 内部工作流:一位Gemini工程师描述了夜间运行的代理循环和检查RL数据的蜂群。在这种工作流中,发布现在感觉像是“定期检查点”(@zhangqiaorjc)。

Leaderboard Resets and Benchmark Integrity

排行榜重置与基准测试完整性

  • AA Intelligence Index v5: The rebuilt index runs 60% on private tests (@TheRundownAI).
  • Ranking before Carbon: Opus 5.5 scored 58, followed by GPT-6 Astra (57), GPT-6.1 Sol (55), Sonnet 5.5 (54) and GPT-6.1 Terra (51).
  • Open models: Kimi K3.1 Pro fell from 55 to 46. DeepSeek V4.1 Flash and GLM-5.3 both score 32, below Claude Haiku 5.5 at 36.
  • China–US gap: scaling01 puts the gap at about 3.3 months on the AA Progress Index (@scaling01).
  • FrontierCode 2.0 mystery model: Cognition data includes a hidden "Obsidian 3" scoring 46.8%, versus 45.5% for Opus 5.5. Because it runs in the claude-code harness, some speculate it is Fable 5.5; this is unconfirmed (@kimmonismus).
  • DeepSeek correction: scaling01 corrected an earlier identification and said Artificial Analysis shows DeepSeek V4.1 Flash-1017 at about 28% (@scaling01).
  • Mixed sources: teortaxes notes that Cognition's chart mixed model-card scores with independently measured ones (@teortaxesTex).
  • Cost comparisons are fragile: teortaxes argues that list-price comparisons of Haiku 5.5 and V4.1-1017 distort real costs. The comparison uses DeepSeek's peak pricing, ignores Haiku's long-context surcharge and does not reflect Haiku's roughly 2x output tokens (@teortaxesTex).
  • "Benchmaxxing" redefined: nrehiew argues that serious labs rarely train on test sets. In this view, score gaps mostly show which capabilities a lab targeted in post-training (@nrehiew_).
  • New evals:
  • Gym-Anything-RT: These real-time minigames keep moving while the model thinks. The best model, GPT-6 Astra, scores 9% (@PranjalAggarw16).
  • Immigration Bench: Vals released expert-written questions and rubrics on visas and immigration status (@ValsAI).
  • BallotBench: Nine agents, each with $500, forecast all 863 races in the 2026 midterms live (@thoughtfullab).
  • AA Intelligence Index v5:重建后的索引在私有测试中得分为60%(@TheRundownAI)。
  • Carbon之前的排名:Opus 5.5得分为58,随后是GPT-6 Astra(57)、GPT-6.1 Sol(55)、Sonnet 5.5(54)和GPT-6.1 Terra(51)。
  • 开源模型:Kimi K3.1 Pro从55分降至46分。DeepSeek V4.1 Flash和GLM-5.3均得分为32分,低于Claude Haiku 5.5的36分。
  • 中美差距:scaling01指出,在AA Progress Index上差距约为3.3个月(@scaling01)。
  • FrontierCode 2.0神秘模型:Cognition数据包含一个隐藏的“Obsidian 3”,得分为46.8%,而Opus 5.5为45.5%。由于它在claude-code harness中运行,有人推测它是Fable 5.5;这一点尚未得到证实(@kimmonismus)。
  • DeepSeek 更正:scaling01 纠正了此前的识别结果,并表示 Artificial Analysis 显示 DeepSeek V4.1 Flash-1017 约为 28% (@scaling01)。
  • 混合来源:teortaxes 指出 Cognition 的图表将模型卡分数与独立测量的分数混合在一起 (@teortaxesTex)。
  • 成本比较具有脆弱性:teortaxes 认为,Haiku 5.5 和 V4.1-1017 的标价比较扭曲了真实成本。该比较使用了 DeepSeek 的最高定价,忽略了 Haiku 的长上下文附加费,且未反映 Haiku 约 2 倍的输出 token (@teortaxesTex)。
  • "刷榜"被重新定义:nrehiew 认为,严肃的研究机构很少在测试集上进行训练。在这种观点下,分数差距主要显示了研究机构在后训练阶段针对哪些能力 (@nrehiew_)。
  • 新评估:
  • Gym-Anything-RT:这些实时小游戏在模型思考时仍在移动。表现最好的模型 GPT-6 Astra 得分为 9% (@PranjalAggarw16)。
  • Immigration Bench:Vals 发布了专家编写的签证和移民身份相关问题及评分标准 (@ValsAI)。
  • BallotBench:九个代理,每个拥有 500 美元,实时预测 2026 年中期选举的所有 863 场选情 (@thoughtfullab)。

Safety, Alignment and Model Provenance

安全、对齐与模型溯源

  • Eval over-attribution in DeepSeek V4.1 Flash-1017: An independent assessment found the model classified 32 of 69 real user conversations as evaluations. The authors report a 46.4% false-positive rate on EvalDetectBench (@ZhihuFrontier).
  • Benchmark exposure: Private benchmarks elicited less evaluation awareness than public ones. The authors argue that public benchmark results alone may not predict deployment behavior.
  • Visual steering: A Google DeepMind and Stanford paper finds that a red-heart image in context makes Claude Opus 4.7 and GPT-5.4 write recursive code 100% of the time (@dair_ai).
  • Explanations: The models' explanations do not match their behavior. For GPT-5.4, 74.7% of reasoning traces give the wrong reason.
  • Alignment techniques:
  • GRAFT (Anthropic): Updates from detected reward hacks are confined to parameters that are deleted after training. Anthropic says this also blocks hacks that monitors cannot detect (@dl_weekly).
  • Embedded lie detector: A detector built into Qwen3.5's weights flags 91% of lies with zero false positives in 28k tokens. Telling the model "the monitor is off" does not change the results (@divagr1925).
  • Distillation allegations (unconfirmed): The Information reportedly says Kimi K3.1 Pro was distilled from GPT-6 Astra (@kimmonismus).
  • Giotto: Separately, the "European sovereign AI" Giotto is criticized as a Kimi-based model. Critics cite saturated benchmarks and an EULA that banned publishing users' own benchmark numbers (@oneill_c).
  • DeepSeek V4.1 Flash-1017 的评估过度归因:一项独立评估发现,该模型将 69 个真实用户对话中的 32 个分类为评估数据。作者报告称,在 EvalDetectBench 上误报率为 46.4% (@ZhihuFrontier)。
  • 基准暴露:私有基准比公开基准引发的评估意识更少。作者认为,仅凭公开基准结果可能无法预测部署行为。
  • 视觉引导:Google DeepMind 和斯坦福大学的一篇论文发现,上下文中包含红心图像会使 Claude Opus 4.7 和 GPT-5.4 100% 的时间编写递归代码 (@dair_ai)。
  • 解释:模型的解释与其行为不符。对于 GPT-5.4,74.7% 的推理轨迹给出了错误的原因。
  • 对齐技术:
  • GRAFT(Anthropic):从检测到的奖励黑客攻击中更新的参数仅限于训练后被删除的参数。Anthropic 表示,这也阻止了监控器无法检测到的黑客攻击 (@dl_weekly)。
  • 嵌入式测谎仪:内置于 Qwen3.5 权重中的检测器在 28k token 中以零误报率标记出 91% 的谎言。告诉模型“监控器已关闭”不会改变结果 (@divagr1925)。
  • 蒸馏指控(未经证实):据《The Information》报道,Kimi K3.1 Pro 是从 GPT-6 Astra 蒸馏而来的 (@kimmonismus)。
  • Giotto:单独来看,被称为“欧洲主权AI”的Giotto被批评为基于Kimi的模型。批评者指出其基准测试已饱和,且最终用户许可协议(EULA)禁止发布用户自己的基准测试结果(@oneill_c)。

Coding Agents and Developer Tools

编码代理与开发者工具

  • GitHub Copilot Fusion: Fusion orchestrates Anthropic and OpenAI models at runtime (@ArtificialAnlys).
  • Independent results: It scores 2 points below Opus 5.5 in Claude Code on the AA Coding Agent Index. It costs $5.59 per task, versus $11.42 for that setup, and uses 7.2M tokens per task. It leads Terminal-Bench 4.0 with 71.
  • GitHub Copilot Fusion:Fusion在运行时编排Anthropic和OpenAI模型(@ArtificialAnlys)。
  • 独立结果:在AA编码代理指数中,其在Claude Code上的得分比Opus 5.5低2分。每任务成本为5.59美元,而该配置的成本为11.42美元,每任务使用720万token。它在Terminal-Bench 4.0中以71分领先。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

关联信息,但可能不是同一事件