跳到主内容
@wquguru
精选75Rohan Paul行业动态多源精选 ×3

微软因算力落后关闭甲骨文AI服务器

Bloomberg: Microsoft is switching off AI servers it rented from Oracle after dec…

原文
发到 X

Bloomberg: Microsoft is switching off AI servers it rented from Oracle after declining to renew a 2023 contract built around Bing.

彭博社:微软在拒绝续签围绕Bing构建的2023年合同后,正在关闭其从甲骨文租赁的AI服务器。

The capacity lost value over time because Oracle’s hardware ran older-generation Nvidia chips that no longer matched Microsoft’s specifications, according to people familiar with the matter.

据知情人士透露,由于甲骨文的硬件运行的是较老一代的英伟达芯片,不再符合微软的规格要求,因此这些容量的价值随时间推移而下降。

Basically, Microsoft pays per GPU-hour. A Blackwell GPU produces several times more inference output than an H100 for similar power, so each Hopper or Ampere hour now buys far less work.

基本上,微软按GPU小时付费。一块Blackwell GPU产生的推理输出量是H100的数倍,且功耗相似,因此每个Hopper或Ampere小时现在能完成的工作量大幅减少。

Current frontier models, often large mixture-of-experts designs, need lots of memory and fast links between GPUs. An H100 has 80GB of memory and talks quickly to only 8 GPUs in its server. Blackwell racks link 72 GPUs as one unit, with 192 to 288GB each. Big models either don’t fit on the old boxes or run slowly across their slower network.

当前的前沿模型通常采用大型混合专家(MoE)架构,需要大量内存以及GPU之间的高速互联。H100拥有80GB内存,但仅能在服务器内与另外8块GPU快速通信。Blackwell机架将72块GPU作为一个单元连接,每块GPU配备192至288GB内存。大型模型要么无法装入旧设备,要么在其较慢的网络中运行缓慢。

Oracle says demand for its AI infrastructure remains strong, and in September it renewed contracts for 4-year-old GPUs at a 20% premium to the original price.

甲骨文表示,其对AI基础设施的需求依然强劲,并在今年九月以高于原价20%的价格续签了使用四年GPU的合同。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →