跳到主内容
精选80Rohan Paul模型发布/更新

Tensordyne发布AI推理机架,声称吞吐量达英伟达13倍

Quite a massive inferencing rack breakthrough from @TensordyneInc .

原文

Quite a massive inferencing rack breakthrough from @TensordyneInc .

They just announced an AI-inference rack, claiming 13x the rack throughput of NVIDIA’s NVL72 GB300 in a DeepSeek-R1 comparison based on internal simulations.

What makes this a big deal is that Tensordyne is attacking inference at the math level.

AI chips spend huge amounts of energy moving and multiplying numbers.

Napier (its AI inference racks) works in log space, where multiplication becomes addition, and addition is cheaper to build, switch, cool, and repeat billions of times per token.

So instead of spending tons of transistor budget on heavy multiply circuits, Napier tries to shrink the math itself.

So that means less chip area for compute and more for SRAM, resulting in less power per token and way more inference packed into the same rack.

If they have made log math accurate and fast enough for real inference, then Napier is not just pushing more power into a rack, it is changing the cost of the basic operation behind model serving.

AI inference is no longer just a FLOPS race. It is a rack-level fight over power, memory locality, interconnect latency, and how many paying tokens can be served before the economics break.

They reported their TDN Rack reaches 363,000 tokens per second on DeepSeek-R1 at user speeds of 210 tokens per second per internal simulation, compared with 27,400 tokens per second for Nvidia’s NVL72 GB300.

🧵 1.

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

关联讨论

同一事件的更多信源

相似阅读

另一事件,读法相近