跳到主内容
@wquguru
精选65r/LocalLLaMA(Reddit)行业动态多源精选 ×4

Sam Altman称本地推理是稀缺资源的糟糕分配

Sam Altman: “Local inference is a terrible allocation of scarce resources”

原文
发到 X

Sam Altman: “Local inference is a terrible allocation of scarce resources.

山姆·奥特曼:"本地推理是对稀缺资源的糟糕分配。"

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre

很多人想要本地推理,并且不知为何他们认为问题已经解决了,因为我们有开源模型,我们能够在自己的计算机上运行它们,因此我们就不需要数据中心里的那些东西了

but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time

但从全球资源分配的角度来看,让每个人都把世界有限的 DRAM 供应大量存放在自己的电脑里,并且只使用百分之五的时间,这实际上是非常糟糕的

you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,

如果你试图应对这种供应受限的环境,你就希望在云端实现最大化的利用率,

somehow many people's intuition is the opposite of that”

然而许多人的直觉却与此相反"

——————————————————————

TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"

TL;DR(太长不看)卖产品的人说:"以下是为什么拥有你自己的产品而不是向我租用是一个糟糕的主意"

(Credits to @RyanTStull, his TLDR made me laugh)

(感谢 @RyanTStull,他的 TL;DR 让我笑了)

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →