Nvidia Groq 3 LPX 系统小模型解码速度超3400 tok/s

Nvidia's Groq 3 LPX system excels at fast decode of small models (>3,400 tok/s), according to a @ArtificialAnlys benchmarks of Gemma 4 31B. LPX does this by using a small amount (128 GB) of ultrafast SRAM in place of HBM.

Nvidia proposes combining LPUs with GPUs to bring this speed to frontier-scale models. A look at how that (might) work below.