OpenAI 推理成本减半，新芯片加持

OpenAI achieved a much more significant breakthrough today.

Sonnet 5 is an average release. But the fact that OpenAI, according to The Information, has managed to more than halve the inference costs of its current models through a new approach to inference optimization is absolutely groundbreaking.

And when you also consider that they recently introduced their own inference chip with Broadcom, which is said to be faster and more efficient than the competition, I increasingly see OpenAI in an outstanding position.

Today, at least, OpenAI emerges as the winner of the day.