Anthropic CEO：1亿词上下文窗口已可实现，推理是瓶颈

"100 million words context window is already possible, which is roughly what a human hears in a lifetime. Inference support is the only bottleneck to achieve it.

And AI Models actually do learn during the context window, without changing the weights."

~ Anthropic CEO Dario Amodei

This is from 11 months back. --- From 'Alex Kantrowitz' YT Channel (Full Video link in comment)