LLM推理工作原理清晰解析

How LLM Inference Works, Clearly Explained.

Every generate() call to an LLM runs two distinct computational phases on the same GPU: prefill (processing the prompt) is compute-bound while decode (generating tokens one at a time) is memory-bound.