AI Two Workloads in a Trench Coat: Why Prefill and Decode Change Everything
LLM inference is two opposite workloads — compute-bound prefill and memory-bandwidth-bound decode. Here's how continuous batching, PagedAttention, and disaggregation evolved to deal with it.
#llm-inference
#prefill-decode
#vllm
#pageattention
#continuous-batching
#gpu-architecture
#nvidia-dynamo
#kv-cache
#ai-engineering
