Zheping Wang

A Survey of Inference Processing Units for Large Language Model Inference: Chips, Systems, Algorithms, and Paradigms (2024–2026)

This survey reviews 2024–2026 progress in LLM inference through a unified "inference processing unit" (IPU) lens, organized into 4 coupled layers. 1. The chip layer covers dedicated accelerators (Groq's LPU, Cerebras' wafer-scale engine), hyperscaler ASICs (Google's TPU v7, AWS T...

A Survey of Inference Processing Units for Large Language Model Inference: Chips, Systems, Algorithms, and Paradigms (2024–2026)

This survey reviews 2024–2026 progress in LLM inference through a unified "inference processing unit" (IPU) lens, organized into 4 coupled layers. 1. The chip layer covers dedicated accelerators (Groq's LPU, Cerebras' wafer-scale engine), hyperscaler ASICs (Google's TPU v7, AWS T...