Affiliated Mortgage

Measuring Workload-Network Coupling in Local LLM Serving: Traffic Demand and Client Latency

AI workloads can change network demand, and network conditions can affect AI service latency. We measure one narrow part of this relationship: a locally served Qwen2.5-3B model under different application-path profiles, request concurrency, and output caps. On one Windows host wi...