Shin Yoo

Atropos: Improving Cost-Benefit Trade-Off of LLM-Based Agents under Self-Consistency with Early Termination and Model Hotswap

Open-weight Small Language Models(SLMs) can provide faster local inference at lower financial cost, but may not achieve the same performance level as commercial Large Language Models (LLMs) that are orders of magnitudes larger. Consequently, many of the latest applications of LLM...