Lukas Vöge

Toward scalable generative AI: efficient language model distillation via zero-shot rationales

Abstract This paper investigates an efficient approach for distilling Large Language Models (LLMs) into smaller, application-specific models using zero-shot Chain of Thought (CoT) rationale generation and Optimization by Prompting (OPRO). To address the challenges of deploying co...