Marko Tahvanainen

Budgeted Reward Allocation: A Position on Unifying Sparse, Verifiable, and Hierarchical Reward Signals in LLM Post-Training

Reward hacking, verbosity, and hallucination are usually treated as separate failure modes in the post-training of large language models, addressed by separate mechanisms: reward shaping for verbosity, verifiable reward models (RLVR) for hallucination, hierarchical decomposition...