Oğuz Kağan Kahraman

Comparing a Hesitation-Word Logit Penalty with presence_penalty in Qwen3.5-0.8B Thinking Mode: A Short Measurement Note

The Qwen3.5-0.8B model card notes that, at the recommended settings, the model is prone to thinking loops in thinking mode even with a presence penalty (presence_penalty) of 1.5 [3]. In this note, we compared a constant logit penalty applied to hesitation words (W3; λ = 3) with t...

Balanced Defensive Fine-Tuning for Text-to-SQL on a Small Code Language Model: A Pre-Registered Measurement Report

Locally run small language models enable generating SQL from natural language without sending the database schema to third-party servers. However, a model fine-tuned only to "translate the question into SQL" can also translate destructive or unauthorized commands embedded in the...