Carson CONCEPTION Rodrigues

Augmentation Helps but Single-Run Metrics Mislead: A Paired, Job-Level Audit of an Automated LLM Fine-Tuning Platform

Hosted platforms now fine-tune large language models on a user's data and report success through single numbers: a dataset quality grade and a pairwise win rate against the un-adapted base model. We audit one such platform, anonymised, using its own per-job records for all 384 fi...