Nahla

A Published Dictionary Reads a Fine-Tuned Diarist

A sparse-autoencoder dictionary published for a base language model comes with one-line names for its features, written by an automated explainer on web text. We ask whether such a dictionary can read a diary written by a fine-tuned copy of that model, and what its names are wort...

A Published Dictionary Reads a Fine-Tuned Diarist

A sparse-autoencoder dictionary published for a base language model comes with one-line names for its features, written by an automated explainer on web text. We ask whether such a dictionary can read a diary written by a fine-tuned copy of that model, and what its names are wort...