Gustavo Dias Apolinário

The Base-Point Barrier: Certifying Low-Rank Truncation Costs a Full Evaluation Pass

Deciding what a low-rank truncation costs in accuracy requires evaluating the truncated network, and this paper proves that nothing measured where the network already sits can take the place of that evaluation. Eckart–Young–Mirsky bounds reconstruction error, not accuracy, and th...

The Base-Point Barrier: Certifying Low-Rank Truncation Costs a Full Evaluation Pass

Deciding what a low-rank truncation costs in accuracy requires evaluating the truncated network, and this paper proves that nothing measured where the network already sits can take the place of that evaluation. Eckart–Young–Mirsky bounds reconstruction error, not accuracy, and th...