The Weights Can’t Bring Me Down