[Bug]`fast_rms_layernorm` does not compute weight gradients — RMSNorm weights never update during full finetuning
March 23, 2026 · #4533
Python
Difficulty: Medium
Labels
bug
Parent Repository
unslothai/unsloth
Python repository
60,135 5,153