• Fixes for Nesterov momentum in ML

  Dec 23, 2025

• Better starting scale for Muon

  Dec 19, 2025

• Why random rotations are good for RoPE

  Jul 27, 2025