> ## Documentation Index
> Fetch the complete documentation index at: https://newtorch.aboneda.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Adam & Variants

> AdamW, AdaFactor, LAMB, and modern optimizers

# Adam & Variants

Adam, AdamW (decoupled weight decay), AdaGrad, RMSprop.