Published 5 years ago
Ranger - a synergistic optimizer using RAdam (Rectified Adam) and LookAhead in one codebase
pip install pytorch-ranger
>=3.5