adamw_bfloat16

Python ★ 40 updated 2y ago

AdamW optimizer for bfloat16 models in pytorch 🔥.

No plain-English explanation yet — one is being written right now. Check back in a minute.