From Dev.to Community
Tech Articles
Curated developer articles, tutorials, and guides � auto-updated hourly
Alex Towell6d ago • 8 min read
Your Optimizer Is (Approximately) Propagating Fisher Information
Adam, K-FAC, EWC, and natural gradient are all approximating the same thing at different fidelity le...
#fisherinformation#naturalgradient#optimization#informationgeometry
0 0