From Dev.to Community
Tech Articles
Curated developer articles, tutorials, and guides � auto-updated hourly
Alex Towell6d ago • 8 min read
Your Optimizer Is (Approximately) Propagating Fisher Information
Adam, K-FAC, EWC, and natural gradient are all approximating the same thing at different fidelity le...
#fisherinformation#naturalgradient#optimization#informationgeometry
0 0
Alex Towell6d ago • 3 min read
Fisher Flow: Optimization on the Statistical Manifold
Gradient descent in Euclidean space ignores the geometry of probability distributions. Natural gradi...
#optimization#informationgeometry#machinelearning
0 0