Optimization Diagnostic
SahaBose-KFAC vs. Baselines
OPTIMIZATION DYNAMICS
SahaBose-KFAC
(Stable/Fast)
Vanilla KFAC
(Erratic)
Adam
(Noisy)
SGD
(Stuck)