Fuzzy hyperparameters update in a second order optimization
Abdelaziz Bensadok Muhammad Zeeshan Babar
This research will present a hybrid approach to accelerate convergence in a
second order optimization. An online finite difference approximation of the
diagonal Hessian matrix will be introduced, along with fuzzy inferencing of
several hyperparameters. Competitive results have been achieved