An Application of the Holonomic Gradient Method to the Neural Tangent Kernel
Paper
Computer algebra system
Risa/Asir
.
Files with .rr extension is for the Risa/Asir. File with .m extension is for Mathematica.
Codes
of "7 Experiments".
tar xzvf ntk_class.tar.gz python experiment_activators.py
Derive an ODE for the dual activation of ReLU
Derive an ODE for the dual activation of ReSin
Derive an ODE for the dual activation of GeLU
A simple sample code
of "HGM all at once method" in "5 Fast Evaluation by the HGM".
Codes
of "7.3 Improvements of numerical solvers in 7 Experiments".