An Application of the Holonomic Gradient Method to the Neural Tangent Kernel


Files with .rr extension is for the Risa/Asir. File with .m extension is for Mathematica.
  1. Codes of "7 Experiments".
          tar xzvf ntk_class.tar.gz
          python experiment_activators.py
        
  2. Derive an ODE for the dual activation of ReLU
  3. Derive an ODE for the dual activation of ReSin
  4. Derive an ODE for the dual activation of GeLU
  5. A simple sample code of "HGM all at once method" in "5 Fast Evaluation by the HGM".
  6. Codes of "7.3 Improvements of numerical solvers in 7 Experiments".