References for the Holonomic Gradient Method (HGM) and the Holonomic Gradient Descent Method (HGD)

Papers and Tutorials

1. Nobuki Takayama, Takaharu Yaguchi, Yi Zhang, Comparison of Numerical Solvers for Differential Equations for Holonomic Gradient Method in Statistics, arxiv:2111.10947
2. Shuhei Mano, Nobuki Takayama, Algebraic algorithm for direct sampling from toric models, arxiv:2110.14992
3. M.Adamer, A.Lorincz, A.L.Sattelberger, B.Sturmfels, Algebraic Analysis of Rotation Data arxiv: 1912.00396
4. Anna-Laura Sattelberger, Bernd Sturmfels, D-Modules and Holonomic Functions arxiv:1910.01395
5. N.Takayama, L.Jiu, S.Kuriki, Y.Zhang, Computations of the Expected Euler Characteristic for the Largest Eigenvalue of a Real Wishart Matrix, jmva
6. M.Harkonen, T.Sei, Y.Hirose, Holonomic extended least angle regression, arxiv:1809.08190
7. S.Mano, Partitions, Hypergeometric Systems, and Dirichlet Processes in Statistics, JSS Research Series in Statistics, 2018.
8. A.Kume, T.Sei, On the exact maximum likelihood inference of Fisher–Bingham distributions using an adjusted holonomic gradient method, doi (2018)
9. Yoshihito Tachibana, Yoshiaki Goto, Tamio Koyama, Nobuki Takayama, Holonomic Gradient Method for Two Way Contingency Tables, arxiv:1803.04170
10. F.H.Danufane, K.Ohara, N.Takayama, C.Siriteanu, Holonomic Gradient Method-Based CDF Evaluation for the Largest Eigenvalue of a Complex Noncentral Wishart Matrix (Title of the version 1: Holonomic Gradient Method for the Distribution Function of the Largest Root of Complex Non-central Wishart Matrices), arxiv:1707.02564
11. T.Koyama, An integral formula for the powered sum of the independent, identically and normally distributed random variables, arxiv:1706.03989
12. H.Hashiguchi, N.Takayama, A.Takemura, Distribution of Ratio of two Wishart Matrices and Evaluation of Cumulative Probability by Holonomic Gradient Method, arxiv:1610.09187
13. R.Vidunas, A.Takemura, Differential relations for the largest root distribution of complex non-central Wishart matrices, arxiv:1609.01799
14. S.Mano, The A-hypergeometric System Associated with the Rational Normal Curve and Exchangeable Structures, doi , arxiv:1607.03569
15. M.Noro, System of Partial Differential Equations for the Hypergeometric Function 1F1 of a Matrix Argument on Diagonal Regions, ACM DL
16. Y.Goto, K.Matsumoto, Pfaffian equations and contiguity relations of the hypergeometric function of type (k+1,k+n+2) and their applications, arxiv:1602.01637
17. T.Koyama, Holonomic gradient method for the probability content of a simplex region with a multivariate normal distribution, arxiv:1512.06564
18. N.Takayama, Holonomic Gradient Method (in Japanese, survey), hgm-dic.pdf
19. N.Takayama, S.Kuriki, A.Takemura, A-Hpergeometric Distributions and Newton Polytopes, arxiv:1510.02269
20. G.Weyenberg, R.Yoshida, D.Howe, Normalizing Kernels in the Billera-Holmes-Vogtmann Treespace, arxiv:1506.00142
21. C.Siriteanu, A.Takemura, C.Koutschan, S.Kuriki, D.St.P.Richards, H.Sin, Exact ZF Analysis and Computer-Algebra-Aided Evaluation in Rank-1 LoS Rician Fading, arxiv:1507.07056
22. K.Ohara, N.Takayama, Pfaffian Systems of A-Hypergeometric Systems II --- Holonomic Gradient Method, arxiv:1505.02947
23. T.Koyama, The Annihilating Ideal of the Fisher Integral, arxiv:1503.05261
24. T.Koyama, A.Takemura, Holonomic gradient method for distribution function of a weighted sum of noncentral chi-square random variables, arxiv:1503.00378
25. Y.Goto, Contiguity relations of Lauricella's F_D revisited, arxiv:1412.3256
26. T.Koyama, H.Nakayama, K.Ohara, T.Sei, N.Takayama, Software Packages for Holonomic Gradient Method, Mathematial Software --- ICMS 2014, 4th International Conference, Proceedings. Edited by Hoon Hong and Chee Yap, Springer lecture notes in computer science 8592, 706--712. DOI
27. N.Marumo, T.Oaku, A.Takemura, Properties of powers of functions satisfying second-order linear differential equations with applications to statistics, arxiv:1405.4451
28. J.Hayakawa, A.Takemura, Estimation of exponential-polynomial distribution by holonomic gradient descent arxiv:1403.7852
29. C.Siriteanu, A.Takemura, S.Kuriki, MIMO Zero-Forcing Detection Performance Evaluation by Holonomic Gradient Method arxiv:1403.3788
30. T.Koyama, Holonomic Modules Associated with Multivariate Normal Probabilities of Polyhedra, arxiv:1311.6905
31. T.Hibi, K.Nishiyama, N.Takayama, Pfaffian Systems of A-Hypergeometric Equations I, Bases of Twisted Cohomology Groups, arxiv:1212.6103 (major revision v2 of arxiv:1212.6103). Accepted version is at DOI
32. T.Hibi et al, Groebner Bases : Statistics and Software Systems , Springer, 2013.
33. Introduction to the Holonomic Gradient Method (movie), 2013. movie at youtube
34. T.Sei, A.Kume, Calculating the Normalising Constant of the Bingham Distribution on the Sphere using the Holonomic Gradient Method, Statistics and Computing, 2013, DOI
35. T.Koyama, A.Takemura, Calculation of Orthant Probabilities by the Holonomic Gradient Method, arxiv:1211.6822
36. T. Koyama, H. Nakayama, K. Nishiyama, N. Takayama, Holonomic Rank of the Fisher-Bingham System of Differential Equations, Journal of Pure and Applied Algebra (online), DOI
37. T. Koyama, H. Nakayama, K. Nishiyama, N. Takayama, Holonomic Gradient Descent for the Fisher-Bingham Distribution on the d-dimensional Sphere, Computational Statistics (2013) DOI
38. Hiroki Hashiguchi, Yasuhide Numata, Nobuki Takayama, Akimichi Takemura, Holonomic gradient method for the distribution function of the largest root of a Wishart matrix, Journal of Multivariate Analysis, 117, (2013) 296-312, DOI
39. Tomonari Sei, Hiroki Shibata, Akimichi Takemura, Katsuyoshi Ohara, Nobuki Takayama, Properties and applications of Fisher distribution on the rotation group, Journal of Multivariate Analysis, 116 (2013), 440--455, DOI
40. T.Koyama, A Holonomic Ideal which Annihilates the Fisher-Bingham Integral, Funkcialaj Ekvacioj 56 (2013), 51--61. DOI
41. Hiromasa Nakayama, Kenta Nishiyama, Masayuki Noro, Katsuyoshi Ohara, Tomonari Sei, Nobuki Takayama, Akimichi Takemura , Holonomic Gradient Descent and its Application to Fisher-Bingham Integral, Advances in Applied Mathematics 47 (2011), 639--658, DOI

1. H.Dwinwoodie, L.Matusevich, E. Mosteig, Transform methods for the hypergeometric distribution, Statistics and Computing 14 (2004), 287--297.

Three Steps of HGM

1. Finding a holonomic system satisfied by the normalizing constant. We may use computational or theoretical methods to find it. Groebner basis and related methods are used.
2. Finding an initial value vector for the holonomic system. This is equivalent to evaluating the normalizing constant and its derivatives at a point. This step is usually performed by a series expansion.
3. Solving the holonomic system numerically. We use several methods in numerical analysis such as the Runge-Kutta method of solving ordinary differential equations and efficient solvers of systems of linear equations.

Software Packages for HGM

• CRAN package hgm (for R).
• Some software packages are experimental and temporary documents are found in "asir-contrib manual" (auto-autogenerated part), or "Experimental Functions in Asir", or "miscellaneous and other documents" of the OpenXM documents or in this folder. The nightly snapshot of the asir-contrib can be found in the asir page below, or look up our cvsweb page.
  1. Command line interfaces are in the folder OpenXM/src/hgm in the OpenXM source tree. See OpenXM distribution page .
  2. Experimental version of hgm package for R (hgm_*tar.gz, hgm-manual.pdf) for the step 3. To install this package in R, type in

     R CMD install hgm_*.tar.gz
     

  3. The following packages are for the computer algebra system Risa/Asir. They are in the asir-contrib collection.
     • yang.rr (for Pfaffian systems) , nk_restriction.rr (for D-module integrations), tk_jack.rr (for Jack polynomials), ko_fb_pfaffian.rr (Pfaffian system for the Fisher-Bingham system), are for the steps 1 or 2.
     • nk_fb_gen_c.rr is a package to generate a C program to perform maximal Likehood estimates for the Fisher-Bingham distribution by HGD (holonomic gradient descent).
     • ot_hgm_ahg.rr (HGM for A-distributions, very experimental).

Programs to try examples of our papers

1. d-dimensional Fisher-Bingham System

 $OpenXM: OpenXM/src/hgm/doc/ref-hgm.html,v 1.33 2021/12/13 04:40:21 takayama Exp $