Simulation of multivariate normal rectangle probabilities and their derivatives theoretical and computational results

Vassilis A. Hajivassiliou, Daniel McFadden, Paul A. Ruud

Journal of Econometrics · 1996 · 470 citations · 29 references

DOIFull text

Open access

Concepts

TL;DR

The evaluation of multivariate normal rectangle probabilities, such as negative orthant probabilities, is a computationally challenging problem central to econometric models like the multinomial probit. This study surveys Monte Carlo methods that approximate these probabilities and their derivatives while reducing computational burden to support iterative statistical inference. The authors review and implement a suite of simulators—including CFS, NIS, KFS, SDS, GHK, PCF, DCS, ARS, GSS, SUS, and AUS—in Gauss and FORTRAN, and report their computational performance. Among the methods examined, the Geweke–Hajivassiliou–Keane (GHK) simulator proved to be the most reliable overall.

Abstract

An extensive literature in econometrics and in numerical analysis has considered the problem of evaluating the multiple integral P(B; μ, Ω) = ∝ab n(v − μ, Ω)dv ≡ Ev1(V ϵ B), where V is a m-dimensional normal vector with mean μ, covariance matrix Ω, and density n(v − μ, Ω), and 1(V ϵ B) is an indicator for the event B = (V¦a < V < b). A leading case of such an integral is the negative orthant probability, where B = (V ¦V < 0). The problem is computationally difficult except in very special cases. The multinomial probit (MNP) model used in econometrics and biometrics has cell probabilities that are negative orthant probabilities, with μ and Ω depending on unknown parameters (and, in general, on covariates). Estimation of this model requires, for each trial parameter vector and each observation in a sample, evaluation of P(B; μ, Ω) and of its derivatives with respect to μ and Ω. This paper surveys Monte Carlo techniques that have been developed for approximations of P(B; μ, Ω) and its linear and logarithmic derivatives, that limit computation while possessing properties that facilitate their use in iterative calculations for statistical inference: the Crude Frequency Simulator (CFS), Normal Importance Sampling (NIS), a Kernel-Smoothed Frequency Simulator (KFS), Stern's Decomposition Simulator (SDS), the Geweke-Hajivassiliou-Keane Simulator (GHK), a Parabolic Cylinder Function Simulator (PCF), Deák's Chi-squared Simulator (DCS), an Acceptance/Rejection Simulator (ARS), the Gibbs Sampler Simulator (GSS), a Sequentially Unbiased Simulator (SUS), and an Approximately Unbiased Simulator (AUS). We also discuss Gauss and FORTRAN implementations of these algorithms and present our computational experience with them. We find that GHK is overall the most reliable method.

References

29