Multidimensional Stochastic Approximation Methods

Abstract

Multidimensional stochastic approximation schemes are presented, and conditions are given for these schemes to converge a.s. (almost surely) to the solutions of $k$ stochastic equations in $k$ unknowns and to the point where a regression function in $k$ variables achieves its maximum.