Natural SciencesComputer ScienceMathematicsProbability TheoryStochastic ProcessesComputational MathematicsMarkov ChainsMarkov ProcessesMonte Carlo MethodsNumerical AlgorithmsNumerical AnalysisContinuous-time Markov ChainsDiscrete-time Markov ProcessesFinite Markov ChainsFinite-state Markov ChainsNumerical Methods For Stochastic Differential Equations