Discrete Probability and Markov Chains: Worked Examples, Queueing Models, Random Walks,and Applications in Computer Science,Statistics, Finance

Probability, Statistics, and Queueing Theory: With Computer science Applications (Computer applied mathematics series)

Probability, Statistics, and Queueing Theory (Computer Science Scientific Computing)

Probability and Statistics by Example: Volume 2, Markov Chains: A Primer in...

Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series in Probability and Statistics)