1 Introduction
1.0 Overview
1.1 Introduction
1.2 Discrete Random Variables and Generating Functions
1.3 Continuous Random Variables and Laplace Transforms
1.4 Some Mathematical Background
Problems
Bibliographic Notes
References
Appendix
2 Poisson Processes
2.0 Overview
2.1 Introduction
2.2 Properties of Poisson Processes
2.3 Nonhomogeneous Poisson Processes
2.4 Compound Poisson Processes
2.5 Filtered Poisson Processes
2.6 Two-Dimensional and Marked Poisson Processes
2.1 Poisson Arrivals See Time Averages (PASTA)
Problems
Bibliographic Notes
References
Appendix
3 Renewal Processes
3.0 Overview
3.1 Introduction
3.2 Renewal-Type Equations
3.3 Excess Life, Current Life, and Total Life
3.4 Renewal Reward Processes
3.5 Limiting Theorems, Stationary and Transient Renewal Processes
3.6 Regenerative Processes
3.7 Discrete Renewal Processes
Problems
Bibliographic Notes
References
Appendix
4 Discrete-Time Markov Chains
4.0 Overview
4.1 Introduction
4.2 Classification of States
4.3 Ergodic and Periodic Markov Chains
4.4 Absorbing Markov Chains
4.5 Markov Reward Processes
4.6 Reversible Discrete-Tune Markov Chains
Problems
Bibliographic Notes
References
Appendix
5 Continuous-Time Markov Chains
5.0 Overview
5.1 Introduction
5.2 The Kolmogorov Differential Equations
5.3 The Limiting Probabilities
5.4 Absorbing Continuous-Time Markov Chains
5.S Phase-Type Distributions
5.6 Uniformization
5.7 Continuous-Time Markov Reward Processes
5.8 Reversible Continuous-Time Markov Chains
Problems
Bibliographic Notes
References
Appendix
6 Markov Renewal and Semi-Regenerative Processes
6.0 Overview
6.1 Introduction
6.2 Markov Renewal Functions and Equations
6.3 Semi-Markov Processes and Related Reward Processes
6.4 Semi-Regenerative Processes
Problems
Bibliographic Notes
References
Appendix
7 Brownian Motion and Other Diffusion Processes
7.0 Overview
7.1 Introduction
7.2 Diffusion Processes
7.3 Ito's Calculus and Stochastic Differential Equations
7.4 Multidimensional Ito's Lemma
7.5 Control of Systems of Stochastic Differential Equations
Problems
Bibliographic Notes
References
Appendix
Appendix: Getting Started with MATLAB
Index