
Lecture 41 of 81 · Stochastic Modeling and Queues
Krishna Jagannathan
Stochastic Modeling and Queues · 81 lectures
81 lectures
1: Review of Probability Theory: Random Variable
2: Sequence of Random Variables
3: Laws of Large Numbers and Central Limit Theorem
4: What is a stochastic process?
5: Counting Process
6: Poisson Process-Introduction
7: Poisson Process-Memorylessness
8: Poisson Process-Increment properties
9: Distribution of arrival epoch Sn and N (t) for a Poisson
10: Alternate definitions of a Poisson Process
11: Merging of Poisson Processes - I
12: Merging of Poisson Processes - Part 2
13: Splitting of Poisson Process - Part 1
14: Splitting of Poisson Process - Part 2
15: Example: Poisson Splitting
16: Conditional arrival density and order statistics - Part 1
17: Conditional arrival density and order statistics - Part 2
18: Non Homogeneous Poisson Process
19: Introduction to Queueing (with examples)
20: Examples: Non homogeneous Poisson process
21: Examples: Competing Poisson processes
22: Introduction to Renewal Processes
23: Strong law for renewal processes
24: Strong law for renewal processes - Proof
25: Residual life, age and duration (Time average) - Part 1
26: Residual life, age and duration (Time average) - Part 2
27: Renewal Reward Theorem (Time average) - Part 1
28: Renewal Reward Theorem (Time average) - Part 2
29: Stopping time
30: Wald’s Equality
31: Wald’s Equality (Contd.)
32: Elementary Renewal Theorem
33: The Renewal Equation
34: The Renewal Equation (Contd.)
35: G/G/1 Queue and Little’s theorem
36: Little’s theorem
37: M/G/1 Queue
38: M/G/1 Queue & PK Formula
39: M/G/1 Queue & PK Formula (Contd.)
40: Ensemble rewards - Age and Duration
41: Ensemble rewards - Age and Duration (Contd.)
42: Key Renewal Theorem & Ensemble rewards
43: Introduction to finite state Discrete Time Markov Chains
44: Class and Types of Classes in a DTMC
45: Periodicity in a DTMC
46: Matrix Representation of a DTMC
47: The long term behaviour of a DTMC
48: Stationary Distribution and Long term behaviour of a DTMC
49: Stationary Distribution and Long term behaviour of a DTMC
50: Stationary Distribution and Long term behaviour of a DTMC
51: Spectral Properties of Stochastic Matrices - Part 1
52: Spectral Properties of Stochastic Matrices - Part 2
53: The Short-term Behaviour of a DTMC
54: Introduction to Countable-state DTMC
55: Introduction to Countable-state DTMC (Contd)
56: The Strong Markov Property
57: Renewal Theory applied to DTMC’s
58: Stationary Distribution of a Countable State Space DTMC
59: Stationary Distribution of a Countable State Space DTMC
60: Stationary Distribution and The Steady State Behaviour
61: Stationary Distribution and The Steady State Behaviour
62: Convergence to Steady State of a Coutable-state DTMC
63: The Birth-Death Markov Chains
64: The Reversibility Markov Chains
65: The Reversibility Markov Chains Contd
66: Time Sampled M/M/1 Queue and The Burke’s Theorem
67: Introduction to Continuous Time Markov Chains
68: Introduction to CTMC (Contd.)
69: The Steady State Behaviour of CTMC - Part 1
70: The Steady State Behaviour of CTMC - Part 2
71: The Steady State Behaviour of CTMC - Part 3
72: The Steady State Behaviour of CTMC - Part 4
73: The chapman-kolmogrov equations for CTMC’s
74: The Birth-Death Continuous time Markov Chains
75: The Reversibility of Continuous time Markov Chains
76: Burke’s Theorem and the Tandem Queues - Part 1
77: Burke’s Theorem and the Tandem Queues - Part 2
78: The Jackson Networks - Part 1
79: The Jackson Networks - Part 2
80: Semi Markov Processes - Part 1
81: Semi Markov Processes - Part 2