
Lecture 23 of 49 · Introduction to Stochastic Processes
NPTEL IIT Bombay
Introduction to Stochastic Processes · 49 lectures
49 lectures
1: Sample Space and events
2: Axioms of Probability
3: Independence of events and Conditional Probability
4: Baye’s Theorem and Introduction to Random Variables
5: CDF and it’s properties
6: Continuity of Probability
7: Discrete and Continuous random variables
8: Expectation of random variables and its properties
9: Variance and some inequalities of random variables
10: Discrete Probability Distributions
11: Continuous Probability Distributions
12: Jointly distributed random variables and conditional
13: Correlation and Covariance
14: Transformation of random vectors
15: Gaussian random vector and joint Gaussian distribution
16: Random Processes
17: Properties of random Process
18: Poisson Process
19: Properties of Poisson Process (Part 1)
20: Properties of Poisson Process (Part 2)
21: Convergence of sequence of random variables (Part 1)
22: Convergence of sequence of random variables (Part 2)
23: Relation between different notions of convergence
24: Cauchy’s criteria of convergence
25: Convergence in expectation
26: Law of Large Numbers
27: Central limit theorem
28: chernoff bound
29: Introduction to Markov property
30: Transition Probability Matrix
31: Finite dimensional distribution of Markov chains
32: Strong Markov Property
33: Stopping Time
34: Hitting Times and Recurrence
35: Mean Number of returns to a state
36: Communicating classes and classproperties
37: Class Properties Continued
38: Positive Recurrence and TheInvariant Probability Vector
39: Properties of Invariant Probability
40: Condition For Transience
41: Example of Queue
42: Queue Continued and Example ofPage Rank
43: Introduction to renewal Theory
44: The Elementary Renewal Theorem
45: Application to DTMC
46: Renewal Reward Theorem
47: Introduction to Continuous Time Markov
48: Properties of states in CTMC
49: Embedded markov chain