STA 331 2.0 Stochastic Processes

Road map for the semester

Semester stating date: 21 Oct 2025

Time: 1pm - 3pm

Location: NFC IV

For additional information: Refer to the Google Classroom

Reference Book

Introduction to Stochastic Processes by Thiyanga S. Talagala

Introduction to Probability Models-10th Edition by Sheldon Ross

Week 1: 21 Oct 2025

Introduction to Stochastic Processes

Week 2: 28 Oct 2025

Markov Chain Processes

Week 3: 18 Nov 2025/ Week 4: 21 Nov 2025/

Higher (n-step) transition probabilities

Week 5: 25 Nov 2025

Classification of States

Dec 2, 2025 - Cancelled due to Ditwah storm and flood

Week 6: 9 Dec 2025

Markov chain process calculations with R

Week 7: 16 Dec 2025

Limiting probabilities and positive recurrent

Continuous Parameter Markov Chains

Week 8: 19 Dec 2025

Poisson Process

Week 9: 6 January 2026

Mid Semester Examination

Week 10: 13 January 2026

Distribution of inter arrival time, Distribution of waiting time

Thinning or splitting a Poisson Process

Week 11: 20 January 2026

Compound Poisson Process - cont. from previous slides

Nonhomogeneous Poisson Process - cont. from previous slides

Important facts about exponential distribution

Birth Process, Death Process and Birth-Death Process

Week 12: 27 January 2026

Birth and Death Process - Examples