We may attempt to live stream, the live in-person sessions. Please note that it is UCL’s expectation that students attend in-person. The Zoom link is available here. Not all sessions will be recorded or streamed. The recording links will be available on Moodle.
We reviewed and introduced Markov chains and some proof techniques with the worksheet. We also discussed Doeblin’s coupling and its role in proving convergence. We also briefly mentioned an alternative approach based in linear algebra: Perron–Frobenius theorem.
We introduced Poisson processes and discussed the Metropolis algorithm.
We briefly discussed continuous-time Markov chains. We went over in some detail, the renewal-type argument for the a version of LLN for Markov chains.
We discussed how to recover stationary increments in the context of renewal processes.
Version: 20 November 2024