Course Description


This is a graduate-level course that teaches basics of random process theory with applications to communication theory and systems.  Important topics include analysis of common random processes (e.g. Poisson process, White Noise, Wiener Process, etc.), random sequences, random processes in linear systems, Markov Chains, mean-square calculus.


The textbook used for the course is, "Probability, Statistics, and Random Processes for Engineers+, 4th Edition, by H. Stark and J. W. Woods.


The video lectures listed below provide a full outline of the course, but only portions of the lectures have been recorded so far.  I try to add a few more recorded lectures each time I teach the course.

Blue text indicates Members Only portions of the website.


Video Lectures


  • Random Vectors: (14 videos, ~164 minutes)

    • Topics include: density and distribution functions, uncorrelated vectors, orthogonal vectors, transformations of random vectors, covariance matrices, eigenvalues/eigenvectors of covariance matrices, covariance diagonalization, Gaussian random vectors.

  • Random Sequences

    • Part 1: (17 videos, ~202 minutes)

      • Topics include: random sequence definition, mean function autocorrelation function, Bernoulli random sequence, arrival time random sequence, random walks, random sequences in discrete-time linear systems

    • Part 2: (11 videos, ~78 minutes)

      • Topics include: Wide-sense stationary (WSS) random sequences, autocorrelation function properties, simplified input/output relationships for WSS random sequences in linear systems, the power spectral density (PSD) function, PSD properties, and PSD examples in Matlab.

    • Part 3: (9 videos, ~117 minutes)

      • Topics include: Markov random sequences, Markov chains, state transition matrices, probability row vectors, convergence of sequences, sure convergence, almost sure convergence, and mean-square convergence.​

  • Random Processes

    • Part 1: (10 videos, ~86 minutes)

      • Topics include: Random process definition, mean and autocorrelation functions, asynchronous binary signaling, Poisson random process and properties​

    • Part 1 Cont: (6 videos, ~73 minutes)

      • Topics include: Telegraph random process, PSK random process, Wiener random process (i.e. random walk random process) and properties

    • Part 2: (10 videos, ~106 minutes)

      • Topics include: Markov random processes, Markov Chains, state-transition diagrams, random processes in continuous-time linear systems, input/output relationships for mean and autocorrelation functions, White Noise random process

    • Part 3: (8 videos, ~77 minutes)

      • Topics include: Random process properties, simplified input/output relationships for WSS random processes, the power spectral density (PSD) function, PSD properties, and PSD examples.​

    • Part 4: Additional Classification (4 videos, ~35 minutes)

      • Topics include: Wide-sense periodic random processes, cyclostationary random processes, and PSK power spectral density​

  • Mean Square (MS) Calculus

    • Part 1: Introduction, MS Derivative, and MS Integral

    • Part 2: Ergodicity and the KL Expansion

    • Part 3: Bandpass Random Processes

Example Problems

Practice Problems


File Downloads

yt channel art banner.jpg

© 2020 by Adam Panagos