ECE 503

Probability and Random Processes for Engineering Applications
Fall and Spring
Catalog Data: 

ECE 503 - Probability and Random Processes for Engineering Applications

Credits: 3.00

Course Assessment:

Homework: 8-10 assignments

Exams: 2 midterm exams, 1 comprehensive final exam

Typical grading policy: 10% homework, 30% exam 1, 30% exam 2, 30% final exam

Course summary: Probability, random variables, stochastic processes, correlation functions and spectra with applications to communications, control and computers.

SIE 230 or equivalent

Papoulis, A., and S.U. Pillai. Probability, Random Variables and Stochastic Processes. 4th ed. McGraw-Hill, 2002. (Other editions acceptable)

Course Topics: 

1.    Brief overview of logic/proof techniques

2.    Probability space: sample space, sigma field, probability measure

3.    Conditional probability

4.    Total probability

5.    Bayes

6.    Independence

7.    Cartesian (combined) experiments

8.    One random variable

a. Definition

b. Distribution/density

c. Conditional distributions/densities

d. Total prob/bayes

e. Conditioning on zero probability events

9.    Functions of one RV

a. Distributions/densities

10. Expectation

a. Moments

b. Characteristic functions

c. Moment generating function

11. Two random variables

a. Distribution/density

b. Joint/marginal

c. Independence

d. One function of two RVs

e. Two functions of two RVs

f. Moments

g. Covariance/correlation/orthogonal

h. Joint characteristic functions

i. Conditional distributions/moments

j. Min MSE estimation

12. N random variables

a. Distribution/density

b. Independence

c. N functions of N RVs

d. Covariance/correlation matrix

e. Characteristic function

13. Convergence of random sequences

a. Everywhere, almost everywhere, in probability, in MSE, in distribution

b. Weak law of large numbers

c. Central limit theorem

14. Random processes

a. Definition, interpretation, examples

b. 1st order, 2nd order, nth order, strict sense, wide sense

c. Moments-mean, variance, covariance, correlation

d. Properties

15. Stationary: 1st order, 2nd order, nth order, strict sense, wide sense

16. Transformations of processes (focus on linear time invariant filter)

a. Covariance/cross covariance input/output

b. Power spectral density

c. Average power

17. Poisson process

a. Poisson points

b. Time to first point (exponential)

c. Time to nth point (Erlang)

d. Time between points (exponential)

18. Ergodicity

a. Mean ergordic

b. Covariance ergodic

19. Markov processes

a. Definition

b. Focus on discrete time

c. Transition probabilities

d. State occupancy probabilities

e. Homogeneous (time-invariant)

f. Transition diagram

g. Transition matrix

h. Irreducible

i. Aperiodic

j. Stationary distribution


Class/Laboratory Schedule: 

One 150-minute lecture per week

Prepared by: 
Michael Marcellin
Prepared Date: 
April 2013

University of Arizona College of Engineering