ECE 612 - Information Theory
Instructor
Professor Amir Khandani
Description
The objective of this course is to explain the fundamental concepts of information theory focusing on problems in communications (efficient signal representation and reliable transmission). Specifically, we will discuss topics in source/channel coding, and networking. Along with a theoretical approach, a goal of the course is to clarify the practical issues behind the corresponding theory.
Some specific topics to be covered are as follows:
-
Introduction:
- Basic definitions
- Asymptotic Equipartition Property (AEP)
- Analysis of Markovian sources and related coding issues
-
Coding
for
source
representation:
- Constrained coding for noiseless channels
- Huffman coding
- Channel capacity, Random coding, Source/Channel coding theorems, Gaussian channel.
-
Network
information
theory:
- Multiple access channel
- Broadcast channel
- Rate distortion theory.
References
T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
R. G. Gallager, Information Theory and Reliable Communication, Wiley, New York 1968.
J. M. Wozencraft and I. M. Jacobs, Principles of Communication Engineering, Wiley, 1965.
R. E. Blahut, Principles and Practice of Information Theory, Addison Wesley, 1987.
Also see the course website.
Course evaluation
A set of assignments, mid-term and final.