Information Theory and Error Control Coding - 2017.2



         The objective of the course is to introduce the fundamentals of information theory and error control coding.  The focus is on the concepts and algorithms required in several areas of communications engineering.



Part I: Information Theory

1.   Introduction

2. Source Coding

3. Channel Capacity

4. Channel Coding Theorem

5. Rate-Distortion Theory

Part II: Error Control Coding

1. Introduction

2. Linear Block Codes

3. Cyclic Codes

4. Convolutional Codes

5. Turbo Codes

6. LDPC Codes

7. ARQ Schemes


                The assessment is based on lists of tutorial questions (T), an exam paper (E) and a project (P) . The final grade is given by FG = (P +E+ T)/3.


Tutorial questions:

                Information theory

List 1

List 2

List 3

List 4


                               Error control coding

List 1

List 2

List 3

List 4


Matlab codes:

                                Turbo codes

                                LDPC codes



                                Exam Grades




1.   Cover, T., Thomas, J., Elements of Information Theory, 2nd Ed., Wiley, 2006. 

2.   Moreira, J. C., Farrell, P. G., Essentials of Error-Control Coding, Wiley, 2006.