Course Title : Information and Coding Theory

Code 91290
Course Year 2nd year
Class day & Period
Credits 2
Restriction No Restriction
Lecture Form(s) Lecture
Language Japanese
Instructor Prof. Toyoaki Nishida, Graduate School of Informatics

Course Description

This course introduces information theory, an foundation for reliable information transmission and storage. We elaborate on source and channel models, source and channel coding, quantitative measure of information and entropy, and coding theory.


Credit will be awarded based on a final written examination and one or more mini-tests.

Course Goals

Students will be able to understand and apply basic concepts and principles of information theory.

Course Topics

Theme Class number of times Description
Introduction 1 I briefly overview the history, goal, techniques and applications of information theory.
Source Coding and its Limitation 5 I introduce source coding, Markov sources, the source coding theorem, and entropy of information source.
Channel Coding and its Limitation 4 I elaborate on mutual information and entropy, channel capacity, maximum likelihood decoding, random coding, and the channel coding theorem.
Coding Theory 4 Following a general introduction to coding theory, I describe parity codes, Hamming codes, cyclic codes, and BCH codes.
Feedback 1 I will answer questions arising from the lecture and advise on further learning.


Hideki Imai: Information Theory, Shokodo (in Japanese)



Web Sites

Additional Information