แผนการสอน Information Theory

204552 Information Theory and Coding

Prerequisite	None
Schedule	Tuesday 13-16; Section 11 (Room 501)
Instructors	Associate Professor Dr.Punpiti Piamsa-nga (pp@ku.ac.th)
Course Description	Mathematical model for information channel and sources, algebraic theory of cyclic codes, error-control procedures and circuits, and application of computer and data transmission systems.
Grading	Midterm (40  %)  Final (50 %)  Class participation (10%)
	Score<40 F 40< Score ≤49 D 50< Score ≤54 D+ 55< Score ≤64 C 65< Score ≤69 C+ 70< Score ≤74 B 75< Score ≤79 B+ Score > 80 A
Textbook	Thomas M. Cover, Joy A. Thomas, Elements of Information Theory, 2nd Edition ISBN: 978-0-471-24195-9, 776 pages July 2006, ©2006 (Required) Escolano Ruiz, Francisco, Suau Pérez, Pablo, Bonev, Boyán Ivanov, Information Theory in Computer Vision and Pattern Recognition 2nd Printing., 2009, XVIII, 394 p.  ISBN: 978-1-84882-296-2
Readings	Research papers distributed in class

 

Schedule

#	Date	Lectures
1	Nov 2	Entropy, Relative Entropy, and Mutual Information
2	Nov 9	Asymptotic Equipartition Property
3	Nov 16	Entropy Rates of a Stochastic Process
4	Nov 23	Data Compression
5	Nov 30	Gambling and Data Compression
6	Dec 7	Channel Capacity
7	Dec 14	Differential Entropy
	Dec 21	Midterm
8	Dec28	Gaussian Channel
9	Jan 4	Rate Distortion Theory
10	Jan 11	Information Theory and Statistics
11	Jan 25	Maximum Entropy
12	Feb 1	Universal Source Coding (Kaset Fair Week)
13	Feb 8	Kolmogorov Complexity
14	Feb 15	Network Information Theory
15	Feb 22	Information Theory and Portfolio Theory