720*90

Custom Search

Sem 7 - INFORMATION THEORY AND CODING

Module 1
Information theory – Concept of amount of information -units, Entropy -marginal, conditional and joint entropies -relation among entropies Mutual information, information rate, channel capacity, redundancy and efficiency of channels.
Module 2
Discrete channels – Symmetric channels, Binary Symmetric Channel, Binary Erasure Channel, Cascaded channels, repetition of symbols, Binary unsymmetric channel, Shannon theorem. Continuous channels – Capacity of band limited Gaussian channels, Shannon-Hartley theorem, Trade off between band width and signal to noise ratio, Capacity of a channel with infinite band width, Optimum modulation system.
Module 3
Source coding – Encoding techniques, Purpose of encoding, Instantaneous codes, Construction of instantaneous codes, Kraft’s inequality, Coding efficiency and redundancy, Noiseless coding theorem. Construction of basic source codes – Shannon-Fano algorithm, Huffman coding, Arithmetic coding, ZIP coding.
Module 4
Codes for error detection and correction – Parity check coding, Linear block codes, Error detecting and correcting capabilities, Generator and Parity check matrices, Standard array and Syndrome decoding, Hamming codes, Encoding and decoding of systematic and unsystematic codes. Cyclic codes – Generator polynomial, Generator and Parity check matrices, Encoding of cyclic codes, Syndrome computation and error detection, Decoding of cyclic codes, BCH codes, RS codes, Burst error correction.
Module 5
Convolutional codes – Encoding- State, Tree and Trellis diagrams, Maximum likelihood decoding of convolutional codes -Viterby algorithm, Sequential decoding -Stack algorithm. Interleaving techniques – Block and convolutional interleaving, Coding and interleaving applied to CD digital audio system -CIRC encoding and decoding, interpolation and muting. ARQ – Types of ARQ, Performance of ARQ, Probability of error and throughput.
mgu university b.tech syllabus electronics
References
1. Communication Systems  Simon Haykin, John Wiley & Sons. Pvt. Ltd.
2. Principles of Communication Systems  Taub & Schilling, Tata McGraw-Hill
3. Principles of Digital Communication Das, Mullick & Chatterjee, Wiley Eastern Ltd.
4. Error Control Coding Fundamentals and Applications Shu Lin & Daniel J. Costello Jr., Prentice Hall Inc.
5. Digital Communications Fundamentals and Applications Bernard Sklar, Person Education Asia