Information Theory and Coding Question Paper - Dec 17 - Electronics And Communication Engineering (Semester 5) - Visvesvaraya Technological University (VTU)

31views

written 4.9 years ago by

Information Theory and Coding - Dec 17

Electronics And Communication Engineering (Semester 5)

Total marks: 80
Total time: 3 Hours INSTRUCTIONS
(1) Question 1 is compulsory.
(2) Attempt any three from the remaining questions.
(3) Draw neat diagrams wherever necessary.

Module-1

1.a. Drive an expression for average information content of symbols in long independent sequence.

(3 marks) 00

1.b. For the markov source shown below find i) The stationary distribution ii) State entropies iii)Source entropy iv) G1 G2 and show that G1≥G2≥H(s).![enter image description here][1]

(10 marks) 00

1.c. Define self Information, Entropy and Information rate.

(3 marks) 00

2.a. mention different properties of entropy and prove external property.

(7 marks) 00

2.b. A source emits one of four symbols S1,S2,S3,S4 with probabilities of 7/16, 5/16, 1/8 & 1/8 . Show that H(S²)=2H(S).

(4 marks) 00

2.c. In a facsimile transmission of a picture, there are about 2.25

(5 marks) 00

ADD COMMENT EDIT