Shannon-Fano coding

Vicente González Ruiz

December 31, 2019

Contents

1 History
2 Encoder
 2.1 Example
 2.2 Decoder
References

1 History

2 Encoder

  1. Sort the symbols using their probabilities.
  2. Split the set of symbols into two subsets in a way in which the each subset have the same total probability.
  3. Assign a different bit to each set.
  4. Repeat the previous procedure to each subset until each subset has only one symbol.

2.1 Example

Using it, this is the Shannon-Fano coding:

2.2 Decoder

TO-DO.

References

[1]   Robert M. Fano. The transmission of information. Massachusetts Institute of Technology, Research Laboratory of Electronics, 1949.

[2]   Claude Elwood Shannon. A mathematical theory of communication. Bell system technical journal, 27(3):379–423, 1948.