<< Chapter < Page Chapter >> Page >
A description of the Huffman source encoding algorithm.

One particular source coding algorithm is the Huffman encoding algorithm. It is a source coding algorithm which approaches, and sometimes achieves, Shannon's bound forsource compression. A brief discussion of the algorithm is also given in another module .

Huffman encoding algorithm

  • Sort source outputs in decreasing order of their probabilities
  • Merge the two least-probable outputs into a single output whose probability is the sum of the corresponding probabilities.
  • If the number of remaining outputs is more than 2, then go to step 1.
  • Arbitrarily assign 0 and 1 as codewords for the two remaining outputs.
  • If an output is the result of the merger of two outputs in a preceding step, append the current codeword with a 0 and a 1 toobtain the codeword the the preceding outputs and repeat step 5. If no output is preceded by another output in a preceding step, thenstop.

X A B C D with probabilities { 1 2 , 1 4 , 1 8 , 1 8 }

Average length 1 2 1 1 4 2 1 8 3 1 8 3 14 8 . As you may recall, the entropy of the source was also H X 14 8 . In this case, the Huffman code achieves the lower bound of 14 8 bits output .

Got questions? Get instant answers now!

In general, we can define average code length as

x x X p X x x
where X is the set of possible values of x .

It is not very hard to show that

H X H X 1
For compressing single source output at a time, Huffman codes provide nearly optimum code lengths.

The drawbacks of Huffman coding

  • Codes are variable length.
  • The algorithm requires the knowledge of the probabilities, p X x for all x X .
Another powerful source coder that does not have the aboveshortcomings is Lempel and Ziv.

Questions & Answers

what is biology
Hajah Reply
the study of living organisms and their interactions with one another and their environments
AI-Robot
what is biology
Victoria Reply
HOW CAN MAN ORGAN FUNCTION
Alfred Reply
the diagram of the digestive system
Assiatu Reply
allimentary cannel
Ogenrwot
How does twins formed
William Reply
They formed in two ways first when one sperm and one egg are splited by mitosis or two sperm and two eggs join together
Oluwatobi
what is genetics
Josephine Reply
Genetics is the study of heredity
Misack
how does twins formed?
Misack
What is manual
Hassan Reply
discuss biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles
Joseph Reply
what is biology
Yousuf Reply
the study of living organisms and their interactions with one another and their environment.
Wine
discuss the biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles in an essay form
Joseph Reply
what is the blood cells
Shaker Reply
list any five characteristics of the blood cells
Shaker
lack electricity and its more savely than electronic microscope because its naturally by using of light
Abdullahi Reply
advantage of electronic microscope is easily and clearly while disadvantage is dangerous because its electronic. advantage of light microscope is savely and naturally by sun while disadvantage is not easily,means its not sharp and not clear
Abdullahi
cell theory state that every organisms composed of one or more cell,cell is the basic unit of life
Abdullahi
is like gone fail us
DENG
cells is the basic structure and functions of all living things
Ramadan
What is classification
ISCONT Reply
is organisms that are similar into groups called tara
Yamosa
in what situation (s) would be the use of a scanning electron microscope be ideal and why?
Kenna Reply
A scanning electron microscope (SEM) is ideal for situations requiring high-resolution imaging of surfaces. It is commonly used in materials science, biology, and geology to examine the topography and composition of samples at a nanoscale level. SEM is particularly useful for studying fine details,
Hilary
cell is the building block of life.
Condoleezza Reply
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Information and signal theory. OpenStax CNX. Aug 03, 2006 Download for free at http://legacy.cnx.org/content/col10211/1.19
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Information and signal theory' conversation and receive update notifications?

Ask