<< Chapter < Page Chapter >> Page >
This module introduces practical entropy coding techniques, such as Huffman Coding, Run-length Coding (RLC) and Arithmetic Coding.

In the module of Use of Laplacian PDFs in Image Compression we have assumed that ideal entropy coding has been used in order to calculate the bitrates for the coded data. In practise we must use real codes and we shall now see how this affects the compression performance.

There are three main techniques for achieving entropy coding:

  • Huffman Coding - one of the simplest variable length coding schemes.
  • Run-length Coding (RLC) - very useful for binary data containing long runs of ones of zeros.
  • Arithmetic Coding - a relatively new variable length coding scheme that can combine the best features ofHuffman and run-length coding, and also adapt to data with non-stationary statistics.
We shall concentrate on the Huffman and RLC methods for simplicity. Interested readers may find out more aboutArithmetic Coding in chapters 12 and 13 of the JPEG Book.

First we consider the change in compression performance if simple Huffman Coding is used to code the subimages of the4-level Haar transform.

The calculation of entropy in this equation from our discussion of entropy assumed that each message with probability p i could be represented by a word of length i 2 logbase --> p i bits. Huffman codes require the i to be integers and assume that the p i are adjusted to become:

p i ^ 2 i
where the i are integers, chosen subject to the constraint that i p i ^ 1 (to guarantee that sufficient uniquely decodable code words are available) and such that the mean Huffman word length(Huffman entropy), H ^ i p i i , is minimised.

We can use the probability histograms which generated the entropy plots in figures of level 1 energies , level 2 energies , level 3 energies and level 4 energies to calculate the Huffman entropies H ^ for each subimage and compare these with the true entropies to see the loss in performance caused by using realHuffman codes.

An algorithm for finding the optimum codesizes i is recommended in the JPEG specification [ the JPEG Book , Appendix A, Annex K.2, fig K.1]; and a Mathlab M-file toimplement it is given in M-file code .

Comparison of entropies (columns 1, 3, 5) and Huffman coded bit rates (columns 2, 4, 6) for the original (columns 1 and2) and transformed (columns 3 to 6) Lenna images. In columns 5 and 6, the zero amplitude state is run-length encoded toproduce many states with probabilities<0.5.
Numerical results used in the figure - entropies and bit rates of subimages for qstep=15
Column: 1 2 3 4 5 6 -
0.0264 0.0265 0.0264 0.0266
0.0220 0.0222 0.0221 0.0221 Level 4
0.0186 0.0187 0.0185 0.0186
0.0171 0.0172 0.0171 0.0173 -
0.0706 0.0713 0.0701 0.0705
0.0556 0.0561 0.0557 0.0560 Level 3
3.7106 3.7676 0.0476 0.0482 0.0466 0.0471 -
0.1872 0.1897 0.1785 0.1796
0.1389 0.1413 0.1340 0.1353 Level 2
0.1096 0.1170 0.1038 0.1048 -
0.4269 0.4566 0.3739 0.3762
0.2886 0.3634 0.2691 0.2702 Level 1
0.2012 0.3143 0.1819 0.1828 -
Totals: 3.7106 3.7676 1.6103 1.8425 1.4977 1.5071

shows the results of applying this algorithm to the probability histograms and lists the same results numerically for ease of analysis. Columns 1 and 2 compare theideal entropy with the mean word length or bit rate from using a Huffman code (the Huffman entropy) for the case of theuntransformed image where the original pels are quantized with Q step 15 . We see that the increase in bit rate from using the real code is: 3.7676 3.7106 1 1.5 % But when we do the same for the 4-level transformed subimages, we get columns 3 and 4. Here we see thatreal Huffman codes require an increase in bit rate of: 1.8425 1.6103 1 14.4 % Comparing the results for each subimage in columns 3 and 4, wesee that most of the increase in bit rate arises in the three level-1 subimages at the bottom of the columns. This is becauseeach of the probability histograms for these subimages (see figure ) contain one probability that is greater than 0.5. Huffman codes cannot allocate a word length ofless than 1 bit to a given event, and so they start to lose efficiency rapidly when 2 logbase --> p i becomes less than 1, ie when p i 0.5 .

Questions & Answers

why does it makes sense to let the sewage disposal company in your town have a monopoly?
Janice Reply
how might a monopoly affect price?
how might a monopoly affect prices?
The principle of Economic is one to be involved in any economic buying substance
Anastassiya Reply
what are the principle of economics?
oche Reply
What is (Qs)
Bigi Reply
What is (Qs) and (Qd)
Quantity of supply and Quantity of demand
Qs: Is quantity of supply and Qd: quantity of demand
give as me quantitys
among all the definition of economics which of the definition is generally acceptable?
i science that studies human behavior as a relationship between ends and scarcity that have alternative uses
what are the principle of economics?
what Make things scarce
Soudani Reply
why do we studied economic
for the stability and growth of any reign.
what is macro economics.?
which part of economics is interesting..
how does economics define me
clement Reply
what are the factors that determines the demand and supply
what are the importance of Economics
Betty Reply
tell me something very important about economics..
Fayaz Reply
how may I solve arithmetic mean ,,,all example
Cee Reply
what is agriculture
Itoe Reply
simple method of understanding cost concept
Oludare Reply
what is inflation
Christiana Reply
Inflation is a general increase in price levels
is the action of inflating something
inflation is the persistent increase in general price level of goods and services in an economy over a considerable period of time .
inflation is the general increase of a commodity in a particular period of time.
inflation is a general increase in price levels of commodities
what are the types of inflation?
inflation is the period of persistent rise in the general level of the price of goods services over time
we have creeping inflation, demand pull inflation ,cost push inflation, and galloping inflation .
I s Nigeria in any kind of in inflation? If yes which kind?
please can someone help me with the principles of economic?
and u
no discassion just question
what is science and art economic
how can a location of a firm create difference between producers
joy Reply
what is monetary policy
is a monetary from policy that's authorized of country encharces
What would you say about the the mobility of enterprise as a factor of production?
Cathryn Reply
how can I connect myself to this Ambrose platform
kanu Reply
in a comparison of the stages of meiosis to the stage of mitosis, which stages are unique to meiosis and which stages have the same event in botg meiosis and mitosis
Leah Reply
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get the best Algebra and trigonometry course in your pocket!

Source:  OpenStax, Image coding. OpenStax CNX. Jan 22, 2004 Download for free at http://cnx.org/content/col10206/1.3
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Image coding' conversation and receive update notifications?