<< Chapter < Page Chapter >> Page >
x k = arg min x y - Φ Ω x 2 , α ^ t = Φ Ω x t , r t = y - α ^ t .

These steps are repeated until convergence. This is known as Orthogonal Matching Pursuit (OMP)  [link] . Tropp and Gilbert  [link] proved that OMP can be used to recover a sparse signal with high probability using compressive measurements. The algorithm converges in at most K iterations, where K is the sparsity, but requires the added computational cost of orthogonalization at each iteration. Indeed, the total complexity of OMP can be shown to be O ( M N K ) .

While OMP is provably fast and can be shown to lead to exact recovery, the guarantees accompanying OMP for sparse recovery are weaker than those associated with optimization techniques . In particular, the reconstruction guarantees are not uniform , i.e., it cannot be shown that a single measurement matrix with M = C K log N rows can be used to recover every possible K - sparse signal with M = C K log N measurements. (Although it is possible to obtain such uniform guarantees when it is acceptable to take more measurements. For example, see [link] .) Another issue with OMP is robustness to noise; it is unknown whether the solution obtained by OMP will only be perturbed slightly by the addition of a small amount of noise in the measurements. Nevertheless, OMP is an efficient method for CS recovery, especially when the signal sparsity K is low. A pseudocode representation of OMP is shown below.

Inputs: Measurement matrix Φ , signal measurements y Outputs: Sparse representation x ^ Initialize: θ ^ 0 = 0 , r = y , Ω = , i = 0 . while ħalting criterion false do 1. i i + 1 2. b Φ T r {form residual signal estimate} 3. Ω Ω supp ( T ( b , 1 ) ) {add index of residual's largest magnitude entry to signal support} 4. x ^ i | Ω Φ Ω x , x ^ i | Ω C 0 {form signal estimate} 5. r y - Φ x ^ i {update measurement residual} end while return x ^ x ^ i

Stagewise orthogonal matching pursuit (stomp)

Orthogonal Matching Pursuit is ineffective when the signal is not very sparse as the computational cost increases quadratically with the number of nonzeros K . In this setting, Stagewise Orthogonal Matching Pursuit (StOMP)  [link] is a better choice for approximately sparse signals in a large-scale setting.

StOMP offers considerable computational advantages over 1 minimization and Orthogonal Matching Pursuit for large scale problems with sparse solutions. The algorithm starts with an initial residual r 0 = y and calculates the set of all projections Φ T r k - 1 at the k t h stage (as in OMP). However, instead of picking a single dictionary element, it uses a threshold parameter τ to determine the next best set of columns of Φ whose correlations with the current residual exceed τ . The new residual is calculated using a least squares estimate of the signal using this expanded set of columns, just as before.

Unlike OMP, the number of iterations in StOMP is fixed and chosen before hand; S = 10 is recommended in [link] . In general, the complexity of StOMP is O ( K N log N ) , a significant improvement over OMP. However, StOMP does not bring in its wake any reconstruction guarantees. StOMP also has moderate memory requirements compared to OMP where the orthogonalization requires the maintenance of a Cholesky factorization of the dictionary elements.

Questions & Answers

what is demand of supply
music Reply
What is the meaning of supply of labour
Anthonia Reply
what is production?
Elizabeth Reply
Production is basically the creation of goods and services to satisfy human wants
under what condition will demand curve slope upward from left to right instead of normally sloping downward from left to right
Atama Reply
how i can calculate elasticity?
Tewekel Reply
What is real wages
Emmanuella Reply
what are the concept of cost
Tabitha Reply
what is the difference between want and choice
Grace Reply
Want is a desire to have something while choice is the ability to select or choose a perticular good or services you desire to have at a perticular point in time.
substitutes and complements
Amman Reply
Substitute are goods that can replace another good but complements goods that can be combined together
account for persistent increase in lnflation
niwahereza Reply
what is opportunity cost
Adebowale Reply
opportunity cost reffered to as alternative foregone when choice is made
government measures to control inflation?
Formu Reply
control populationk growth rate by using family planning to reduce faster increase of people than job creation
how do we calculate the firm's profit maximizing output in the short run given marginal cost ,average cost and average variable costs?
Nomuhle Reply
what is employment?
Ahmarh Reply
what is meant by broadening the tax base?
Fiona Reply
A soccer field is a rectangle 130 meters wide and 110 meters long. The coach asks players to run from one corner to the other corner diagonally across. What is that distance, to the nearest tenths place.
Kimberly Reply
Jeannette has $5 and $10 bills in her wallet. The number of fives is three more than six times the number of tens. Let t represent the number of tens. Write an expression for the number of fives.
August Reply
What is the expressiin for seven less than four times the number of nickels
Leonardo Reply
How do i figure this problem out.
how do you translate this in Algebraic Expressions
linda Reply
why surface tension is zero at critical temperature
I think if critical temperature denote high temperature then a liquid stats boils that time the water stats to evaporate so some moles of h2o to up and due to high temp the bonding break they have low density so it can be a reason
Need to simplify the expresin. 3/7 (x+y)-1/7 (x-1)=
Crystal Reply
. After 3 months on a diet, Lisa had lost 12% of her original weight. She lost 21 pounds. What was Lisa's original weight?
Chris Reply
Researchers demonstrated that the hippocampus functions in memory processing by creating lesions in the hippocampi of rats, which resulted in ________.
Mapo Reply
The formulation of new memories is sometimes called ________, and the process of bringing up old memories is called ________.
Mapo Reply
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now

Source:  OpenStax, An introduction to compressive sensing. OpenStax CNX. Apr 02, 2011 Download for free at http://legacy.cnx.org/content/col11133/1.5
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'An introduction to compressive sensing' conversation and receive update notifications?