<< Chapter < Page Chapter >> Page >

Manifold models

Manifold models generalize the conciseness of sparsity-based signal models. In particular, in many situations where a signal isbelieved to have a concise description or “few degrees of freedom,” the result is that the signal will live on or near aparticular submanifold of the ambient signal space.

Parametric models

We begin with an abstract motivation for the manifold perspective. Consider a signal f (such as a natural image), and suppose that we can identify some single 1-D piece of information about thatsignal that could be variable; that is, other signals might rightly be called “similar” to f if they differ only in this piece of information. (For example, this 1-D parameter coulddenote the distance from some object in an image to the camera.) We let θ denote the variable parameter and write the signal as f θ to denote its dependence on θ . In a sense, θ is a single “degree of freedom” driving the generation of the signal f θ under this simple model. We let Θ denote the set of possible values of the parameter θ . If the mapping between θ and f θ is well-behaved, then thecollection of signals { f θ : θ Θ } forms a 1-D path in the ambient signal space.

More generally, when a signal has K degrees of freedom, we may model it as depending on some parameter θ that is chosen from a K -dimensional manifold Θ . (The parameter space Θ could be, for example, a subset of R K , or it could be a more general manifold such as SO(3).) We again let f θ denote the signal corresponding to a particular choice of θ , and we let F = { f θ : θ Θ } . Assuming the mapping f is continuous and injective over Θ (and its inverse is continuous), then by virtue of the manifold structure of Θ , its image F will correspond to a K -dimensional manifold embedded in the ambient signal space (see [link] (c)).

These types of parametric models arise in a number of scenarios in signal processing. Examples include: signals of unknowntranslation, sinusoids of unknown frequency (across a continuum of possibilities), linear radar chirps described by a starting andending time and frequency, tomographic or light field images with articulated camera positions, robotic systems with few physicaldegrees of freedom, dynamical systems with low-dimensional attractors  [link] , [link] , and so on.

In general, parametric signals manifolds are nonlinear (by which we mean non-affine as well); this can again be seen byconsidering the sum of two signals f θ 0 + f θ 1 . In many interesting situations, signal manifolds are non-differentiable as well.

Nonparametric models

Manifolds have also been used to model signals for which there is no known parametric model. Examples include images of faces andhandwritten digits [link] , [link] , which have been found empirically to cluster near low-dimensional manifolds.Intuitively, because of the configurations of human joints and muscles, it may be conceivable that there are relatively “few”degrees of freedom driving the appearance of a human face or the style of handwriting; however, this inclination is difficult orimpossible to make precise. Nonetheless, certain applications in face and handwriting recognition have benefitted from algorithmsdesigned to discover and exploit the nonlinear manifold-like structure of signal collections. Manifold Learning from Dimensionality Reduction discusses such methods for learning parametrizations and other information from data livingalong manifolds.

Much more generally, one may consider, for example, the set of all natural images. Clearly, this set has small volume with respect to the ambient signal space — generating an imagerandomly pixel-by-pixel will almost certainly produce an unnatural noise-like image. Again, it is conceivable that, at least locally,this set may have a low-dimensional manifold-like structure: from a given image, one may be able to identify only a limited numberof meaningful changes that could be performed while still preserving the natural look to the image. Arguably, most work insignal modeling could be interpreted in some way as a search for this overall structure.

Questions & Answers

What is demand
TECK Reply
the amount of a good that buyers are willing and able to purchase
what is population
Amadou Reply
The people living within a political or geographical boundary.
what happens to price and quantity when demand curves shift to the right
Asha Reply
price level goes up. quantity demand increases
example- inferior goods
demand law
Its states that higher the price the of the commodity, and lower the quantity demanded
I am confused but quantity demand will increase.
No. That's the law of supply
what happens to price and quantity when supply curve shifts left?
Asha Reply
price level will increase
quantity demand will decrease
what is inflation
Pop Reply
inflation is a general and ongoing rise in the level of prices in an entire economy.
is the pasistance increase in the price of a country economy
how does inflation affects the economy of a country? what is deflation?
deflation can simply be define as the persistence decrease in price of a countrys economy
the revenge of malthus relates "revenge" with "commodity prices". collect data for 3 commodoties and check their price evolution
Jamshi Reply
what is elasticity
dubela Reply
Elasticity is an economics concept that measures responsiveness of one variable to changes in another variable.
Computer software represents
Mboledi Reply
पर्यावरण राज्यों में से किस राज्य में शिष्य शिक्षक अनुपात 30 से अधिक वाले विद्यालयों का प्रतिशत न्यूनतम होता है
plz Reply
Hey what are you trying to mean?
what is Asset
like a banana
demand is the process whereby consumers are willing and able to purchase a particular product at various price over a given period of time
Samuel Reply
The law of dinimish
Frank Reply
What is the law of dinimish
What is the law of dinimish
What is the law of dinimish
opportunity cost is to forgo something for another.
jackie Reply
what is financial market
Asheeru Reply
what is demand
Levinel Reply
Demand is an economic principle referring to a consumer's desire to purchase goods and services and willingness to pay a price for a specific good or service.
explain any three exceptions to the law of demand
Emma Reply
Difference between extinct and extici spicies
Amanpreet Reply
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get the best Algebra and trigonometry course in your pocket!

Source:  OpenStax, Concise signal models. OpenStax CNX. Sep 14, 2009 Download for free at http://cnx.org/content/col10635/1.4
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Concise signal models' conversation and receive update notifications?