<< Chapter < Page Chapter >> Page >

Suppose f is piecewise Lipschitz and f k ia a piecewise constant.

| f ( t ) - f k ( t ) | Δ

where Δ is a constant equal to average of f on right and left side of discontinuity in this interval.

| | f - f k | | L 2 2 = O ( k - 1 )

where k - 1 is the width of the interval. Notice this rate is quite slow.

This problem naturally suggests the following remedy: use very small intervals near discontinuities and larger intervals insmooth regions. Specifically, suppose we use intervals of width k - 2 α to contain the discontinuities and the intervals ofwidth k - 1 elsewhere. Then accordingly piecewise polynomial approximation f ˜ k satisfies

| | f - f ˜ k | | L 2 2 = O ( k - 2 α ) .

We can accomplish this need for "adaptive resolution" or "multiresolution" using recursive partitions and trees.

Recursive dyadic partitions

We discussed this idea already in our examination of classification trees. Here is the basic idea again, graphically.

Complete and pruned RDP along with their correspnding tree structures.

Consider a function f B α ( C α ) that contains no more than m points of discontinuity, and is H α ( C α ) away from these points.

Lemma

Consider a complete RDP with n intervals, then there exists anassociated pruned RDP with O ( k l o g n ) intervals, such that an associated piecewise degree α polynomial approximation ( ˜ f ) k , has a squared approximation error of O ( m i n ( k - 2 α , n - 1 ) ) .

Assume n > k > m . Divide [ 0 , 1 ] into k intervals. If f is smooth on a particular interval I , then

| f ( t ) - f ˜ k ( t ) | = O ( k - 2 α ) t I .

In intervals that contain a discontinuity, recursively subdivide into two until the discontinuity is contained in an interval ofwidth n - 1 . This process results in at most l o g 2 n addition subintervals per discontinuity, and the squared approximationerror is O ( k - 2 α ) on all of them accept the m intervals of width n - 1 containing the discontinuities where the error is O ( 1 ) at each point.

Thus, the overall squared L 2 norm is

| | f - f ˜ k | | L 2 2 = O ( m i n ( k - 2 α , n - 1 ) )

and there are at most k + l o g 2 n intervals in the partition. Since k>m, we can upperbound the number of intervals by 2 k l o g 2 n .

Note that if the initial complete RDP has n k 2 α intervals, then the squared error is O ( k - 2 α ) .

Thus, we only incur a factor of 2 α l o g k additional leafs and achieve the same overall approximation error as in the H α ( C α ) case. We will see that this is a small price to pay in order to handle not only smooth functions, but alsopiecewise smooth functions.

Wavelet approximations

Let f L 2 ( [ 0 , 1 ] ) ; f 2 ( t ) d t < .

A wavelet approximation is a series of the form

f = c o + j 0 k = 1 2 j < f , ψ j , k > ψ j , k

where c o is a constant ( c o = 0 1 f ( t ) d t ) ,

< f , ψ j , k > = 0 1 f ( t ) ψ j , k ( t ) d t

and the basis functions ψ j , k are orthonormal, oscillatory signals, each with an associated scale 2 - j and position k 2 - j . ψ j , k is called the wavelet at scale 2 - j and position k 2 - j .

Haar wavelets

ψ j , k ( t ) = 2 j / 2 ( 1 { t [ 2 - j ( k - 1 ) , 2 - j ( k - 1 / 2 ) ] } - 1 { t [ 2 - j ( k - 1 / 2 ) , 2 - j k ] } )
Haar Wavelet
0 1 ψ j , k ( t ) d t = 0
0 1 ψ j , k 2 ( t ) d t = ( k - 1 ) 2 - j k 2 - j 2 j d t = 1
0 1 ψ j , k ( t ) ψ l , m ( t ) d t = δ j , l . δ k , m
If f is constant on [ 2 - j ( k - 1 ) , 2 - j k ] , then
f ψ j , k ( t ) = 0 .

Suppose f is piecewise constant with at most m discontinuities. Let

f J = c o + j = 0 J - 1 k = 1 2 j < f , ψ j , k > ψ j , k .

Then, f J has at most m J non-zero wavelet coefficients; i.e., < f , ψ j , k > = 0 for all but m J terms, since at most one Haar Wavelet at each scale senses each point of discontinuity. Said another way, allbut at most m of the wavelets at each scale have support over constant regions of f .

f J itself will be piecewise constant with discontinuities only possible occurring at end points of the intervals [ 2 - J ( k - 1 ) , 2 - J k ] . Therefore, in this case

| | f - f J | | L 2 2 = O ( 2 - J ) .

Daubechies wavelets are the extension of the Haar wavelet idea. Haar wavelets have one "vanishing moment":

0 1 ψ j , k = 0 .

Daubechies wavelets are "smoother" basis functions with extra vanishing moments. The Daubechies- N wavelet has N vanishing moments.

0 1 t l ψ j , k d t = 0 f o r l = 0 , 1 , . . . , N - 1 .

The Daubechies-1 wavelet is just the Haar case.

If f is a piecewise degree N polynomial with at most m pieces, then using the Daubechies- N wavelet system.

| | f - f J | | L 2 2 = O ( 2 - J ) ;

and

f J ( t ) = c o + j = 0 J - 1 k = 1 2 j < f , ψ j , k > ψ j , k ( t )

has at most O ( m J ) non-zero wavelet coefficients. f J is called the Discrete Wavelet Transform (DWT) approximation of f . The key idea is the same as we saw with trees.

Sampled data

We can also use DWT's to analyze and represent discrete, sampled functions. Suppose,

f ̲ = [ f ( 1 / n ) , f ( 2 / n ) , . . . , f ( n / n ) ]

then we can write f ̲ as

f ̲ = c o + j = 0 l o g 2 n - 1 k = 1 2 j < f ̲ , ψ ̲ j , k > ψ ̲ j , k

where

ψ ̲ j , k = [ ψ j , k ( 1 ) , ψ j , k ( 2 ) , . . . , ψ j , k ( n ) ]

is a discrete time analog of the continuous time wavelets we considered before. In particular,

i = 1 n i l ψ j , k ( i ) = 0 , l = 0 , 1 , . . . , N - 1

for the Daubechies- N discrete wavelets.

< f ̲ , ψ ̲ j , k > = f ̲ T ψ ̲ j , k

Thus, we also have an analogous approximation result: If f ̲ are samples from a piecewise degree N polynomial function with a finite number m of discontinuities, then f ̲ has O ( m J ) non-zero wavelet coefficients.

ApproximatingFunctions with wavelets

Suppose f B α ( C α ) and has a finite number of discontinuities. Let f p denote piecewise degree- N ( N = α ) polynomial approximation to f with O ( k ) pieces; a uniform partition into k equal length intervals followed by addition splits at the points of discontinuity.

Then

| f ( t ) - f p ( t ) | 2 = O ( k ( - 2 α ) ) t [ 0 , 1 ]
| f ( i / n ) - f p ( i / n ) | 2 = O ( k - 2 α ) i = 1 , . . . , n
1 / n | | f ̲ - f ̲ p | | L 2 2 = O ( k - 2 α ) )

and f ̲ p has O ( k l o g 2 n ) non-zero coefficients according to our previous analysis.

Wavelets in 2-d

Suppose f is a 2-D image that is piecewise polynomial:

A pruned RDP of k squares decorated with polyfits gives

| | f - f k | | L 2 2 = O ( k - 1 ) .

Let f ̲ = [ f ( i / k , j / k ) i , j = 1 n sample range.

f n ( t ) = i , j = 1 k f ( i / k , j / k k ) 1 { t [ i - 1 / k , i / k ) x [ j - 1 / k , j / k ) }

then

| | f - f n | | L 2 2 = O ( k - 1 )

O ( 1 ) error on k of the k 2 pixels, near zero elsewhere. The DWT of f ̲ has O ( k ) non-zero wavelet coefficients. O ( 2 j ) at scale 2 - j , j = 0 , 1 , . . . , l o g n .

Questions & Answers

show that the set of all natural number form semi group under the composition of addition
Nikhil Reply
what is the meaning
Dominic
explain and give four Example hyperbolic function
Lukman Reply
_3_2_1
felecia
⅗ ⅔½
felecia
_½+⅔-¾
felecia
The denominator of a certain fraction is 9 more than the numerator. If 6 is added to both terms of the fraction, the value of the fraction becomes 2/3. Find the original fraction. 2. The sum of the least and greatest of 3 consecutive integers is 60. What are the valu
SABAL Reply
1. x + 6 2 -------------- = _ x + 9 + 6 3 x + 6 3 ----------- x -- (cross multiply) x + 15 2 3(x + 6) = 2(x + 15) 3x + 18 = 2x + 30 (-2x from both) x + 18 = 30 (-18 from both) x = 12 Test: 12 + 6 18 2 -------------- = --- = --- 12 + 9 + 6 27 3
Pawel
2. (x) + (x + 2) = 60 2x + 2 = 60 2x = 58 x = 29 29, 30, & 31
Pawel
ok
Ifeanyi
on number 2 question How did you got 2x +2
Ifeanyi
combine like terms. x + x + 2 is same as 2x + 2
Pawel
x*x=2
felecia
2+2x=
felecia
×/×+9+6/1
Debbie
Q2 x+(x+2)+(x+4)=60 3x+6=60 3x+6-6=60-6 3x=54 3x/3=54/3 x=18 :. The numbers are 18,20 and 22
Naagmenkoma
Mark and Don are planning to sell each of their marble collections at a garage sale. If Don has 1 more than 3 times the number of marbles Mark has, how many does each boy have to sell if the total number of marbles is 113?
mariel Reply
Mark = x,. Don = 3x + 1 x + 3x + 1 = 113 4x = 112, x = 28 Mark = 28, Don = 85, 28 + 85 = 113
Pawel
how do I set up the problem?
Harshika Reply
what is a solution set?
Harshika
find the subring of gaussian integers?
Rofiqul
hello, I am happy to help!
Shirley Reply
please can go further on polynomials quadratic
Abdullahi
hi mam
Mark
I need quadratic equation link to Alpa Beta
Abdullahi Reply
find the value of 2x=32
Felix Reply
divide by 2 on each side of the equal sign to solve for x
corri
X=16
Michael
Want to review on complex number 1.What are complex number 2.How to solve complex number problems.
Beyan
yes i wantt to review
Mark
16
Makan
x=16
Makan
use the y -intercept and slope to sketch the graph of the equation y=6x
Only Reply
how do we prove the quadratic formular
Seidu Reply
please help me prove quadratic formula
Darius
hello, if you have a question about Algebra 2. I may be able to help. I am an Algebra 2 Teacher
Shirley Reply
thank you help me with how to prove the quadratic equation
Seidu
may God blessed u for that. Please I want u to help me in sets.
Opoku
what is math number
Tric Reply
4
Trista
x-2y+3z=-3 2x-y+z=7 -x+3y-z=6
Sidiki Reply
can you teacch how to solve that🙏
Mark
Solve for the first variable in one of the equations, then substitute the result into the other equation. Point For: (6111,4111,−411)(6111,4111,-411) Equation Form: x=6111,y=4111,z=−411x=6111,y=4111,z=-411
Brenna
(61/11,41/11,−4/11)
Brenna
x=61/11 y=41/11 z=−4/11 x=61/11 y=41/11 z=-4/11
Brenna
Need help solving this problem (2/7)^-2
Simone Reply
x+2y-z=7
Sidiki
what is the coefficient of -4×
Mehri Reply
-1
Shedrak
A soccer field is a rectangle 130 meters wide and 110 meters long. The coach asks players to run from one corner to the other corner diagonally across. What is that distance, to the nearest tenths place.
Kimberly Reply
Jeannette has $5 and $10 bills in her wallet. The number of fives is three more than six times the number of tens. Let t represent the number of tens. Write an expression for the number of fives.
August Reply
What is the expressiin for seven less than four times the number of nickels
Leonardo Reply
How do i figure this problem out.
how do you translate this in Algebraic Expressions
linda Reply
why surface tension is zero at critical temperature
Shanjida
I think if critical temperature denote high temperature then a liquid stats boils that time the water stats to evaporate so some moles of h2o to up and due to high temp the bonding break they have low density so it can be a reason
s.
Need to simplify the expresin. 3/7 (x+y)-1/7 (x-1)=
Crystal Reply
. After 3 months on a diet, Lisa had lost 12% of her original weight. She lost 21 pounds. What was Lisa's original weight?
Chris Reply
how did you get the value of 2000N.What calculations are needed to arrive at it
Smarajit Reply
Privacy Information Security Software Version 1.1a
Good
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Statistical learning theory. OpenStax CNX. Apr 10, 2009 Download for free at http://cnx.org/content/col10532/1.3
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Statistical learning theory' conversation and receive update notifications?

Ask