<< Chapter < Page Chapter >> Page >
This module introduces adaptive filters through the example of system identification using the LMS algorithm. The adaptive filter adjusts its coefficients to minimize the mean-square error between its output and that of an unknown system.


[link] is a block diagram of system identification using adaptive filtering. The objective is tochange (adapt) the coefficients of an FIR filter, W , to match as closely as possible the response of an unknown system, H . The unknown system and the adapting filter process the same input signal x n and have outputs d n (also referred to as the desired signal) and y n .

System identification block diagram.

Gradient-descent adaptation

The adaptive filter, W , is adapted using the least mean-square algorithm, which is the most widely used adaptive filteringalgorithm. First the error signal, e n , is computed as e n d n y n , which measures the difference between the output of the adaptive filter and the output of the unknown system.On the basis of this measure, the adaptive filter will change its coefficients in an attempt to reduce the error.The coefficient update relation is a function of the error signal squared and is given by

h n + 1 i h n i μ 2 h n i e 2

The term inside the parentheses represents the gradient of the squared-error with respect to the i th coefficient. The gradient is a vector pointing in the direction of the change in filter coefficients that willcause the greatest increase in the error signal. Because the goal is to minimize the error, however, [link] updates the filter coefficients in the direction opposite the gradient; that is why the gradientterm is negated. The constant μ is a step-size, which controls the amount of gradient information used to update each coefficient. Afterrepeatedly adjusting each coefficient in the direction opposite to the gradient of the error, the adaptive filtershould converge; that is, the difference between the unknown and adaptive systems should get smaller and smaller.

To express the gradient decent coefficient update equation in a more usable manner, we can rewrite the derivative of thesquared-error term as

h i e 2 2 h i e e 2 h i d y e 2 h i d i 0 N 1 h i x n i e
h i e 2 2 x n i e
which in turn gives us the final LMS coefficient update,
h n+1 i h n i μ e x n i
The step-size μ directly affects how quickly the adaptive filter will converge toward the unknown system. If μ is very small, then the coefficients change only a small amount at each update, and the filter convergesslowly. With a larger step-size, more gradient information is included in each update, and the filter converges morequickly; however, when the step-size is too large, thecoefficients may change too quickly and the filter will diverge. (It is possible in some cases to determineanalytically the largest value of μ ensuring convergence.)

Matlab simulation

Simulate the system identification block diagram shown in [link] .

Previously in MATLAB, you used the filter command or the conv command to implement shift-invariant filters. Those commands will not work here because adaptivefilters are shift-varying, since the coefficient update equation changes the filter's impulse response at every sampletime. Therefore, implement the system identification block on a sample-by-sample basis with a do loop, similar to the way you might implement a time-domain FIR filter on aDSP. For the "unknown" system, use the fourth-order, low-pass, elliptical, IIR filter designed for the IIR Filtering: Filter-Design Exercise in MATLAB .

Use Gaussian random noise as your input, which can be generated in MATLAB using the command randn . Random white noise provides signal at all digital frequenciesto train the adaptive filter. Simulate the system with an adaptive filter of length 32 and a step-size of 0.02 . Initialize all of the adaptive filter coefficients to zero. From your simulation, plot the error (orsquared-error) as it evolves over time and plot the frequency response of the adaptive filter coefficients at the end of thesimulation. How well does your adaptive filter match the "unknown" filter? How long does it take to converge?

Once your simulation is working, experiment with different step-sizes and adaptive filter lengths.

Processor implementation

Use the same "unknown" filter as you used in the MATLAB simulation.

Although the coefficient update equation is relatively straightforward, consider using the lms instruction available on the TI processor, which is designed for this application and yields a very efficientimplementation of the coefficient update equation.

To generate noise on the DSP, you can use the PN generator from the Digital Transmitter: Introduction to Quadrature Phase-Shift Keying , but shift the PN register contents up to make the sign bit random.(If the sign bit is always zero, then the noise will not be zero-mean and this will affect convergence.) Send the desiredsignal, d n , the output of the adaptive filter, y n , and the error to the D/A for display on the oscilloscope.

When using the step-size suggested in the MATLAB simulation section, you should notice that the error converges veryquickly. Try an extremely small μ so that you can actually watch the amplitude of the error signal decrease towards zero.


If your project requires some modifications to the implementation here, refer to Haykin and consider some of the following questions regarding such modifications:

  • How would the system in [link] change for different applications? (noise cancellation,equalization, etc. )
  • What happens to the error when the step-size is too large or too small?
  • How does the length of an adaptive FIR filters affect convergence?
  • What types of coefficient update relations are possible besides the described LMS algorithm?

Questions & Answers

show that the set of all natural number form semi group under the composition of addition
Nikhil Reply
explain and give four Example hyperbolic function
Lukman Reply
⅗ ⅔½
The denominator of a certain fraction is 9 more than the numerator. If 6 is added to both terms of the fraction, the value of the fraction becomes 2/3. Find the original fraction. 2. The sum of the least and greatest of 3 consecutive integers is 60. What are the valu
1. x + 6 2 -------------- = _ x + 9 + 6 3 x + 6 3 ----------- x -- (cross multiply) x + 15 2 3(x + 6) = 2(x + 15) 3x + 18 = 2x + 30 (-2x from both) x + 18 = 30 (-18 from both) x = 12 Test: 12 + 6 18 2 -------------- = --- = --- 12 + 9 + 6 27 3
2. (x) + (x + 2) = 60 2x + 2 = 60 2x = 58 x = 29 29, 30, & 31
on number 2 question How did you got 2x +2
combine like terms. x + x + 2 is same as 2x + 2
Mark and Don are planning to sell each of their marble collections at a garage sale. If Don has 1 more than 3 times the number of marbles Mark has, how many does each boy have to sell if the total number of marbles is 113?
mariel Reply
Mark = x,. Don = 3x + 1 x + 3x + 1 = 113 4x = 112, x = 28 Mark = 28, Don = 85, 28 + 85 = 113
how do I set up the problem?
Harshika Reply
what is a solution set?
find the subring of gaussian integers?
hello, I am happy to help!
Shirley Reply
please can go further on polynomials quadratic
hi mam
I need quadratic equation link to Alpa Beta
Abdullahi Reply
find the value of 2x=32
Felix Reply
divide by 2 on each side of the equal sign to solve for x
Want to review on complex number 1.What are complex number 2.How to solve complex number problems.
yes i wantt to review
use the y -intercept and slope to sketch the graph of the equation y=6x
Only Reply
how do we prove the quadratic formular
Seidu Reply
please help me prove quadratic formula
hello, if you have a question about Algebra 2. I may be able to help. I am an Algebra 2 Teacher
Shirley Reply
thank you help me with how to prove the quadratic equation
may God blessed u for that. Please I want u to help me in sets.
what is math number
Tric Reply
x-2y+3z=-3 2x-y+z=7 -x+3y-z=6
Sidiki Reply
can you teacch how to solve that🙏
Solve for the first variable in one of the equations, then substitute the result into the other equation. Point For: (6111,4111,−411)(6111,4111,-411) Equation Form: x=6111,y=4111,z=−411x=6111,y=4111,z=-411
x=61/11 y=41/11 z=−4/11 x=61/11 y=41/11 z=-4/11
Need help solving this problem (2/7)^-2
Simone Reply
what is the coefficient of -4×
Mehri Reply
A soccer field is a rectangle 130 meters wide and 110 meters long. The coach asks players to run from one corner to the other corner diagonally across. What is that distance, to the nearest tenths place.
Kimberly Reply
Jeannette has $5 and $10 bills in her wallet. The number of fives is three more than six times the number of tens. Let t represent the number of tens. Write an expression for the number of fives.
August Reply
What is the expressiin for seven less than four times the number of nickels
Leonardo Reply
How do i figure this problem out.
how do you translate this in Algebraic Expressions
linda Reply
why surface tension is zero at critical temperature
I think if critical temperature denote high temperature then a liquid stats boils that time the water stats to evaporate so some moles of h2o to up and due to high temp the bonding break they have low density so it can be a reason
Need to simplify the expresin. 3/7 (x+y)-1/7 (x-1)=
Crystal Reply
. After 3 months on a diet, Lisa had lost 12% of her original weight. She lost 21 pounds. What was Lisa's original weight?
Chris Reply
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play

Source:  OpenStax, Dsp laboratory with ti tms320c54x. OpenStax CNX. Jan 22, 2004 Download for free at http://cnx.org/content/col10078/1.2
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Dsp laboratory with ti tms320c54x' conversation and receive update notifications?