7.4 Filtering: exponential averages and recursive filters

Suppose we try to extend our method for computing finite moving averages to infinite moving averages of the form

In general, this moving average would require infinite memory for the weighting coefficients $w_0,w_1,...$ and for the inputs $u_n,u_{n-1},...$ . Furthermore, the hardware for multiplying $w_k{u}_{n-k}$ would have to be infinitely fast to compute the infinite moving average in finite time. All of this is clearly fanciful and implausible (not to mention impossible). But what if the weights take the exponential form

Does any simplification result? There is hope because the weighting sequence obeys the recursion

This recursion may be rewritten as follows, for $k\ge 1$ :

Let's now manipulate the infinite moving average and use the recursion for the weights to see what happens. You must follow every step:

This result is fundamentally important because it says that the output of the infinite exponential moving average may be computed by scaling the previous output $x_{n-1}$ by the constant a , scaling the new input $u_n$ by $w_0$ , and adding. Only three memory locations must be allocated: one for $w_0$ , one for $a$ , and one for $x_{n-1}$ . Only two multiplies must be implemented: one for $a{x}_{n-1}$ and one for $w_0{u}_n$ . A diagram of the recursion is given in Figure 1 . In this recursion, the old value of the exponential moving average, $x_{n-1}$ , is scaled by $a$ and added to $w_0{u}_n$ to produce the new exponential moving average $x_n$ . This new value is stored in memory, where it becomes $x_{n-1}$ in the next step of the recursion, and so on.