# 0.5 Sampling with automatic gain control  (Page 12/19)

 Page 12 / 19

To apply steepest descent to the minimization of the polynomial $J\left(x\right)$ in [link] , suppose that a current estimate of $x$ is available at time $k$ , which is denoted $x\left[k\right]$ . A new estimate of $x$ at time $k+1$ can be made using

$x\left[k+1\right]=x\left[k\right]-\mu {\left(\frac{dJ\left(x\right)}{dx}|}_{x=x\left[k\right]},$

where $\mu$ is a small positive number called the stepsize, and where the gradient (derivative) of $J\left(x\right)$ is evaluated at the current point $x\left[k\right]$ . This is then repeated again and again as $k$ increments. This procedure isshown in [link] . When the current estimate $x\left[k\right]$ is to the right of the minimum, the negative of the gradient points left. When the current estimate is to the left of the minimum, thenegative gradient points to the right. In either case, as long as the stepsize is suitably small, the newestimate $x\left[k+1\right]$ is closer to the minimum than the old estimate $x\left[k\right]$ ; that is, $J\left(x\left[k+1\right]\right)$ is less than $J\left(x\left[k\right]\right)$ .

To make this explicit, the iteration defined by [link] is

$x\left[k+1\right]=x\left[k\right]-\mu \left(2x\left[k\right]-4\right),$

or, rearranging,

$x\left[k+1\right]=\left(1-2\mu \right)x\left[k\right]+4\mu .$

In principle, if [link] is iterated over and over, the sequence $x\left[k\right]$ should approach the minimum value $x=2$ . Does this actually happen?

There are two ways to answer this question. It is straightforward to simulate the process. Here is some M atlab code that takes an initial estimate of $x$ called x(1) and iterates [link] for N=500 steps.

N=500;                          % number of iterations mu=.01;                         % algorithm stepsizex=zeros(1,N);                   % initialize x to zero x(1)=3;                         % starting point x(1)for k=1:N-1   x(k+1)=(1-2*mu)*x(k)+4*mu;    % update equationend polyconverge.m find the minimum of $J\left(x\right)={x}^{2}-4x+4$ via steepest descent (download file) 

[link] shows the output of polyconverge.m for 50 different x(1) starting values superimposed; all converge smoothly to the minimum at $x=2$ .

Explore the behavior of steepest descent by running polyconverge.m with different parameters.

1. Try mu = -.01, 0, .0001, .02, .03, .05, 1.0, 10.0. Can mu be too large or too small?
2. Try N= 5, 40, 100, 5000. Can N be too large or too small?
3. Try a variety of values of x(1) . Can x(1) be too large or too small?

As an alternative to simulation, observe that the process [link] is itself a linear time invariant system, of the general form

$x\left[k+1\right]=ax\left[k\right]+b,$

which is stable as long as $|a|<1$ . For a constant input, the final value theorem of z-Transforms (see [link] ) can be used to show that the asymptotic (convergent)output value is ${lim}_{k\to \infty }{x}_{k}=\frac{b}{1-a}$ . To see this withoutreference to arcane theory, observe that if ${x}_{k}$ is to converge, then it must converge to some value, say ${x}^{*}$ . At convergence, $x\left[k+1\right]=x\left[k\right]={x}^{*}$ , and so [link] implies that ${x}^{*}=a{x}^{*}+b$ , which implies that ${x}^{*}=\frac{b}{1-a}$ . (This holds assuming $|a|<1$ .) For example, for [link] , ${x}^{*}=\frac{4\mu }{1-\left(1-2\mu \right)}=2$ , which is indeed the minimum.

Thus, both simulation and analysis suggest that the iteration [link] is a viable way to find the minimum of the function $J\left(x\right)$ , as long as $\mu$ is suitably small. As will become clearer in later sections, suchsolutions to optimization problems are almost always possible—as long as the function $J\left(x\right)$ is differentiable. Similarly, it is usually quite straightforward to simulate thealgorithm to examine its behavior in specific cases, though it is not always so easy to carry out a theoretical analysis.

what is monopoli power
the situation that prevails when economic forces balance so that economic variables neither increase nor decrease
Bombey
what is equilibrium
Kabir
what are the important of economic to accounting students with references
Economics is important because it helps people understand how a variety of factors work with and against each other to control how resources such as labor and capital get used, and how inflation, supply, demand, interest rates and other factors determine how much you pay for goods and services.
explain the steps taken by the government in developing rural market?
contribution of Adam smith in economics
I will join
Dexter
I will join
Patrick
Hey
Fatima
Hey
Amir
Hello
AS
hey
Umarou
I love this book and i need extra Economic book
Amir
Hey
Amir
what's happening here
AS
I love this book and i need extra Economic book
Amir
what is the meaning of function in economics
Pls, I need more explanation on price Elasticity of Supply
Is the degree to the degree of responsiveness of a change in quantity supplied of goods to a change in price
Afran
what is production
Humaira
Okay what is land mobile and land unmobile
scor
And what are the resources in land
scor
what is production
Humaira
the proces of using the services of labor and equipmnt together with other in puts to make goods and services availble
Bombey
Okay what is land mobile and land unmobile
scor
Discuss the short-term and long-term balance positions of the firm in the monopoly market?
hey
Soumya
hi
Mitiku
how are you?
Mitiku
can you tell how can i economics honurs(BSC) in reputed college?
Soumya
through hard study and performing well than expected from you
Mitiku
what should i prepare for it?
Soumya
prepare first, in psychologically as well as potentially to sacrifice what's expected from you, when I say this I mean that you have to be ready, for every thing and to accept failure as a good and you need to change them to potential for achievement of ur goals
Mitiku
parna kya hai behencho?
Soumya
Hallo
Rabindranath
Hello, dear what's up?
Mitiku
cool
Momoh
good morning
Isaac
pls, is anyone here from Ghana?
Isaac
Afran
Afran
Hello
OLANIYI
pls anyone from Nigeria
OLANIYI
am a new candidate here, can someone put me 2ru
OLANIYI
hello
OLANIYI
Pls economic A level exam tomorrow pls help me
akinwale
am from Ghana
Jacob
hi
Charles
Pls economic A level exam tomorrow pls help me
akinwale
Hi
Dev
bol Diya discuss ab krega v
Dev
hello Mr. Rabindranath
Dev
what do you want Dimlare
Dev
yes tell me your desire to have it
Dev
to have what?
OLANIYI
Good luck
JOSEPH
I want to know about economic A level tomorrow pls help
Lerato
okay
Umarou
okay
Umarou
hi
Humaira
hi
Liaqat
what is firms
A firm is a business entity which engages in the production of goods and aimed at making profit.
What is autarky in Economics.
what is choice
So how is the perfect competition different from others
what is choice
Tia
1
Naziru
what is the difference between short run and long run?
It just depends on how far you would like to run!!!🤣🤣🤣
Anna
meaning? You guys need not to be playing here; if you don't know a question, leave it for he that knows.
Ukpen
pls is question from which subject or which course
Is this not economics?
Ukpen
This place is meant to be for serious educational matters n not playing ground so pls let's make it a serious place.
Docky
Is there an economics expert here?
Docky
Okay and I was being serous
Anna
The short run is a period of time in which the quantity of at least one inputs is fixed...
Anna
that is the answer that I found online and in my text book
Anna
Elacisity
salihu
Meaning of economics
It will creates rooms for an effective demands.
different between production and supply
babsnof
Hii
Suraj
hlo
eshita
What is the economic?
Suraj
Economics is a science which study human behavior as a relationship between ends and scarce means which has an alternative use.
Mr
what is supply
babsnof
what is different between demand and supply
Demand refers to the quantity of products that consumers are willing to purchase at various prices per time while Supply has to do with the quantity of products suppliers are willing to supply at various prices per time. find the difference in between
Saye
what is demand
Humaira
demand is a relationship btn the price of an item and the quantity demanded
Bombey
Difference between extinct and extici spicies
Got questions? Join the online conversation and get instant answers!