-
Home
- Statistical signal processing
- Estimation theory
- Estimation theory: problems
Estimates for identical parameters are heavily dependent on the
assumed underlying probability densities. To understand thissensitivity better, consider the following variety of
problems, each of which asks for estimates of quantitiesrelated to variance. Determine the bias and consistency in
each case.
Compute the maximum
a posteriori and
maximum likelihood estimates of
based on
statistically independent observations of a Maxwellian
random variable
.
Find the maximum
a posteriori estimate
of the variance
from
statistically independent observations having the
exponential density
where the variance is uniformly distributed over the interval
.
Find the maximum likelihood estimate of the variance of
identically distributed, but dependent Gaussian random
variables. Here, the covariance matrix is written
,
where the normalized covariance matrix has trace
Imagine yourself idly standing on the corner in a large city
when you note the serial number of a passing beer truck.Because you are idle, you wish to estimate (guess may be
more accurate here) how many beer trucks the city has fromthis single operation
Making appropriate assumptions, the beer truck's number is
drawn from a uniform probability density ranging betweenzero and some unknown upper limit, find the maximum
likelihood estimate of the upper limit.
Show that this estimate is biased.
In one of your extraordinarily idle moments, you observe
throughout the city
beer trucks. Assuming them to be independent
observations, now what is the maximum likelihood estimateof the total?
Is this estimate of
biased? asymptotically biased? consistent?
We make
observations
of a parameter
corrupted by additive noise (
). The parameter
is a Gaussian random variable
[
]
and
are statistically independent Gaussian random variables
[
].
Find the MMSE estimate of
.
Find the maximum
a posteriori estimate of
.
Compute the resulting mean-squared error for each estimate.
Consider an alternate procedure based on the same observations
. Using the MMSE criterion, we estimate
immediately after each observation. This procedure yieldsthe sequence of estimates
,
,,
. Express
as a function of
,
, and
. Here,
denotes the variance of the estimation error of the
estimate. Show that
Although the maximum likelihood estimation procedure was not
clearly defined until early in the 20th century, Gaussshowed in 1905 that the Gaussian density
It wasn't called the Gaussian density in
1805; this result is one of the reasons why it is.
was the
sole density for which the
maximum likelihood estimate of the mean equaledthe sample
average. Let
be a sequence of statistically independent, identically
distributed random variables.
What equation defines the maximum likelihood estimate
of the mean
when the common probability density function of the data
has the form
?
The sample average is, of course,
.
Show that it minimizes the mean-square error
.
Equating the sample average to
, combine this equation with the maximum
likelihood equation to show that the Gaussian densityuniquely satisfies the equations.
Because both equations equal 0, they can be equated. Use
the fact that they must hold for
all
to derive the result. Gauss thus showed that mean-squared
error and the Gaussian density were closely linked,presaging ideas from modern robust estimation theory.
Questions & Answers
the study of living organisms and their interactions with one another and their environments
AI-Robot
HOW CAN MAN ORGAN FUNCTION
the diagram of the digestive system
allimentary cannel
Ogenrwot
They formed in two ways first when one sperm and one egg are splited by mitosis or two sperm and two eggs join together
Oluwatobi
Genetics is the study of heredity
Misack
how does twins formed?
Misack
discuss biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles
the study of living organisms and their interactions with one another and their environment.
Wine
discuss the biological phenomenon and provide pieces of evidence to show that it was responsible for the formation of eukaryotic organelles in an essay form
list any five characteristics of the blood cells
Shaker
lack electricity and its more savely than electronic microscope because its naturally by using of light
advantage of electronic microscope is easily and clearly while disadvantage is dangerous because its electronic. advantage of light microscope is savely and naturally by sun while disadvantage is not easily,means its not sharp and not clear
Abdullahi
cell theory state that every organisms composed of one or more cell,cell is the basic unit of life
Abdullahi
is like gone fail us
DENG
cells is the basic structure and functions of all living things
Ramadan
is organisms that are similar into groups called tara
Yamosa
in what situation (s) would be the use of a scanning electron microscope be ideal and why?
A scanning electron microscope (SEM) is ideal for situations requiring high-resolution imaging of surfaces. It is commonly used in materials science, biology, and geology to examine the topography and composition of samples at a nanoscale level. SEM is particularly useful for studying fine details,
Hilary
cell is the building block of life.
Got questions? Join the online conversation and get instant answers!
Source:
OpenStax, Statistical signal processing. OpenStax CNX. Dec 05, 2011 Download for free at http://cnx.org/content/col11382/1.1
Google Play and the Google Play logo are trademarks of Google Inc.