<< Chapter < Page Chapter >> Page >
One can look at the operation of a matrix times a vector as changing the basis set for the vector or as changing the vector with the same basis description. Many signal and systems problem can be posed in this form.

A matrix times a vector

In this chapter we consider the first problem posed in the introduction

A x = b

where the matrix A and vector x are given and we want to interpret and give structure to the calculation of the vector b . Equation [link] has a variety of special cases. The matrix A may be square or may be rectangular. It may have full column or row rank or it may not. It may be symmetric or orthogonalor non-singular or many other characteristics which would be interesting properties as an operator. If we view the vectors as signals and thematrix as an operator or processor, there are two interesting interpretations.

  • The operation [link] is a change of basis or coordinates for a fixed signal. The signal stays the same, the basis (or frame) changes.
  • The operation [link] alters the characteristics of the signal (processes it) but within a fixed basis system. The basis stays the same, the signalchanges.

An example of the first would be the discrete Fourier transform (DFT) where one calculates frequency components of a signal which arecoordinates in a frequency space for a given signal. The definition of the DFT from [link] can be written as a matrix-vector operation by c = Wx which, for w = e - j 2 π / N and N = 4 , is

c 0 c 1 c 2 c 3 = w 0 w 0 w 0 w 0 w 0 w 1 w 2 w 3 w 0 w 2 w 4 w 6 w 0 w 3 w 6 w 9 x 0 x 1 x 2 x 3

An example of the second might be convolution where you are processing or filtering asignal and staying in the same space or coordinate system.

y 0 y 1 y 2 = h 0 0 0 0 h 1 h 0 0 h 2 h 1 h 0 x 0 x 1 x 2 .

A particularly powerful sequence of operations is to first change the basis for a signal, then process the signal in this new basis, and finally returnto the original basis. For example, the discrete Fourier transform (DFT) of a signal is taken followed by setting some of the Fourier coefficients tozero followed by taking the inverse DFT.

Another application of [link] is made in linear regression where the input signals are rows of A and the unknown weights of the hypothesisare in x and the outputs are the elements of b .

Change of basis

Consider the two views:

  1. The operation given in [link] can be viewed as x being a set of weights so that b is a weighted sum of the columns of A . In other words, b will lie in the space spanned by the columns of A at a location determined by x . This view is a composition of a signal from a set of weights as in [link] and [link] below. If the vector a i is the i t h column of A , it is illustrated by
    A x = x 1 a 1 + x 2 a 2 + x 3 a 3 = b .
  2. An alternative view has x being a signal vector and with b being a vector whose entries are inner products of x and the rows of A . In other words, the elements of b are the projection coefficients of x onto the coordinates given by the rows of A . The multiplication of a signal by this operator decomposes the signal and gives thecoefficients of the decomposition. If a ¯ j is the j t h row of A we have:
    b 1 = a ¯ 1 x b 2 = a ¯ 2 x e t c .
    Regression can be posed from this view with the input signal being the rows of A .

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Basic vector space methods in signal and systems theory. OpenStax CNX. Dec 19, 2012 Download for free at http://cnx.org/content/col10636/1.5
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Basic vector space methods in signal and systems theory' conversation and receive update notifications?

Ask