Skip to content Skip to navigation

Connexions

You are here: Home » Content » Continuous-Time Signals

Navigation

Content Actions

  • Download module PDF
  • Add to ...
    Add the module to:
    • My Favorites
    • A lens
    • An external social bookmarking service
    • My Favorites (What is 'My Favorites'?)
      'My Favorites' is a special kind of lens which you can use to bookmark modules and collections directly in Connexions. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need a Connexions account to use 'My Favorites'.
    • A lens (What is a lens?)

      Definition of a lens

      Lenses

      A lens is a custom view of Connexions content. You can think of it as a fancy kind of list that will let you see Connexions through the eyes of organizations and people you trust.

      What is in a lens?

      Lens makers point to Connexions materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

      Who can create a lens?

      Any individual Connexions member, a community, or a respected organization.

    • External bookmarks
  • E-mail the author

Recently Viewed

This feature requires Javascript to be enabled.

Continuous-Time Signals

Module by: C. Sidney Burrus

Signals occur in a wide range of physical phenomenon. They might be human speech, blood pressure variations with time, seismic waves, radar and sonar signals, pictures or images, stress and strain signals in a building structure, stock market prices, a city's population, or temperature across a plate. These signals are often modeled or represented by a real or complex valued mathematical function of one or more variables. For example, speech is modeled by a function representing air pressure varying with time. The function is acting as a mathematical analogy to the speech signal and, therefore, is called an analog signal. For these signals, the independent variable is time and it changes continuously so that the term continuous-time signal is also used. In our discussion, we talk of the mathematical function as the signal even though it is really a model or representation of the physical signal.

The description of signals in terms of their sinusoidal frequency content has proven to be one of the most powerful tools of continuous and discrete-time signal description, analysis, and processing. For that reason, we will start the discussion of signals with a development of Fourier transform methods. We will first review the continuous-time methods of the Fourier series (FS), the Fourier transform or integral (FT), and the Laplace transform (LT). Next the discrete-time methods will be developed in more detail with the discrete Fourier transform (DFT) applied to finite length signals followed by the discrete-time Fourier transform (DTFT) for infinitely long signals and ending with the Z-transform which allows the powerful tools of complex variable theory to be applied.

More recently, a new tool has been developed for the analysis of signals. Wavelets and wavelet transforms Entry 9, Entry 1, Entry 5, Entry 16, Entry 15 are another more flexible expansion system that also can describe continuous and discrete-time, finite or infinite duration signals. We will very briefly introduce the ideas behind wavelet-based signal analysis.

The Fourier Series

The problem of expanding a finite length signal in a trigonometric series was posed and studied in the late 1700's by renowned mathematicians such as Bernoulli, d'Alembert, Euler, Lagrange, and Gauss. Indeed, what we now call the Fourier series and the formulas for the coefficients were used by Euler in 1780. However, it was the presentation in 1807 and the paper in 1822 by Fourier stating that an arbitrary function could be represented by a series of sines and cosines that brought the problem to everyone's attention and started serious theoretical investigations and practical applications that continue to this day Entry 8, Entry 3, Entry 11, Entry 10, Entry 7, Entry 12. The theoretical work has been at the center of analysis and the practical applications have been of major significance in virtually every field of quantitative science and technology. For these reasons and others, the Fourier series is worth our serious attention in a study of signal processing.

Definition of the Fourier Series

We assume that the signal x(t)x(t) to be analyzed is well described by a real or complex valued function of a real variable tt defined over a finite interval {0tT}{0tT}. The trigonometric series expansion of x(t)x(t) is given by

x ( t ) = a ( 0 ) 2 + k = 1 a ( k ) cos ( 2 π T k t ) + b ( k ) sin ( 2 π T k t ) . x ( t ) = a ( 0 ) 2 + k = 1 a ( k ) cos ( 2 π T k t ) + b ( k ) sin ( 2 π T k t ) . (1)

where xk(t)=cos(2πkt/T)xk(t)=cos(2πkt/T) and yk(t)=sin(2πkt/T)yk(t)=sin(2πkt/T) are the basis functions for the expansion. The energy or power in an electrical, mechanical, etc. system is a function of the square of voltage, current, velocity, pressure, etc. For this reason, the natural setting for a representation of signals is the Hilbert space of L2[0,T]L2[0,T]. This modern formulation of the problem is developed in Entry 6, Entry 11. The sinusoidal basis functions in the trigonometric expansion form a complete orthogonal set in L2[0,T]L2[0,T]. The orthogonality is easily seen from inner products

( cos ( 2 π T k t ) , cos ( 2 π T t ) ) = 0 T ( cos ( 2 π T k t ) cos ( 2 π T t ) ) d t = δ ( k - ) ( cos ( 2 π T k t ) , cos ( 2 π T t ) ) = 0 T ( cos ( 2 π T k t ) cos ( 2 π T t ) ) d t = δ ( k - ) (2)

and

( cos ( 2 π T k t ) , sin ( 2 π T t ) ) = 0 T ( cos ( 2 π T k t ) sin ( 2 π T t ) ) d t = 0 ( cos ( 2 π T k t ) , sin ( 2 π T t ) ) = 0 T ( cos ( 2 π T k t ) sin ( 2 π T t ) ) d t = 0 (3)

where δ(t)δ(t) is the Kronecker delta function with δ(0)=1δ(0)=1 and δ(k0)=0δ(k0)=0. Because of this, the kkth coefficients in the series can be found by taking the inner product of x(t)x(t) with the kkth basis functions. This gives for the coefficients

a ( k ) = 2 T 0 T x ( t ) cos ( 2 π T k t ) d t a ( k ) = 2 T 0 T x ( t ) cos ( 2 π T k t ) d t (4)

and

b ( k ) = 2 T 0 T x ( t ) sin ( 2 π T k t ) d t b ( k ) = 2 T 0 T x ( t ) sin ( 2 π T k t ) d t (5)

where TT is the time interval of interest or the period of a periodic signal. Because of the orthogonality of the basis functions, a finite Fourier series formed by truncating the infinite series is an optimal least squared error approximation to x(t)x(t). If the finite series is defined by

x ^ ( t ) = a ( 0 ) 2 + k = 1 N a ( k ) cos ( 2 π T k t ) + b ( k ) sin ( 2 π T k t ) , x ^ ( t ) = a ( 0 ) 2 + k = 1 N a ( k ) cos ( 2 π T k t ) + b ( k ) sin ( 2 π T k t ) , (6)

the squared error is

ε = 1 T 0 T | x ( t ) - x ^ ( t ) | 2 d t ε = 1 T 0 T | x ( t ) - x ^ ( t ) | 2 d t (7)

which is minimized over all a(k)a(k) and b(k)b(k) by (Equation 4) and (Equation 5). This is an extraordinarily important property.

It follows that if x(t)L2[0,T]x(t)L2[0,T], then the series converges to x(t)x(t) in the sense that ε0ε0 as NNEntry 6, Entry 11. The question of point-wise convergence is more difficult. A sufficient condition that is adequate for most application states: If f(x)f(x) is bounded, is piece-wise continuous, and has no more than a finite number of maxima over an interval, the Fourier series converges point-wise to f(x)f(x) at all points of continuity and to the arithmetic mean at points of discontinuities. If f(x)f(x) is continuous, the series converges uniformly at all points Entry 11, Entry 8, Entry 3.

A useful condition Entry 6, Entry 11 states that if x(t)x(t) and its derivatives through the qqth derivative are defined and have bounded variation, the Fourier coefficients a(k)a(k) and b(k)b(k) asymptotically drop off at least as fast as 1kq+11kq+1 as kk. This ties global rates of convergence of the coefficients to local smoothness conditions of the function.

The form of the Fourier series using both sines and cosines makes determination of the peak value or of the location of a particular frequency term difficult. A different form that explicitly gives the peak value of the sinusoid of that frequency and the location or phase shift of that sinusoid is given by

x ( t ) = d ( 0 ) 2 + k = 1 d ( k ) cos ( 2 π T k t + θ ( k ) ) x ( t ) = d ( 0 ) 2 + k = 1 d ( k ) cos ( 2 π T k t + θ ( k ) ) (8)

and, using Euler's relation and the usual electrical engineering notation of j=-1j=-1,

e j x = cos ( x ) + j sin ( x ) , e j x = cos ( x ) + j sin ( x ) , (9)

the complex exponential form is obtained as

x ( t ) = k = - c ( k ) e j 2 π T k t x ( t ) = k = - c ( k ) e j 2 π T k t (10)

where

c ( k ) = a ( k ) + j b ( k ) . c ( k ) = a ( k ) + j b ( k ) . (11)

The coefficient equation is

c ( k ) = 1 T 0 T x ( t ) e - j 2 π T k t d t c ( k ) = 1 T 0 T x ( t ) e - j 2 π T k t d t (12)

The coefficients in these three forms are related by

| d | 2 = | c | 2 = a 2 + b 2 | d | 2 = | c | 2 = a 2 + b 2 (13)

and

θ = a r g { c } = tan - 1 ( b a ) θ = a r g { c } = tan - 1 ( b a ) (14)

It is easier to evaluate a signal in terms of c(k)c(k) or d(k)d(k) and θ(k)θ(k) than in terms of a(k)a(k) and b(k)b(k). The first two are polar representation of a complex value and the last is rectangular. The exponential form is easier to work with mathematically.

Although the function to be expanded is defined only over a specific finite region, the series converges to a function that is defined over the real line and is periodic. It is equal to the original function over the region of definition and is a periodic extension outside of the region. Indeed, one could artificially extend the given function at the outset and then the expansion would converge everywhere.

A Geometric View

It can be very helpful to develop a geometric view of the Fourier series where x(t)x(t) is considered to be a vector and the basis functions are the coordinate or basis vectors. The coefficients become the projections of x(t)x(t) on the coordinates. The ideas of a measure of distance, size, and orthogonality are important and the definition of error is easy to picture. This is done in Entry 6, Entry 11, Entry 17 using Hilbert space methods.

Properties of the Fourier Series

The properties of the Fourier series are important in applying it to signal analysis and to interpreting it. The main properties are given here using the notation that the Fourier series of a real valued function x(t)x(t) over {0tT}{0tT} is given by F{x(t)}=c(k)F{x(t)}=c(k) and x˜(t)x˜(t) denotes the periodic extensions of x(t)x(t).

  1. Linear: F{x+y}=F{x}+F{y}F{x+y}=F{x}+F{y} Idea of superposition. Also scalability: F{ax}=aF{x}F{ax}=aF{x}
  2. Extensions of x(t)x(t): x˜(t)=x˜(t+T)x˜(t)=x˜(t+T)x˜(t)x˜(t) is periodic.
  3. Even and Odd Parts: x(t)=u(t)+jv(t)x(t)=u(t)+jv(t) and C(k)=A(k)+jB(k)=|C(k)|ejθ(k)C(k)=A(k)+jB(k)=|C(k)|ejθ(k)
    uuvvAABB|C||C|θθ
    even0even0even0
    odd00oddeven0
    0even0evenevenπ/2π/2
    0oddodd0evenπ/2π/2
  4. Convolution: If continuous cyclic convolution is defined by
    y(t)=h(t)x(t)=0Th˜(t-τ)x˜(τ)dτy(t)=h(t)x(t)=0Th˜(t-τ)x˜(τ)dτ(15)
    then F{h(t)x(t)}=F{h(t)}F{x(t)}F{h(t)x(t)}=F{h(t)}F{x(t)}
  5. Multiplication: If discrete convolution is defined by
    e(n)=d(n)*c(n)=m=-d(m)c(n-m)e(n)=d(n)*c(n)=m=-d(m)c(n-m)(16)
    then F{h(t)x(t)}=F{h(t)}*F{x(t)}F{h(t)x(t)}=F{h(t)}*F{x(t)} This property is the inverse of property 4 and vice versa.
  6. Parseval: 1T0T|x(t)|2dt=k=-|C(k)|21T0T|x(t)|2dt=k=-|C(k)|2 This property says the energy calculated in the time domain is the same as that calculated in the frequency (or Fourier) domain.
  7. Shift: F{x˜(t-t0)}=C(k)e-j2πt0k/TF{x˜(t-t0)}=C(k)e-j2πt0k/T A shift in the time domain results in a linear phase shift in the frequency domain.
  8. Modulate: F{x(t)ej2πKt/T}=C(k-K)F{x(t)ej2πKt/T}=C(k-K) Modulation in the time domain results in a shift in the frequency domain. This property is the inverse of property 7.
  9. Orthogonality of basis functions:
    0Te-j2πmt/Tej2πnt/Tdt=Tδ(n-m)=Tifn=m0ifnm.0Te-j2πmt/Tej2πnt/Tdt=Tδ(n-m)=Tifn=m0ifnm.(17)
    Orthogonality allows the calculation of coefficients using inner products in (Equation 4) and (Equation 5). It also allows Parseval's Theorem in property 6. A relaxed version of orthogonality is called “tight frames" and is important in over-specified systems, especially in wavelets.

Examples

  • An example of the Fourier series is the expansion of a square wave signal with period 2π2π. The expansion is
    x(t)=4π[sin(t)+13sin(3t)+15sin(5t)].x(t)=4π[sin(t)+13sin(3t)+15sin(5t)].(18)
    Because x(t)x(t) is odd, there are no cosine terms (all a(k)=0a(k)=0) and, because of its symmetries, there are no even harmonics (even kk terms are zero). The function is well defined and bounded; its derivative is not, therefore, the coefficients drop off as 1k1k.
  • A second example is a triangle wave of period 2π2π. This is a continuous function where the square wave was not. The expansion of the triangle wave is
    x(t)=4π[sin(t)-132sin(3t)+152sin(5t)+].x(t)=4π[sin(t)-132sin(3t)+152sin(5t)+].(19)
    Here the coefficients drop off as 1k21k2 since the function and its first derivative exist and are bounded.

Note the derivative of a triangle wave is a square wave. Examine the series coefficients to see this. There are many books and web sites on the Fourier series that give insight through examples and demos.

Theorems on the Fourier Series

Four of the most important theorems in the theory of Fourier analysis are the inversion theorem, the convolution theorem, the differentiation theorem, and Parseval's theorem Entry 4.

  • The inversion theorem is the truth of the transform pair given in (Equation 1), (Equation 4), and(Equation 5)..
  • The convolution theorem is property 4.
  • The differentiation theorem says that the transform of the derivative of a function is jωjω times the transform of the function.
  • Parseval's theorem is given in property 6.

All of these are based on the orthogonality of the basis function of the Fourier series and integral and all require knowledge of the convergence of the sums and integrals. The practical and theoretical use of Fourier analysis is greatly expanded if use is made of distributions or generalized functions (e.g. Dirac delta functions, δ(t)δ(t)) Entry 14, Entry 2. Because energy is an important measure of a function in signal processing applications, the Hilbert space of L2L2 functions is a proper setting for the basic theory and a geometric view can be especially useful Entry 6, Entry 4.

The following theorems and results concern the existence and convergence of the Fourier series and the discrete-time Fourier transform Entry 13. Details, discussions and proofs can be found in the cited references.

  • If f(x)f(x) has bounded variation in the interval (-π,π)(-π,π), the Fourier series corresponding to f(x)f(x) converges to the value f(x)f(x) at any point within the interval, at which the function is continuous; it converges to the value 12[f(x+0)+f(x-0)]12[f(x+0)+f(x-0)] at any such point at which the function is discontinuous. At the points π,-ππ,-π it converges to the value 12[f(-π+0)+f(π-0)]12[f(-π+0)+f(π-0)]. Entry 8
  • If f(x)f(x) is of bounded variation in (-π,π)(-π,π), the Fourier series converges to f(x)f(x), uniformly in any interval (a,b)(a,b) in which f(x)f(x) is continuous, the continuity at aa and bb being on both sides. Entry 8
  • If f(x)f(x) is of bounded variation in (-π,π)(-π,π), the Fourier series converges to 12[f(x+0)+f(x-0)]12[f(x+0)+f(x-0)], bounded throughout the interval (-π,π)(-π,π). Entry 8
  • If f(x)f(x) is bounded and if it is continuous in its domain at every point, with the exception of a finite number of points at which it may have ordinary discontinuities, and if the domain may be divided into a finite number of parts, such that in any one of them the function is monotone; or, in other words, the function has only a finite number of maxima and minima in its domain, the Fourier series of f(x)f(x) converges to f(x)f(x) at points of continuity and to 12[f(x+0)+f(x-0)]12[f(x+0)+f(x-0)] at points of discontinuity. Entry 8, Entry 3
  • If f(x)f(x) is such that, when the arbitrarily small neighborhoods of a finite number of points in whose neighborhood |f(x)||f(x)| has no upper bound have been excluded, f(x)f(x) becomes a function with bounded variation, then the Fourier series converges to the value 12[f(x+0)+f(x-0)]12[f(x+0)+f(x-0)], at every point in (-π,π)(-π,π), except the points of infinite discontinuity of the function, provided the improper integral -ππf(x)dx-ππf(x)dx exist, and is absolutely convergent. Entry 8
  • If f is of bounded variation, the Fourier series of f converges at every point