Gibbs's Phenomena 2.9 2001/06/13 2006/07/19 16:37:42.602 GMT-5 Ricardo Anthony Radaelli-Sanchez ricky@alumni.rice.edu Richard G. Baraniuk richb@rice.edu Mariyah Poonawala mariyah@rice.edu Prashant Singh prash@ece.rice.edu Ricardo Anthony Radaelli-Sanchez ricky@alumni.rice.edu Justin Romberg jrom@rice.edu Melissa Selik mselik@alumni.rice.edu Matthew Hutchinson mhutch@rice.edu almost everywhere fourier series gibbs phenomenon nonuniform convergence The Fourier Series is the representation of continuous-time, periodic signals in terms of complex exponentials. The Dirichlet conditions suggest that discontinuous signals may have a Fourier Series representation so long as there are a finite number of discontinuities. This seems counter-intuitive, however, as complex exponentials are continuous functions. It does not seem possible to exactly reconstruct a discontinuous function from a set of continuous ones. In fact, it is not. However, it can be if we relax the condition of exactly and replace it with the idea of almost everywhere. This is to say that the reconstruction is exactly the same as the original signal except at a finite number of points. These points, not necessarily suprisingly, occur at the points of discontinuities.

Introduction The Fourier Series is the representation of continuous-time, periodic signals in terms of complex exponentials. The Dirichlet conditions suggest that discontinuous signals may have a Fourier Series representation so long as there are a finite number of discontinuities. This seems counter-intuitive, however, as complex exponentials are continuous functions. It does not seem possible to exactly reconstruct a discontinuous function from a set of continuous ones. In fact, it is not. However, it can be if we relax the condition of 'exactly' and replace it with the idea of 'almost everywhere'. This is to say that the reconstruction is exactly the same as the original signal except at a finite number of points. These points, not necessarily surprisingly, occur at the points of discontinuities.

History In the late 1800s, many machines were built to calculate Fourier coefficients and re-synthesize: f N t n N N c n ω 0 n t Albert Michelson (an extraordinary experimental physicist) built a machine in 1898 that could compute c n up to n ± 79 , and he re-synthesized f 79 t n 79 -79 c n ω 0 n t The machine performed very well on all tests except those involving discontinuous functions. When a square wave, like that shown in , was inputed into the machine, "wiggles" around the discontinuities appeared, and even as the number of Fourier coefficients approached infinity, the wiggles never disappeared - these can be seen in the last plot in . J. Willard Gibbs first explained this phenomenon in 1899, and therefore these discontinuous points are referred to as Gibbs Phenomenon.

Explanation We begin this discussion by taking a signal with a finite number of discontinuities (like a square pulse) and finding its Fourier Series representation. We then attempt to reconstruct it from these Fourier coefficients. What we find is that the more coefficients we use, the more the signal begins to resemble the original. However, around the discontinuities, we observe rippling that does not seem to subside. As we consider even more coefficients, we notice that the ripples narrow, but do not shorten. As we approach an infinite number of coefficients, this rippling still does not go away. This is when we apply the idea of almost everywhere. While these ripples remain (never dropping below 9% of the pulse height), the area inside them tends to zero, meaning that the energy of this ripple goes to zero. This means that their width is approaching zero and we can assert that the reconstruction is exactly the original except at the points of discontinuity. Since the Dirichlet conditions assert that there may only be a finite number of discontinuities, we can conclude that the principle of almost everywhere is met. This phenomenon is a specific case of nonuniform convergence. Below we will use the square wave, along with its Fourier Series representation, and show several figures that reveal this phenomenon more mathematically.

Square Wave The Fourier series representation of a square signal below says that the left and right sides are "equal." In order to understand Gibbs Phenomenon we will need to redefine the way we look at equality. s t a 0 k 1 a k 2 k t T k 1 b k 2 k t T

Example shows several Fourier series approximation of the square wave using a varied number of terms, denoted by K:

Fourier series approximation of a square wave Fourier series approximation to sq t . The number of terms in the Fourier sum is indicated in each plot, and the square wave is shown as a dashed line over two periods.

When comparing the square wave to its Fourier series representation in , it is not clear that the two are equal. The fact that the square wave's Fourier series requires more terms for a given representation accuracy is not important. However, close inspection of does reveal a potential issue: Does the Fourier series really equal the square wave at all values of t? In particular, at each step-change in the square wave, the Fourier series exhibits a peak followed by rapid oscillations. As more terms are added to the series, the oscillations seem to become more rapid and smaller, but the peaks are not decreasing. Consider this mathematical question intuitively: Can a discontinuous function, like the square wave, be expressed as a sum, even an infinite one, of continuous ones? One should at least be suspicious, and in fact, it can't be thus expressed. This issue brought Fourier much criticism from the French Academy of Science (Laplace, Legendre, and Lagrange comprised the review committee) for several years after its presentation on 1807. It was not resolved for also a century, and its resolution is interesting and important to understand from a practical viewpoint. The extraneous peaks in the square wave's Fourier series never disappear; they are termed Gibb's phenomenon after the American physicist Josiah Willard Gibbs. They occur whenever the signal is discontinuous, and will always be present whenever the signal has jumps.

Redefine Equality Let's return to the question of equality; how can the equal sign in the definition of the Fourier series be justified? The partial answer is that pointwise--each and every value of t --equality is not guaranteed. What mathematicians later in the nineteenth century showed was that the rms error of the Fourier series was always zero. K rms ε K 0 What this means is that the difference between an actual signal and its Fourier series representation may not be zero, but the square of this quantity has zero integral! It is through the eyes of the rms value that we define equality: Two signals s 1 t , s 2 t are said to be equal in the mean square if rms s 1 s 2 0 . These signals are said to be equal pointwise if s 1 t s 2 t for all values of t . For Fourier series, Gibb's phenomenon peaks have finite height and zero width: The error differs from zero only at isolated points--whenever the periodic signal contains discontinuities--and equals about 9% of the size of the discontinuity. The value of a function at a finite set of points does not affect its integral. This effect underlies the reason why defining the value of a discontinuous function at its discontinuity is meaningless. Whatever you pick for a value has no practical relevance for either the signal's spectrum or for how a system responds to the signal. The Fourier series value "at" the discontinuity is the average of the values on either side of the jump.