You are currently viewing Introduction to Wavelets and Their Applications

Wavelets are a powerful mathematical tool, used in recent years in many applications. For example, wavelets play a fundamental role in defining the JPEG-2000 and MPEG-4 standards.

Let’s see what they are and how they’re used in applications.

Wavelets in a Nutshell

A wavelet is a real function $f: \mathbb{R} \rightarrow \mathbb {R}$ which represents a wavelike oscillation localized in a limited range of its domain.

Here are some examples:

The Meyer wavelet. Image by JonMcLoone, Wikimedia Commons.
The Morlet wavelet. Image by JonMcLoone, Wikimedia Commons.
The Mexican hat wavelet. Image by JonMcLoone, Wikimedia Commons.

Given a mother wavelet $f$ we can define a set of child wavelets $f_ {a, b}$ through the parameters $(a, b)$

$$\displaystyle f_ {a, b } = \frac {1} {\sqrt {a}} f \left (\frac {x-b} {a} \right) \qquad \text{with } a,b \in \mathbb{R}\text{ and } a>0$$

Parameter $a$ scales the function while $b$ shifts it. In applications it is common to take into account a discrete set of pairs $(a, b)$ so you can index child functions with discrete parameters $f_ {i, j}$ with $i, j \in \mathbb{N}$.

The general idea behind wavelets is that a function $g(x)$ can be represented as a linear combination of child wavelets:

$$\displaystyle g(x) = \sum_{i, j} A_ {i, j} \cdot f(x) _ {i, j}$$

Compression of Signals

The function $g(x)$ could be, for example, the sound of a musical instrument or the signal of a seismograph or electrocardiogram.

The signal of an electrocardiogram. Image by James Heilman, MD, Wikimedia Commons.

At first, the signal is registered sampling at a certain frequency. In practice for each sampling interval the value of the function $g(x)$ is recorded. If the sampling frequency is high, a signal stored in such a way can occupy a lot of memory.

Through wavelets it is possible to store the signal using only the values of the main coefficients $A_{i,j}$ of the wavelet expansion.

The truncation of the wavelet series results in a little loss of precision in representing the $g(x)$ function, but it also results in a huge saving in the amount of information to be stored, also called compression.

The JPEG-2000 and MPEG-4 Standards

In the JPEG-2000 and MPEG-4 standards, images and videos are represented through a wavelet expansion. In addition to data compression, the main advantage of using wavelets in this field is to manage different resolutions of the image with a single file.

Once an image is saved as a wavelet expansion, if you want to create a low-resolution preview of the same image, it is sufficient to use fewer elements of the summation.

Different image resolutions are obtained by simply truncating the wavelet series at different depths.

The so-called CDF 5/3 wavelet used in the JPEG-2000 standard for image compression.

Wavelets vs Fourier

Experienced readers will have noticed the similarity between the wavelet decomposition and discrete Fourier transforms.

The Fourier transforms have many properties that make them interesting from a theoretical point of view. However, wavelets have some significant advantages in applied mathematics.

1) Personalization: Fourier transforms always make use of sine and cosine functions. On the other hand, depending on the particular application, you can choose the wavelets that better adapt to deal with that problem.

2) Localization: signals that are analyzed in applications often consist of several blocks of information separated by intervals of near-zero signal (for example, in the case of the electrocardiogram). As a consequence, it’s more natural to decompose this kind of signal through wavelets that represent localized waves.

3) More control over Gibbs phenomenon: Fourier transforms present some problems in describing discontinuous signals. I’m referring to the so-called Gibbs phenomenon.

The classic example is that of a square wave that alternately takes the values 0 and 1. The discrete Fourier expansion of this signal presents a peak near the discontinuity with a value of about 1.09.

The left image shows the approximation using 25 harmonics while the right image using 125 harmonics. The height of the peak remains stable, even increasing the terms of the Fourier series!

This is somewhat counterintuitive, because you would expect the series to converge to the function and so to the value 1.

Also, the wavelet expansion exhibits this kind of phenomenon, but to a lesser extent compared to the discrete Fourier transform.

Some Geometrical Considerations for More Advanced Readers

Another difference between wavelets and Fourier transform is geometric. The sine and cosine functions used in Fourier series form a basis of the space of functions $\mathrm{L} ^ 2 ([0,1])$.

This means they are linearly independent vectors that span the whole space of functions.

Often, wavelets used in applications are frames rather than bases. A frame is a set of vectors that span the vector space but that are not linearly independent.

As a consequence we have that the decomposition of a vector in terms of wavelets is not unique. This feature, which might seem to be a problem, represents instead a further computational advantage, contributing to an improved numerical stability of wavelets with respect to Fourier transform.

EnricoDeg

I live in Verona, Italy and I teach mathematics and physics at high school trying to make students understand the beauty and usefulness of STEM subjects. Before being a teacher, I worked for 12 years in the financial industry dealing with risk management, stochastic models for derivative pricing, and IT banking applications. My interests include chess, go, guitar, volleyball, trekking, snowboarding and of course reading and writing about mathematics and physics!

This Post Has 5 Comments

  1. Raul Simon

    Nice text. Years ago, I read about wavelets, and something called the “proper orthogonal decomposition”. However, I have forgoten all about it.

    1. EnricoDeg

      Thank you Raul. I guess proper orthogonal decomposition (also called principal component analysis) was used to establish which were the most important wavelets in reconstructing the signal.

      1. Raul Simon

        Thank you, Enrico.

  2. Melchior

    Could you recommend some literature to read further details?

    1. EnricoDeg

      Hi Melchior, first of all, sorry for the late reply. I’ve been very busy in these days.

      I’ve never studied this topic on a book. I knew something about wavelets from a master in applied mathematics I’ve attended some years ago and just searched on the internet some other information to complete the post.

      So some obvious references are:
      https://en.wikipedia.org/wiki/Wavelet
      https://en.wikipedia.org/wiki/JPEG_2000
      https://en.wikipedia.org/wiki/Frame_(linear_algebra)

      For a more academic reference I asked a friend of mine who’s more in the field and he suggested me “A First Course in Wavelets with Fourier Analysis” by Albert Boggess and Francis Narcowich.

      I also found this freely available document on scribd.com:
      https://www.scribd.com/document/334619872/Concise-Introduction-to-Wavelets

Leave a Reply