Convolutions and Correlations
Convolution and correlation are central to many kinds of operations on lists of data. They are used in such areas as signal and image processing, statistical data analysis, and approximations to partial differential equations, as well as operations on digit sequences and power series.
In both convolution and correlation the basic idea is to combine a kernel list with successive sublists of a list of data. The
convolution of a kernel
with a list
has the general form
, while the
correlation has the general form
.
| ListConvolve[kernel,list] | form the convolution of kernel with list |
| ListCorrelate[kernel,list] | form the correlation of kernel with list |
Convolution and correlation of lists.
This forms the convolution of the kernel
with a list of data.
| Out[1]= |  |
This forms the correlation.
| Out[2]= |  |
In this case reversing the kernel gives exactly the same result as
ListConvolve.
| Out[3]= |  |
This forms successive differences of the data.
| Out[4]= |  |
In forming sublists to combine with a kernel, there is always an issue of what to do at the ends of the list of data. By default,
ListConvolve and
ListCorrelate never form sublists which would "overhang" the ends of the list of data. This means that the output you get is normally shorter than the original list of data.
With an input list of length 6, the output is in this case of length 4.
| Out[5]= |  |
In practice one often wants to get output that is as long as the original list of data. To do this requires including sublists that overhang one or both ends of the list of data. The additional elements needed to form these sublists must be filled in with some kind of "padding". By default,
Mathematica takes copies of the original list to provide the padding, thus effectively treating the list as being cyclic.
| ListCorrelate[kernel,list] | do not allow overhangs on either side (result shorter than list) |
| ListCorrelate[kernel,list,1] | allow an overhang on the right (result same length as list) |
| ListCorrelate[kernel,list,-1] | allow an overhang on the left (result same length as list) |
| ListCorrelate[kernel,list,{-1,1}] | allow overhangs on both sides (result longer than list) |
| ListCorrelate[kernel,list,{kL,kR}] | allow particular overhangs on left and right |
Controlling how the ends of the list of data are treated.
The default involves no overhangs.
| Out[6]= |  |
The last term in the last element now comes from the beginning of the list.
| Out[7]= |  |
Now the first term of the first element and the last term of the last element both involve wraparound.
| Out[8]= |  |
In the general case
ListCorrelate
is set up so that in the first element of the result, the first element of
list appears multiplied by the element at position
in
kernel, and in the last element of the result, the last element of
list appears multiplied by the element at position
in
kernel. The default case in which no overhang is allowed on either side thus corresponds to
ListCorrelate
.
With a kernel of length 3, alignments
always make the first and last elements of the result the same.
| Out[9]= |  |
For many kinds of data, it is convenient to assume not that the data is cyclic, but rather that it is padded at either end by some fixed element, often 0, or by some sequence of elements.
| ListCorrelate[kernel,list,klist,p] | pad with element p |
| ListCorrelate[kernel,list,klist,{p1,p2,...}] |
| pad with cyclic repetitions of the  |
| ListCorrelate[kernel,list,klist,list] | pad with cyclic repetitions of the original data |
Controlling the padding for a list of data.
This pads with element
.
| Out[10]= |  |
A common case is to pad with zero.
| Out[11]= |  |
When the padding is indicated by
, the list
overlays
with a
aligned under the
.
| Out[12]= |  |
Different choices of kernel allow
ListConvolve and
ListCorrelate to be used for different kinds of computations.
This finds a moving average of data.
| Out[13]= |  |
Here is a Gaussian kernel.
This generates some "data".
Here is a plot of the data.
| Out[16]= |  |
This convolves the kernel with the data.
The result is a smoothed version of the data.
| Out[18]= |  |
You can use
ListConvolve and
ListCorrelate to handle symbolic as well as numerical data.
This forms the convolution of two symbolic lists.
| Out[19]= |  |
The result corresponds exactly with the coefficients in the expanded form of this product of polynomials.
| Out[20]= |  |
ListConvolve and
ListCorrelate work on data in any number of dimensions.
This imports image data from a file.
| Out[22]= |  |
This convolves the data with a two-dimensional kernel.
This shows the image corresponding to the data.
| Out[24]= |  |
