MATHEMATICA TUTORIAL

"Composition" and "Splitting" Methods for NDSolve

Introduction

In some cases it is useful to split the differential system into subsystems and solve each subsystem using appropriate integration methods. Recombining the individual solutions often allows certain dynamical properties, such as volume, to be conserved. More information on splitting and composition can be found in [MQ02, HLW02], and specific aspects related to NDSolve are discussed in [SS05, SS06].

Definitions

Of concern are initial value problems , where .

"Composition"

Composition is a useful device for raising the order of a numerical integration scheme.

In contrast to the Aitken-Neville algorithm used in extrapolation, composition can conserve geometric properties of the base integration method (e.g. symplecticity).

Let be a basic integration method that takes a step of size with given real numbers.

Then the -stage composition method is given by

Often interest is in composition methods that involve the same base method

An interesting special case is symmetric composition: , .

The most common types of composition are:

  • Symmetric composition of symmetric second-order methods
  • Symmetric composition of first-order methods (e.g. a method with its adjoint )
  • Composition of first-order methods

"Splitting"

An -stage splitting method is a generalization of a composition method in which is broken up in an additive fashion:

The essential point is that there can often be computational advantages in solving problems involving instead of .

An -stage splitting method is a composition of the form

with not necessarily distinct.

Each base integration method now only solves part of the problem, but a suitable composition can still give rise to a numerical scheme with advantageous properties.

If the vector field is integrable, then the exact solution or flow can be used in place of a numerical integration method.

A splitting method may also use a mixture of flows and numerical methods.

An example is Lie-Trotter splitting [T59]:

Split with ; then yields a first-order integration method.

Computationally it can be advantageous to combine flows using the group property

Implementation

Several changes to the new NDSolve framework were needed in order to implement splitting and composition methods.

  • Allow a method to call an arbitrary number of submethods.
  • Add the ability to pass around a function for numerically evaluating a subfield, instead of the entire vector field.
  • Add a method to compute the flow; analytically solve a subsystem and advance the (local) solution numerically.
    • Add cache data for identical methods to avoid repeated initialization. Data for numerically evaluating identical subfields is also cached.

    A simplified input syntax allows omitted vector fields and methods to be filled in cyclically. These must be defined unambiguously:

    can be input as .

    cannot be input as since this corresponds to .

Nested Methods

The following example constructs a high-order splitting method from a low-order splitting using .

NDSolve

Simplification

A more efficient integrator can be obtained in the previous example using the group property of flows and calling the method directly.

FrameBox[TemplateBox[{NDSolve, paclet:ref/NDSolve}, RefLink, BaseStyle -> InlineFormula], FrameMargins -> {{0.2, 0.2}, {0.4, 0.4}}]

Examples

The following examples will use a second-order symmetric splitting known as the Strang splitting [S68], [M68]. The splitting coefficients are automatically determined from the structure of the equations.

This defines a method known as symplectic leapfrog in terms of the method .
Click for copyable input
Load a package with some useful example problems.
Click for copyable input

Symplectic Splitting

Symplectic Leapfrog

is an efficient method for solving separable Hamiltonian systems with favorable long-time dynamics.

is a more general-purpose method, but it can be used to construct partitioned symplectic methods (though it is somewhat less efficient than ).

Consider the harmonic oscillator that arises from a linear differential system that is governed by the separable Hamiltonian .
Click for copyable input
Split the Hamiltonian vector field into independent components governing momentum and position. This is done by setting the relevant right-hand sides of the equations to zero.
Click for copyable input
This composition of weighted (first-order) Euler integration steps corresponds to the symplectic (second-order) leapfrog method.
In[11]:=
Click for copyable input
Out[14]=

The method could only have been specified once, since the second and third instances would have been filled in cyclically.

This is the result at the end of the integration step.
In[15]:=
Click for copyable input
Out[15]//InputForm=
This invokes the built-in integration method corresponding to the symplectic leapfrog integrator.
In[16]:=
Click for copyable input
Out[16]=
The result at the end of the integration step is identical to the result of the splitting method.
In[17]:=
Click for copyable input
Out[17]//InputForm=

Composition of Symplectic Leapfrog

This takes the symplectic leapfrog scheme as the base integration method and constructs a fourth-order symplectic integrator using a symmetric composition of Ruth-Yoshida [Y90].
In[18]:=
Click for copyable input
Out[20]=
This is the result at the end of the integration step.
In[21]:=
Click for copyable input
Out[21]//InputForm=
This invokes the built-in symplectic integration method using coefficients for the fourth-order methods of Ruth and Yoshida.
Click for copyable input
The result at the end of the integration step is identical to the result of the composition method.
Click for copyable input

Hybrid Methods

While a closed-form solution often does not exist for the entire vector field, in some cases it is possible to analytically solve a system of differential equations for part of the vector field.

When a solution can be found by DSolve, direct numerical evaluation can be used to locally advance the solution.

This idea is implemented in the method "LocallyExact".

Harmonic Oscillator Test Example

This example checks that the solution for the exact flows of split components of the harmonic oscillator equations is the same as applying Euler's method to each of the split components.
Click for copyable input
Click for copyable input
Click for copyable input
Click for copyable input

Hybrid Numeric-Symbolic Splitting Methods (ABC Flow)

Consider the Arnold, Beltrami, and Childress flow, a widely studied model for volume-preserving three-dimensional flows.
Click for copyable input

When applied directly, a volume-preserving integrator would not in general preserve symmetries. A symmetry-preserving integrator, such as the implicit midpoint rule, would not preserve volume.

This defines a splitting of the system by setting some of the right-hand side components to zero.
Click for copyable input
Click for copyable input
Click for copyable input

The system for is solvable exactly by DSolve so that you can use the "LocallyExact" method.

is not solvable, however, so you need to use a suitable numerical integrator in order to obtain the desired properties in the splitting method.

This defines a method for computing the implicit midpoint rule in terms of the built-in method.
Click for copyable input
This defines a second-order, volume-preserving, reversing symmetry-group integrator [MQ02].
Click for copyable input

Lotka-Volterra Equations

Various numerical integrators for this system are compared within "Numerical Methods for Solving the Lotka-Volterra Equations".

Euler's Equations

Various numerical integrators for Euler's equations are compared within "Rigid Body Solvers".

Non-Autonomous Vector Fields

Consider the Duffing oscillator, a forced planar non-autonomous differential system.
Click for copyable input
This defines a splitting of the system.
Click for copyable input
The splitting of the time component among the vector fields is ambiguous, so the method issues an error message.
Click for copyable input
The equations can be extended by introducing a new "dummy" variable such that and specifying how it should be distributed in the split differential systems.
Click for copyable input
This defines a geometric splitting method that satisfies for any finite time interval, where and are the Lyapunov exponents [MQ02].
Click for copyable input
Here is a plot of the solution.
Click for copyable input

Option Summary

The default coefficient choice in tries to automatically select between and depending on the properties of the methods specified using the Method option.

option name
default value
"Coefficients"Automaticspecify the coefficients to use in the composition method
"DifferenceOrder"Automaticspecify the order of local accuracy of the method
MethodNonespecify the base methods to use in the numerical integration

Options of the method .

option name
default value
"Coefficients"{}specify the coefficients to use in the splitting method
"DifferenceOrder"Automaticspecify the order of local accuracy of the method
"Equations"{}specify the way in which the equations should be split
MethodNonespecify the base methods to use in the numerical integration

Options of the method .

New to Mathematica? Find your learning path »
Have a question? Ask support »