8.5: Chaos

You have surely heard the story about the flap of a butterfly wing in the Amazon causing hurricanes in the North Atlantic. In a prior section, we mentioned that a small change in initial conditions of the planets can lead to very different configuration of the planets in the long term. These are examples of chaotic systems. Mathematical chaos is not really chaos, there is precise order behind the scenes. Everything is still deterministic. However a chaotic system is extremely sensitive to initial conditions. This also means even small errors induced via numerical approximation create large errors very quickly, so it is almost impossible to numerically approximate for long times. This is large part of the trouble as chaotic systems cannot be in general solved analytically.

Take the weather for example. As a small change in the initial conditions (the temperature at every point of the atmosphere for example) produces drastically different predictions in relatively short time, we cannot accurately predict weather. This is because we do not actually know the exact initial conditions, we measure temperatures at a few points with some error and then we somehow estimate what is in between. There is no way we can accurately measure the effects of every butterfly wing. Then we will solve numerically introducing new errors. That is why you should not trust weather prediction more than a few days out.

The idea of chaotic behavior was first noticed by Edward Lorenz in the 1960s when trying to model thermally induced air convection (movement). The equations Lorentz was looking at form the relatively simple looking system:

\[ x' = -10x +10y, \quad y' = 28x-y-xz, \quad z'=-\frac{8}{3}z + xy . \nonumber \]

A small change in the initial conditions yield a very different solution after a reasonably short time.

Figure \(\PageIndex{1}\)

A very simple example the reader can experiment with, which displays chaotic behavior, is a double pendulum. The equations that govern this system are somewhat complicated and their derivation is quite tedious, so we will not bother to write them down. The idea is to put a pendulum on the end of another pendulum. If you look at the movement of the bottom mass, the movement will appear chaotic. This type of system is a basis for a whole number of office novelty desk toys. It is very simple to build a version. Take a piece of a string, and tie two heavy nuts at different points of the string; one at the end, and one a bit above. Now give the bottom nut a little push, as long as the swings are not too big and the string stays tight, you have a double pendulum system.

Duffing Equation and Strange Attractors

Let us study the so-called Duffing equation:

\[x'' + a x' + bx + cx^3 = C \cos(\omega t) . \nonumber \]

Here \(a\), \(b\), \(c\), \(C\), and \(\omega\) are constants. You will recognize that except for the \(c x^3\) term, this equation looks like a forced mass-spring system. The \(c x^3\) term comes up when the spring does not exactly obey Hooke's law (which no real-world spring actually does obey exactly). When \(c\) is not zero, the equation does not have a nice closed form solution, so we have to resort to numerical solutions as is usual for nonlinear systems. Not all choices of constants and initial conditions will exhibit chaotic behavior. Let us study

\[ x''+0.05 x' + x^3 = 8\cos(t) . \nonumber \]

The equation is not autonomous, so we will not be able to draw the vector field in the phase plane. We can still draw the trajectories however. In Figure \(\PageIndex{2}\) we plot trajectories for \(t\) going from \(0\) to \(15\), for two very close initial conditions \((2,3)\) and \((2,2.9)\), and also the solutions in the \((x,t)\) space. The two trajectories are close at first, but after a while diverge significantly. This sensitivity to initial conditions is precisely what we mean by the system behaving chaotically.

Figure \(\PageIndex{2}\): On left, two trajectories in phase space for \(0\leq t\leq 15\), for the Duffing equation one with initial conditions \((2,3)\) and the other with \((2, 2.9)\). On right the two solutions in \((x,t)\)-space.

Let us see the long term behavior. In Figure \(\PageIndex{3}\), we plot the behavior of the system for initial conditions \((2,3)\), but for much longer period of time. Note that for this period of time it was necessary to use a ridiculously large number of steps\(^{1}\) in the numerical algorithm used to produce the graph, as even small errors quickly propagate. From the graph it is hard to see any particular pattern in the shape of the solution except that it seems to oscillate, but each oscillation appears quite unique. The oscillation is expected due to the forcing term.

Figure \(\PageIndex{3}\): The solution to the given Duffing equation for \(t\) from \(0\) to \(100\).

In general it is very difficult to analyze chaotic systems, or to find the order behind the madness, but let us try to do something that we did for the standard mass-spring system. One way we analyzed what happens is that we figured out what was the long term behavior (not dependent on initial conditions). From the figure above it is clear that we will not get a nice description of the long term behavior, but perhaps we can figure out some order to what happens on each "oscillation" and what do these oscillations have in common.

The concept we will explore is that of a Poincaré section\(^{2}\). Instead of looking at \(t\) in a certain interval, we will look at where the system is at a certain sequence of points in time. Imagine flashing a strobe at a certain fixed frequency and drawing the points where the solution is during the flashes. The right strobing frequency depends on the system in question. The correct frequency to use for the forced Duffing equation (and other similar systems) is the frequency of the forcing term. For the Duffing equation above, find a solution \(\bigl(x(t),y(t)\bigr)\), and look at the points

\[ \bigl(x(0),y(0)\bigr), \quad \bigl(x(2\pi),y(2\pi)\bigr), \quad \bigl(x(4\pi),y(4\pi)\bigr), \quad \bigl(x(6\pi),y(6\pi)\bigr), \quad \ldots \nonumber \]

As we are really not interested in the transient part of the solution, that is, the part of the solution that depends on the initial condition we skip some number of steps in the beginning. For example, we might skip the first 100 such steps and start plotting points at \(t = 100(2\pi)\), that is

\[ \bigl(x(200\pi),y(200\pi)\bigr), \quad \bigl(x(202\pi),y(202\pi)\bigr), \quad \bigl(x(204\pi),y(204\pi)\bigr), \quad \bigl(x(206\pi),y(206\pi)\bigr), \quad \ldots \nonumber \]

The plot of these points is the Poincaré section. After plotting enough points, a curious pattern emerges in Figure \(\PageIndex{4}\) (the left hand picture), a so-called strange attractor.

Figure \(\PageIndex{4}\): Strange attractor. The left plot is with no phase shift, the right plot has phase shift \(\frac{\pi}{4}\).

If we have a sequence of points, then an attractor is a set towards which the points in the sequence eventually get closer and closer to, that is, they are attracted. The Poincaré section above is not really the attractor itself, but as the points are very close to it, we can see its shape. The strange attractor in the figure is a very complicated set, and it in fact has fractal structure, that is, if you would zoom in as far as you want, you would keep seeing the same complicated structure.

The initial condition does not really make any difference. If we started with different initial condition, the points would eventually gravitate towards the attractor, and so as long as we throw away the first few points, we always get the same picture.

An amazing thing is that a chaotic system such as the Duffing equation is not random at all. There is a very complicated order to it, and the strange attractor says something about this order. We cannot quite say what state the system will be in eventually, but given a fixed strobing frequency we can narrow it down to the points on the attractor.

If you would use a phase shift, for example \(\frac{\pi}{4}\), and look at the times

\[\frac{\pi}{4}, \quad 2\pi+\frac{\pi}{4}, \quad 4\pi+\frac{\pi}{4}, \quad 6\pi+\frac{\pi}{4}, \quad \ldots \nonumber \]

you would obtain a slightly different looking attractor. The picture is the right hand side of Figure \(\PageIndex{4}\). It is as if we had rotated, distorted slightly, and then moved the original. Therefore for each phase shift you can find the set of points towards which the system periodically keeps coming back to.

You should study the pictures and notice especially the scales---where are these attractors located in the phase plane. Notice the regions where the strange attractor lives and compare it to the plot of the trajectories in Figure \(\PageIndex{2}\).

Let us compare the discussion in this section to the discussion in Section 2.6 about forced oscillations. Take the equation

\[ x''+2p x' + \omega_0^2 x = \frac{F_0}{m} \cos (\omega t) . \nonumber \]

This is like the Duffing equation, but with no \(x^3\) term. The steady periodic solution is of the form

\[x = C \cos (\omega t + \gamma) . \nonumber \]

Strobing using the frequency \(\omega\) we would obtain a single point in the phase space. So the attractor in this setting is a single point---an expected result as the system is not chaotic. In fact it was the opposite of chaotic. Any difference induced by the initial conditions dies away very quickly, and we settle into always the same steady periodic motion.

Lorenz System

In two dimensions to have the kind of chaotic behavior we are looking for, we have to study forced, or non-autonomous, systems such as the Duffing equation. Due to the Poincaré-Bendoxson Theorem, if an autonomous two-dimensional system has a solution that exists for all time in the future and does not go towards infinity, then we obtain a limit cycle or a closed trajectory. Hardly the chaotic behavior we are looking for.

In three dimensions even autonomous systems can be chaotic. Let us very briefly return to the Lorenz system

\[ x' = -10x +10y, \qquad y' = 28x-y-xz, \qquad z'=-\frac{8}{3}z + xy . \nonumber \]

The Lorenz system is an autonomous system in three dimensions exhibiting chaotic behavior. See the Figure \(\PageIndex{5}\) for a sample trajectory, which is now a curve in three-dimensional space.

Figure \(\PageIndex{5}\): A trajectory in the Lorenz system.

The solutions will tend to an attractor in space, the so-called Lorenz attractor. In this case no strobing is necessary. Again we cannot quite see the attractor itself, but if we try to follow a solution for long enough, as in the figure, we will get a pretty good picture of what the attractor looks like. The Lorenz attractor is also a strange attractor and has a complicated fractal structure. And, just as for the Duffing equation, what we want to draw is not the whole trajectory, but start drawing the trajectory after a while, once it is close to the attractor.

The path is not just a repeating figure-eight. The trajectory will spin some seemingly random number of times on the left, then spin a number of times on the right, and so on. As this system arose in weather prediction, one can perhaps imagine a few days of warm weather and then a few days of cold weather, where it is not easy to predict when the weather will change, just as it is not really easy to predict far in advance when the solution will jump onto the other side. See Figure \(\PageIndex{6}\) for a plot of the \(x\) component of the solution drawn above. A negative \(x\) corresponds to the left "loop" and a positive \(x\) corresponds to the right "loop".

Figure \(\PageIndex{6}\): Graph of the \(x(t)\) component of the solution.

Most of the mathematics we studied in this book is quite classical and well understood. On the other hand, chaos, including the Lorenz system, continues to be the subject of current research. Furthermore, chaos has found applications not just in the sciences, but also in art.

Footnotes

[1] In fact for reference, 30,000 steps were used with the Runge–Kutta algorithm, see exercises in Section 1.7.

[2] Named for the French polymath Jules Henri Poincaré (1854-1912).