Deep Learning Math  ·  Chapter 03

Differential Equations

the rules that grow the future

You almost never get handed the future. What you get is a rule — how fast things change right now, based on how they are right now. A differential equation is that rule. The astonishing part: from it, you can unfold what happens next.

SCROLL
The problem · the rule is all you have

What if you can't write down the answer — only how it changes?

Picture a colony of rabbits. You can't write a tidy formula for “how many rabbits on day 200.” But you can say something obvious: the more rabbits there are, the faster new rabbits arrive. The rate of change depends on the current amount. That sentence is a differential equation.

It's a strange kind of riddle: the thing you want to know is tangled up in its own rate of change. Money earning interest, a cooling cup of coffee, a falling stone, a spreading rumor — none of them come with a formula for the future. They come with a rule for the present.

The picture · a map of next steps

The rule paints an arrow at every point. You just follow them.

Here is the move that makes it intuitive. At every spot on the graph, the rule tells you which way to step next — a tiny arrow. Cover the whole plane in these arrows and you get a field of currents, like wind on a weather map.

Now drop a leaf anywhere — that's your starting condition — and let it ride the current. The path it traces is the future, threaded out of the rule. Move the leaf below, and reshape the wind, and watch a whole family of possible futures appear.

time →
the rule {{ ruleDisplay }}
start {{ startDisplay }}
future {{ futureDisplay }}
the leaf
the wind

drag the leaf to pick a starting point; bend the wind from decay to growth. one rule, infinitely many futures — you choose which by where you begin.

You just solved one

A solution isn't a number. It's a whole story.

Notice what “solving” meant: not finding a value, but finding an entire curve — a function that obeys the rule at every instant. And there wasn't one solution but a family of them, one for each place you could start. Pin down the starting point, and a single future snaps into focus.

That faithful arrow-following even has a name: Euler's method. Take a tiny step in the arrow's direction, look at the new arrow, step again. Repeat enough times and you've drawn the future by hand — which is exactly what a computer does to forecast weather or fly a rocket.

Who built this

The day the universe became an equation.

portrait:
Isaac Newton
~1687

When Newton wrote “force equals mass times acceleration,” he wasn't writing a number — acceleration is a rate of change of a rate of change. F = ma is a differential equation. Suddenly the motion of every planet, tide, and cannonball was the solution to one.

portrait:
Leonhard Euler
~1768

A century later Leonhard Euler — the most prolific mathematician who ever lived, working much of it blind — turned the arrow-following into a method anyone could compute by hand. The Bernoullis, Lagrange, and others built a whole machinery for unfolding these rules. It became the language physics is written in.

It led one mathematician, Laplace, to a dizzying thought: if you knew every rule and every starting point, you could in principle compute the entire future of the cosmos. The universe as one enormous differential equation, quietly solving itself.

Where you'll meet it again

This is how AI dreams up images.

The most striking modern use of differential equations is the one behind today's image and science models.

Diffusion models

Image generators start from pure noise and follow a learned rule, step by step, until a picture emerges. That's a leaf riding a current — solving a differential equation from chaos to a clean image. The same trick now powers weather and science foundation models.

Neural ODEs

Some networks replace their stacked layers with a single differential equation, letting depth become continuous. The network is the rule; a solver does the rest.

In the real world

Epidemics (the famous SIR model), climate, drug levels in your blood, circuits, predator and prey, the swing of a bridge — all forecast by following the arrows.

Now the symbols can't scare you

One short line. You've already lived it.

Hover or tap each piece.

dy/dt = k · y
{{ termTitle }}

{{ termBody }}

Read it aloud and it's just a sentence: “how fast y grows equals some rate times how much y there already is.” The more you have, the faster it grows. That one line is compound interest, runaway populations, and radioactive decay — all at once, depending only on the sign of the wind.