We like to describe and understand the way things change. The mathematical approach of evolution processes usually consists in a description of the state of a given system at a given time together with a rule telling us how this state changes with time. The formulation of these rules is often quite complicated.
To give an example (you do not need to undestand the details!), we can describe the state of fluid of constant density in terms of a the velocity of the fluid at a position and a time t, and the pressure . Since we will not use these equations in a detailed way, the intuitive meaning of density, velocity and pressure will be sufficient. The evolution of the system can in principle be determined by solving a partial differential equation (PDE) known as the Navier-Stockes equation
The symbols and are called partial derivatives. They tell us how the quantities on which they are applied change in space and time. The use of boldface characters such as indicates a collection of variables, or more precisely a vector. PDE are very useful to describe concrete systems but they are usually very difficult to solve and we will discuss more ``idealized'' examples.
A simpler type of evolution is the classical mechanics description of the motion of point-like objects, where the state of one object can be described by a finite number of variables: the instantaneous position and velocity . The time evolution of such a system is described by ordinary differential equations (ODE). In the case of a single particle the ODE can be written
where f is related to forces acting on the object and is the time derivative, it tells us how the quantities on which it is applied change in time. ODE are discussed in the section 3 of Part 1 of the course. Using a computer, one can solve ODE numerically. It is usually not too difficult for a sufficiently short amount of time.
In the two above examples of evolution, time flows continuously. On the other hand, one can also observe the state of the system at discrete time and labels the successive observations with . If as in the ODE case, it is possible to specify the state of the system with a finite number of variables, one might try to find a rule of evolution where the state of the system at the n-th observation (denoted ) is all we need to know to predict the state of the system at the n+1-th observation (denoted ). Such rule of evolution can be written
That such a law exists is not a totally absurd assumption. Indeed, some numerical solutions of ODE can be written in the form of Eq.(4). The rule of evolution of Eq.(4) is clearly deterministic. If we know the function and then is uniquely fixed.
An important question which we want to address is the following. Given the fact that we can only know the state of the system at initial time with a limited precision, can we predict reliably the future of the system after an arbitrarily long time? And if not, is it nevertheless possible to say something useful about the evolution? Similar questions can be addressed for ODE or PDE.
Instead of starting with ODE or PDE, we shall first learn some basic concepts with simple examples which do not require calculus. In these examples, the state of a system is characterized by one or two numbers and a simple deterministic rule fixes its evolution. In the fifth example discussed, a probabilistic approach will be necessary. In other words, the best question we can ask is: what is the chance that the system is in a given state? The concepts developed with these examples will reappear naturally in the the description of systems with continuous evolution (based on differential equations), in particular Newtonian mechanics.