Chapter 9
Differential equations

Context: Most of the phenomena we encounter in engineering are very well described by differential equations. We remember the discrete network models from electrical engineering and systems theory. They are described by a system of linear ordinary differential equations with time as an independent variable. described. We also remember the diffusion process, such as the heat transport in a component on a heat sink that is exposed to a heat source. This phenomenon is best described using a partial differential equation (partial differential equation). In this chapter, we deal with an abstract classification of differential equations. The diffusion process will be repeated in more detail in the next chapter.

9.1 Ordinary differential equations

We recall the classification (properties) of ordinary differential equations (ODEs) and recognize the different types of differential equations. For all these differential equations, we are always interested in a solution for a certain initial value (or boundary value), e.g. \(x(t=0)=x_0\) etc. This initial value is always part of the definition of the differential equation.

9.1.1 Linearity

A linear differential equation is, for example \begin {equation} m\ddot {x}(t)+c\dot {x}(t)+kx=f(t) \label {eq:linear} \end {equation} which describes the damped and driven harmonic oscillator, while \begin {equation} \frac {\dif ^2x}{\dif t^2}+\mu (x^2-1)\frac {\dif x}{\dif t}+x= 0 \label {eq:nonlinear} \end {equation} is a non-linear equation of motion for \(x\). It describes the so-called van der Pol oscillator. The non-linearity can be recognized here by the fact that \(x^2\) multiplies the derivative \(\dif x/\dif t\).

Note: The first or higher order derivative is a linear operation, since \begin {equation} \frac {\dif ^n}{\dif x^n} \lambda f(x) = \lambda \frac {\dif ^n}{\dif x^n} f(x) \end {equation} for a constant \(\lambda \) and \begin {equation} \frac {\dif ^n}{\dif x^n} \left [f(x) + g(x)\right ] = \frac {\dif ^n}{\dif x^n} f(x) + \frac {\dif ^n}{\dif x^n} g(x). \end {equation} Time derivatives are displayed with a dot, \begin {equation} \dot {x}(t)=\frac {\dif }{\dif t} x(t). \end {equation} For functions of a variable, the derivative is often displayed with a dash, \begin {equation} f'(x)=\frac {\dif }{\dif x} f(x). \end {equation} This is no longer possible for functions with several variables. We will therefore always explicitly use the differential operator here.

9.1.2 Order

The order of a differential equation is given by the highest derivative that appears in the equation. Eq. \eqref{eq:linear} and Eq. \eqref{eq:nonlinear} are examples of second-order differential equations.

9.1.3 Systems

A system of first-order differential equations is formed, for example, by the equations \begin {align} \frac {\dif x}{\dif t} =& x(m - n y), \label {eq:sys1} \\ \frac {\dif y}{\dif t} =& - y(\gamma - \delta x), \label {eq:sys2} \end {align}

the well-known Räuber-Beute equations or Lotka-Volterra equations. Equations \eqref{eq:sys1} and \eqref{eq:sys2} are still non-linear.

Differential equations of higher order can be rewritten into a system of 1st order equations. In the example of the damped harmonic oscillator, \begin {equation} m\ddot {x}(t)+c\dot {x}(t)+kx=f(t), \end {equation} we replace \(\dot {x} = y\) and thus obtain two first-order equations instead of the original second-order equation, namely \begin {align} \dot {x} =& y \\ m\dot {y} =& -cy-kx+f(t) \end {align}

9.2 Partial differential equations

Partial differential equations (PDEs) are differential equations with more than one independent variable. As an example, we imagine a time-dependent heat transport problem in one dimension. This is represented by a diffusion equation for the local temperature of the system. The temperature is therefore represented as a function of two independent variables, the time \(t\) and the spatial position \(x\), \(T(x, t)\). The time evolution of the temperature is given by \begin {equation} \frac {\partial T(x,t)}{\partial t}=\kappa \frac {\partial ^2 T(x,t)}{\partial x^2}, \label {eq:heateq} \end {equation} where \(\kappa \) denotes the heat conduction coefficient. This equation was developed by Joseph Fourier (*1768, \(\dagger \)1830), whom we will encounter again during this course.

Note: In Eq. \eqref{eq:heateq}\(\partial /\partial t\) denotes the partial derivative. This is the derivative with respect to one of the arguments (here \(t\)), i.e. the variation of the function if all other arguments are kept constant. With ODEs, in contrast to PDEs, only derivatives with respect to one variable (usually the time \(t\)) occur, which are then denoted by the differential operator \(\dif /\dif t\).

9.2.1 First order

Quasilinear PDEs of the first order, i.e. equations of the form \begin {equation} P(x,t;u)\frac {\partial u(x,t)}{\partial x}+ Q(x,t;u)\frac {\partial u(x,t)}{\partial t}= R(x,t;u), \label {eq:PDE1Oquasi} \end {equation} for an (unknown) function \(u(x,t)\) and the initial condition \(u(x,t=0)=u_0(x)\) can be systematically traced back to a system of coupled first-order ODEs. We want to investigate this important property.

Note: In Eq. \eqref{eq:PDE1Oquasi} a representation with two variables \(x\) and \(t\) was chosen for illustration. In general, we can write \begin {equation} \sum \limits _i P_i(\{x_i\};u)\frac {\partial u(\{x_i\})}{\partial x_i}= R(\{x_i\};u) \end {equation} The notation used here is \(u(\{x_i\})=u(x_0, x_1, x_2, \ldots )\), i.e. the curly brackets denote all degrees of freedom \(x_i\).

Equation \eqref{eq:PDE1Oquasi} can be transformed to a system of ODEs. This is called the method of characteristics. We can then apply the formalisms (analytical or numerical) for solving systems of ODEs that we learned about in the lecture “Differential Equations”.

We proceed as follows:

  1. First, we parameterize the independent variables in Eq. \eqref{eq:PDE1Oquasi} with a parameter \(s\) according to \(x(s)\) and \(t(s)\).
  2. We then form the total derivative of \(u(x(s),t(s))\) to \(s\) \begin {equation} \frac {\dif u(x(s),t(s))}{\dif s}= \frac {\partial u(x(s),t(s))}{\partial x}\frac {\dif x(s)}{\dif s}+ \frac {\partial u(x(s),t(s))}{\partial t}\frac {\dif t(s)}{\dif s}. \label {eq:totalderiv} \end {equation}
  3. By comparing the coefficients of the total derivative \eqref{eq:totalderiv} with the PDE \eqref{eq:PDE1Oquasi}, you can see that this DGL is solved exactly when \begin {align} \frac {dx(s)}{ds}&=P(x,t,u),\label {eq:transode1}\\\ \frac {dt(s)}{ds}&=Q(x,t,u)\quad \text {und}\\ \frac {du(s)}{ds} &= R(u(s)).\label {eq:transode3} \end {align}

    is fulfilled. This describes the solution along certain curves in the \((x,t)\)-plane.

We have thus converted the PDE into a set of coupled first-order ODEs, Eq. \eqref{eq:transex1}-\eqref{eq:transex3}.

Example: The transport equation \begin {equation} \frac {\partial u(x,t)}{\partial t}+c\frac {\partial u(x,t)}{\partial x}=0 \label {eq:transportexample} \end {equation} with the initial condition \(u(x,t=0)=u_0(x)\) is to be solved. We proceed according to the recipe above:

  1. We parameterize the variables \(x\) and \(t\) with the help of a new variable \(s\), i.e. \(x(s)\) and \(t(s)\). We are now looking for an expression with which we can determine \(x(s)\) and \(t(s)\).
  2. We now ask how the function \(u(x(s),t(s))\) behaves. This function describes the change in an initial value \(u(x(0),t(0))\) with the variable \(s\). The total derivative becomes \begin {equation} \frac {\dif u(x(s),t(s))}{\dif s}=\frac {\partial u}{\partial t}\frac {\dif t(s)}{\dif s}+\frac {\partial u}{\partial x}\frac {\dif x(s)}{\dif s}. \end {equation}
  3. The total derivative is identical to the partial differential equation that we want to solve if \begin {align} \frac {\dif x(s)}{\dif s} &=c\quad \text {and} \label {eq:transex1}\\ \frac {\dif t(s)}{\dif s} &=1. \end {align}

    In this case, the following applies \begin {equation} \frac {\dif u(s)}{\dif s} = 0.\label {eq:transex3} \end {equation}

  4. The general solutions for the three ordinary differential equations \eqref{eq:transex1}-\eqref{eq:transex3} are given by \begin {align} x(s) &= cs + \text {const.},\\ t(s) &= s + \text {const.}\quad \text {and}\\ u(s) &= \text {const.} \end {align}
  5. With the initial conditions \(t(0)=0\), \(x(0)=\xi \) and \(u(x,t=0)=f(\xi )\) you get \(t=s\), \(x=ct+\xi \) and \(u=f(\xi )=f(x-ct)\),

The initial condition \(f(\xi )\) is transported with the speed \(c\) in the positive x-direction. The solution for \(u\) remains constant, as the derivative of \(u\) is zero, so \(u\) retains the value given by the initial condition. The field \(u(x,0)\) is therefore shifted at a constant speed \(c\): \(u(x,t)=u(x-ct,0)\).

9.2.2 Second order

Examples of second-order PDEs are the...

  • ...wave equation: \begin {equation} \frac {\partial ^2 u}{\partial t^2}-\frac {\partial ^2 u}{\partial x^2}=0 \end {equation}
  • ...diffusion equation (which we will look at in more detail here): \begin {equation} \frac {\partial u}{\partial t}-\frac {\partial ^2 u}{\partial x^2}=0 \end {equation}
  • ...Laplace equation (which we will also get to know better): \begin {equation} \frac {\partial ^2 u}{\partial x^2}+\frac {\partial ^2 u}{\partial y^2}=0 \end {equation}

The second order here refers to the second derivative. These examples are formulated for two variables, but these differential equations can also be written down for more degrees of freedom.

For two variables, the general form of second-order linear PDEs is \begin {equation} a(x,y) \frac {\partial ^2 u}{\partial x^2}+ b(x,y)\frac {\partial ^2 u}{\partial x\partial y}+ c(x,y)\frac {\partial ^2 u}{\partial y^2}=F\left (x,y;u,\frac {\partial u}{\partial x},\frac {\partial u}{\partial y}\right ), \end {equation} where \(F\) itself must of course also be linear in the arguments if the entire equation is to be linear. We now classify 2nd order PDEs, but note that this classification is not exhaustive and that it only applies pointwise. The latter means that the PDE can fall into a different classification at different points in space.

We first assume that \(F=0\) and \(a\), \(b\), \(c\) are constant. Then we get: \begin {equation} a\frac {\partial ^2 u}{\partial x^2}+b\frac {\partial ^2 u}{\partial x\partial y}+ c\frac {\partial ^2 u}{\partial y^2}=0. \label {eq:n2ndoconst} \end {equation} We rewrite this equation as the quadratic form \begin {equation} \begin {pmatrix} \partial /\partial x \\ \partial /\partial y \end {pmatrix} \cdot \begin {pmatrix} a & b/2 \\ b/2 & c \end {pmatrix} \cdot \begin {pmatrix} \partial /\partial x \\ \partial /\partial y \end {pmatrix} u = \nabla \cdot \t {C} \cdot \nabla u =0 \label {eq:quadform} \end {equation} We can now diagonalize the coefficient matrix \(\t {C}\). This for to \begin {equation} \t {C} = \t {U} \cdot \begin {pmatrix} \lambda _1 & 0 \\ 0 & \lambda _2 \end {pmatrix}\cdot \t {U}^T, \label {eq:diagquadform} \end {equation} where \(\t {U}\) is unitary due to the symmetry of \(\t {C}\), \(\t {U}^T \cdot \t {U}=\t {1}\). The geometric interpretation of the operation \(\t {U}\) is a rotation. We now introduce transformed coordinates \(x'\) and \(y'\) so that \begin {equation} \nabla = \t {U} \cdot \nabla ' \end {equation} with \(\nabla '=(\partial /\partial x', \partial /\partial y')\). In other words, the transformation matrix is given as \begin {equation} \t {U} = \begin {pmatrix} \partial x'/\partial x & \partial y'/\partial x \\ \partial x'/\partial y & \partial y'/\partial y \end {pmatrix}. \end {equation} Equation \eqref{eq:n2ndoconst} becomes \begin {equation} \lambda _1 \frac {\partial ^2 u}{\partial x'^2} + \lambda _2 \frac {\partial ^2 u}{\partial y'^2} = 0. \label {eq:diag2nd} \end {equation} We have diagonalized the coefficients of the differential equation. For any twice differentiable function \(f(z)\), is \begin {equation} u(x', y') = f\left (\sqrt {\lambda _2} x' + i\sqrt {\lambda _1} y'\right ) \end {equation} a solution of Eq. \eqref{eq:diag2nd}.

The analytical expression for the eigenvalues is:

We now distinguish three cases:

  • The case \(\det \t {C}=\lambda _1\lambda _2=ac-b^4/4=0\) with \(b\ne 0\) and \(a\ne 0\) leads to a parabolic PDE. This PDE is called parabolic because the quadratic form Eq. \eqref{eq:quadform} or \eqref{eq:diagquadform} describes a parabola. (This is of course an analogy. You have to replace the differential operators with coordinates for this to work). Without restriction of generality, let \(\lambda _2=0\). Then we get \begin {equation} \frac {\partial ^2 u}{\partial x'^2}=0. \label {eqnparab} \end {equation} This is the canonical form of a parabolic PDE.
  • The case \(\det \t {C}=\lambda _1 \lambda _2=ac-b^2/4>0\) leads to an elliptic PDE. This PDE is called elliptic because the quadratic form Eq. \eqref{eq:quadform} or \eqref{eq:diagquadform} describes an ellipse for a constant right-hand side. (For \(\lambda _1=\lambda _2\) it is a circle). We now convert the equation for the elliptical case to a standardized form and introduce the scaled coordinates \(x'=\sqrt {\lambda _1} x''\) and \(y'=\sqrt {\lambda _2} y''\). Eq. \eqref{eq:diag2nd} then becomes the canonical elliptic PDE \begin {equation} \frac {\partial ^2 u}{\partial x''^2}+\frac {\partial ^2 u}{\partial y''^2}=0. \label {eqnelliptic} \end {equation} The canonical elliptic PDE is therefore the Laplace equation, Eq. \eqref{eqnelliptic} (here in two dimensions). Solutions of the Laplace equation are called harmonic functions.
  • The case \(\det \t {C}=\lambda _1\lambda _2=ac-b^2/4<0\) results in the so-called hyperbolic PDE. This PDE is called hyperbolic because the quadratic form Eq. \eqref{eq:quadform} or \eqref{eq:diagquadform} for a constant right-hand side describes a hyperbola. Without restricting the generality, we now require \(\lambda _1>0\) and \(\lambda _2<0\). Then we can again introduce scaled coordinates \(x'=\sqrt {\lambda _1}x''\) and \(y'=\sqrt {-\lambda _2}y''\) so that \begin {equation} \frac {\partial ^2 u}{\partial x''^2} - \frac {\partial ^2 u}{\partial y''^2} = \begin {pmatrix} \partial u/\partial x'' \\ \partial u/\partial y'' \end {pmatrix} \cdot \begin {pmatrix} 1 & 0 \\ 0 & -1 \end {pmatrix} \cdot \begin {pmatrix} \partial u/\partial x'' \\ \partial u/\partial y'' \end {pmatrix} = 0. \label {eq:hyb} \end {equation} We can now use a further coordinate transformation, namely a rotation by \(45^\circ \), to bring the coefficient matrix in Eq. \eqref{eq:hyb} to a form in which the diagonal elements are \(0\) and the secondary diagonal elements are \(1\). This results in the differential equation \begin {equation} \frac {\partial ^2 u}{\partial x''' \partial y'''}=0, \label {eqnd2udxideta0} \end {equation} where \(x''''\) and \(y''''\) are the corresponding rotated coordinates. This equation is the canonical form of a hyperbolic PDE and is equivalent to Eq. \eqref{eq:n2ndoconst} in the new variables \(x'''\) and \(y'''\).

For higher dimensional problems, we need to look at the eigenvalues of the coefficient matrix \(\t {C}\). The PDE is called parabolic if there is an eigenvalue that vanishes, but all other eigenvalues are either greater or less than zero. The PDE is called elliptic if all eigenvalues are either greater than zero or less than zero. The PDE is called hyperbolic if there is exactly one negative eigenvalue and all others are positive or if there is exactly one positive eigenvalue and all others are negative. It is clear that for PDEs with more than two variables, these three classes of PDEs are not exhaustive and there are coefficient matrices that fall outside this classification scheme. For problems with exactly two variables, this classification leads to the conditions for the determinants of the coefficient matrix mentioned above.

These three types of 2nd-order linear PDEs can also be solved analytically for some problems. In the following, we give an example of this.

Example: We solve the one-dimensional wave equation. \begin {equation} \frac {\partial ^2 u}{\partial x^2}-\frac {1}{c^2}\frac {\partial ^2 u}{\partial t^2}=0 \label {eqn1Dwaveeqn} \end {equation} by separating the variables. To do this, we take the approach \(u(x,t)=X(x)T(t)\), which leads to \begin {equation} \frac {1}{X}\frac {\partial ^2 X}{\partial x^2}=\frac {1}{c^2}\frac {1}{T}\frac {\partial ^2 T}{\partial t^2}. \label {eqnseparate} \end {equation} In Eq. \eqref{eqnseparate}, the left-hand side depends only on the variable \(x\), while the right-hand side depends only on \(t\). For any \(x\) and \(t\), this equation can only be fulfilled if both sides are equal to a constant and we thus obtain \begin {equation} \frac {1}{X}\frac {\partial ^2 X}{\partial x^2}=-k^2=\frac {1}{c^2}\frac {1}{T}\frac {\partial ^2 T}{\partial t^2}\,\mathrm {.} \end {equation} This results in the following two equations \[\frac {\partial ^2 X}{\partial x^2}+k^2X=0\] with the solution \(X(x)=e^{\pm ikx}\) and \[\frac {\partial ^2 T}{\partial t^2}+\omega ^2T=0\] with the solution \(T(t)=e^{\pm i\omega t}\), where we have set \(\omega ^2=c^2k^2\). have set. This example needs initial conditions to be completed so that we can can find a solution.

Bibliography


Copyright © 2017-2024 Andreas Greiner, 2014-2016 Till Junge, 2024 Martin Ladecky, 2020-2024 Lars Pastewka.