Search This Blog

Thursday, April 11, 2024

Differential equation

From Wikipedia, the free encyclopedia
https://en.wikipedia.org/wiki/Quadratic_irrational_number
Visualization of heat transfer in a pump casing, created by solving the heat equation. Heat is being generated internally in the casing and being cooled at the boundary, providing a steady state temperature distribution.

In mathematics, a differential equation is an equation that relates one or more unknown functions and their derivatives. In applications, the functions generally represent physical quantities, the derivatives represent their rates of change, and the differential equation defines a relationship between the two. Such relations are common; therefore, differential equations play a prominent role in many disciplines including engineering, physics, economics, and biology.

The study of differential equations consists mainly of the study of their solutions (the set of functions that satisfy each equation), and of the properties of their solutions. Only the simplest differential equations are soluble by explicit formulas; however, many properties of solutions of a given differential equation may be determined without computing them exactly.

Often when a closed-form expression for the solutions is not available, solutions may be approximated numerically using computers. The theory of dynamical systems puts emphasis on qualitative analysis of systems described by differential equations, while many numerical methods have been developed to determine solutions with a given degree of accuracy.

History

Differential equations came into existence with the invention of calculus by Isaac Newton and Gottfried Leibniz. In Chapter 2 of his 1671 work Methodus fluxionum et Serierum Infinitarum, Newton listed three kinds of differential equations:

In all these cases, y is an unknown function of x (or of x1 and x2), and f is a given function.

He solves these examples and others using infinite series and discusses the non-uniqueness of solutions.

Jacob Bernoulli proposed the Bernoulli differential equation in 1695. This is an ordinary differential equation of the form

for which the following year Leibniz obtained solutions by simplifying it.

Historically, the problem of a vibrating string such as that of a musical instrument was studied by Jean le Rond d'Alembert, Leonhard Euler, Daniel Bernoulli, and Joseph-Louis Lagrange.[5][6][7][8] In 1746, d’Alembert discovered the one-dimensional wave equation, and within ten years Euler discovered the three-dimensional wave equation.

The Euler–Lagrange equation was developed in the 1750s by Euler and Lagrange in connection with their studies of the tautochrone problem. This is the problem of determining a curve on which a weighted particle will fall to a fixed point in a fixed amount of time, independent of the starting point. Lagrange solved this problem in 1755 and sent the solution to Euler. Both further developed Lagrange's method and applied it to mechanics, which led to the formulation of Lagrangian mechanics.

In 1822, Fourier published his work on heat flow in Théorie analytique de la chaleur (The Analytic Theory of Heat), in which he based his reasoning on Newton's law of cooling, namely, that the flow of heat between two adjacent molecules is proportional to the extremely small difference of their temperatures. Contained in this book was Fourier's proposal of his heat equation for conductive diffusion of heat. This partial differential equation is now a common part of mathematical physics curriculum.

Example

In classical mechanics, the motion of a body is described by its position and velocity as the time value varies. Newton's laws allow these variables to be expressed dynamically (given the position, velocity, acceleration and various forces acting on the body) as a differential equation for the unknown position of the body as a function of time.

In some cases, this differential equation (called an equation of motion) may be solved explicitly.

An example of modeling a real-world problem using differential equations is the determination of the velocity of a ball falling through the air, considering only gravity and air resistance. The ball's acceleration towards the ground is the acceleration due to gravity minus the deceleration due to air resistance. Gravity is considered constant, and air resistance may be modeled as proportional to the ball's velocity. This means that the ball's acceleration, which is a derivative of its velocity, depends on the velocity (and the velocity depends on time). Finding the velocity as a function of time involves solving a differential equation and verifying its validity.

Types

Differential equations can be divided into several types. Apart from describing the properties of the equation itself, these classes of differential equations can help inform the choice of approach to a solution. Commonly used distinctions include whether the equation is ordinary or partial, linear or non-linear, and homogeneous or heterogeneous. This list is far from exhaustive; there are many other properties and subclasses of differential equations which can be very useful in specific contexts.

Ordinary differential equations

An ordinary differential equation (ODE) is an equation containing an unknown function of one real or complex variable x, its derivatives, and some given functions of x. The unknown function is generally represented by a variable (often denoted y), which, therefore, depends on x. Thus x is often called the independent variable of the equation. The term "ordinary" is used in contrast with the term partial differential equation, which may be with respect to more than one independent variable.

Linear differential equations are the differential equations that are linear in the unknown function and its derivatives. Their theory is well developed, and in many cases one may express their solutions in terms of integrals.

Most ODEs that are encountered in physics are linear. Therefore, most special functions may be defined as solutions of linear differential equations (see Holonomic function).

As, in general, the solutions of a differential equation cannot be expressed by a closed-form expression, numerical methods are commonly used for solving differential equations on a computer.

Partial differential equations

A partial differential equation (PDE) is a differential equation that contains unknown multivariable functions and their partial derivatives. (This is in contrast to ordinary differential equations, which deal with functions of a single variable and their derivatives.) PDEs are used to formulate problems involving functions of several variables, and are either solved in closed form, or used to create a relevant computer model.

PDEs can be used to describe a wide variety of phenomena in nature such as sound, heat, electrostatics, electrodynamics, fluid flow, elasticity, or quantum mechanics. These seemingly distinct physical phenomena can be formalized similarly in terms of PDEs. Just as ordinary differential equations often model one-dimensional dynamical systems, partial differential equations often model multidimensional systems. Stochastic partial differential equations generalize partial differential equations for modeling randomness.

Non-linear differential equations

A non-linear differential equation is a differential equation that is not a linear equation in the unknown function and its derivatives (the linearity or non-linearity in the arguments of the function are not considered here). There are very few methods of solving nonlinear differential equations exactly; those that are known typically depend on the equation having particular symmetries. Nonlinear differential equations can exhibit very complicated behaviour over extended time intervals, characteristic of chaos. Even the fundamental questions of existence, uniqueness, and extendability of solutions for nonlinear differential equations, and well-posedness of initial and boundary value problems for nonlinear PDEs are hard problems and their resolution in special cases is considered to be a significant advance in the mathematical theory (cf. Navier–Stokes existence and smoothness). However, if the differential equation is a correctly formulated representation of a meaningful physical process, then one expects it to have a solution.

Linear differential equations frequently appear as approximations to nonlinear equations. These approximations are only valid under restricted conditions. For example, the harmonic oscillator equation is an approximation to the nonlinear pendulum equation that is valid for small amplitude oscillations.

Equation order and degree

The order of the differential equation is the highest order of derivative of the unknown function that appears in the differential equation. For example, an equation containing only first-order derivatives is a first-order differential equation, an equation containing the second-order derivative is a second-order differential equation, and so on.

When it is written as a polynomial equation in the unknown function and its derivatives, its degree of the differential equation is, depending on the context, the polynomial degree in the highest derivative of the unknown function, or its total degree in the unknown function and its derivatives. In particular, a linear differential equation has degree one for both meanings, but the non-linear differential equation is of degree one for the first meaning but not for the second one.

Differential equations that describe natural phenomena almost always have only first and second order derivatives in them, but there are some exceptions, such as the thin-film equation, which is a fourth order partial differential equation.

Examples

In the first group of examples u is an unknown function of x, and c and ω are constants that are supposed to be known. Two broad classifications of both ordinary and partial differential equations consist of distinguishing between linear and nonlinear differential equations, and between homogeneous differential equations and heterogeneous ones.

  • Heterogeneous first-order linear constant coefficient ordinary differential equation:
  • Homogeneous second-order linear ordinary differential equation:
  • Homogeneous second-order linear constant coefficient ordinary differential equation describing the harmonic oscillator:
  • Heterogeneous first-order nonlinear ordinary differential equation:
  • Second-order nonlinear (due to sine function) ordinary differential equation describing the motion of a pendulum of length L:

In the next group of examples, the unknown function u depends on two variables x and t or x and y.

  • Homogeneous first-order linear partial differential equation:
  • Homogeneous second-order linear constant coefficient partial differential equation of elliptic type, the Laplace equation:
  • Homogeneous third-order non-linear partial differential equation, the KdV equation:

Existence of solutions

Solving differential equations is not like solving algebraic equations. Not only are their solutions often unclear, but whether solutions are unique or exist at all are also notable subjects of interest.

For first order initial value problems, the Peano existence theorem gives one set of circumstances in which a solution exists. Given any point in the xy-plane, define some rectangular region , such that and is in the interior of . If we are given a differential equation and the condition that when , then there is locally a solution to this problem if and are both continuous on . This solution exists on some interval with its center at . The solution may not be unique. (See Ordinary differential equation for other results.)

However, this only helps us with first order initial value problems. Suppose we had a linear initial value problem of the nth order:

such that

For any nonzero , if and are continuous on some interval containing , is unique and exists.

Related concepts

Connection to difference equations

The theory of differential equations is closely related to the theory of difference equations, in which the coordinates assume only discrete values, and the relationship involves values of the unknown function or functions and values at nearby coordinates. Many methods to compute numerical solutions of differential equations or study the properties of differential equations involve the approximation of the solution of a differential equation by the solution of a corresponding difference equation.

Applications

The study of differential equations is a wide field in pure and applied mathematics, physics, and engineering. All of these disciplines are concerned with the properties of differential equations of various types. Pure mathematics focuses on the existence and uniqueness of solutions, while applied mathematics emphasizes the rigorous justification of the methods for approximating solutions. Differential equations play an important role in modeling virtually every physical, technical, or biological process, from celestial motion, to bridge design, to interactions between neurons. Differential equations such as those used to solve real-life problems may not necessarily be directly solvable, i.e. do not have closed form solutions. Instead, solutions can be approximated using numerical methods.

Many fundamental laws of physics and chemistry can be formulated as differential equations. In biology and economics, differential equations are used to model the behavior of complex systems. The mathematical theory of differential equations first developed together with the sciences where the equations had originated and where the results found application. However, diverse problems, sometimes originating in quite distinct scientific fields, may give rise to identical differential equations. Whenever this happens, mathematical theory behind the equations can be viewed as a unifying principle behind diverse phenomena. As an example, consider the propagation of light and sound in the atmosphere, and of waves on the surface of a pond. All of them may be described by the same second-order partial differential equation, the wave equation, which allows us to think of light and sound as forms of waves, much like familiar waves in the water. Conduction of heat, the theory of which was developed by Joseph Fourier, is governed by another second-order partial differential equation, the heat equation. It turns out that many diffusion processes, while seemingly different, are described by the same equation; the Black–Scholes equation in finance is, for instance, related to the heat equation.

The number of differential equations that have received a name, in various scientific areas is a witness of the importance of the topic. See List of named differential equations.

Software

Some CAS software can solve differential equations. These are the commands used in the leading programs:

Laplace operator

From Wikipedia, the free encyclopedia
https://en.wikipedia.org/wiki/Laplace_operator
 
In mathematics, the Laplace operator or Laplacian is a differential operator given by the divergence of the gradient of a scalar function on Euclidean space. It is usually denoted by the symbols , (where is the nabla operator), or . In a Cartesian coordinate system, the Laplacian is given by the sum of second partial derivatives of the function with respect to each independent variable. In other coordinate systems, such as cylindrical and spherical coordinates, the Laplacian also has a useful form. Informally, the Laplacian Δf (p) of a function f at a point p measures by how much the average value of f over small spheres or balls centered at p deviates from f (p).

The Laplace operator is named after the French mathematician Pierre-Simon de Laplace (1749–1827), who first applied the operator to the study of celestial mechanics: the Laplacian of the gravitational potential due to a given mass density distribution is a constant multiple of that density distribution. Solutions of Laplace's equation Δf = 0 are called harmonic functions and represent the possible gravitational potentials in regions of vacuum.

The Laplacian occurs in many differential equations describing physical phenomena. Poisson's equation describes electric and gravitational potentials; the diffusion equation describes heat and fluid flow; the wave equation describes wave propagation; and the Schrödinger equation describes the wave function in quantum mechanics. In image processing and computer vision, the Laplacian operator has been used for various tasks, such as blob and edge detection. The Laplacian is the simplest elliptic operator and is at the core of Hodge theory as well as the results of de Rham cohomology.

Definition

The Laplace operator is a second-order differential operator in the n-dimensional Euclidean space, defined as the divergence () of the gradient (). Thus if is a twice-differentiable real-valued function, then the Laplacian of is the real-valued function defined by:

 

 

 

 

(1)

where the latter notations derive from formally writing:

Explicitly, the Laplacian of f is thus the sum of all the unmixed second partial derivatives in the Cartesian coordinates xi:

 

 

 

 

(2)

As a second-order differential operator, the Laplace operator maps Ck functions to Ck−2 functions for k ≥ 2. It is a linear operator Δ : Ck(Rn) → Ck−2(Rn), or more generally, an operator Δ : Ck(Ω) → Ck−2(Ω) for any open set Ω ⊆ Rn.

Motivation

Diffusion

In the physical theory of diffusion, the Laplace operator arises naturally in the mathematical description of equilibrium. Specifically, if u is the density at equilibrium of some quantity such as a chemical concentration, then the net flux of u through the boundary V of any smooth region V is zero, provided there is no source or sink within V:

where n is the outward unit normal to the boundary of V. By the divergence theorem,

Since this holds for all smooth regions V, one can show that it implies:

The left-hand side of this equation is the Laplace operator, and the entire equation Δu = 0 is known as Laplace's equation. Solutions of the Laplace equation, i.e. functions whose Laplacian is identically zero, thus represent possible equilibrium densities under diffusion.

The Laplace operator itself has a physical interpretation for non-equilibrium diffusion as the extent to which a point represents a source or sink of chemical concentration, in a sense made precise by the diffusion equation. This interpretation of the Laplacian is also explained by the following fact about averages.

Averages

Given a twice continuously differentiable function and a point . Then, the average value of over the ball with radius centered at is:

Similarly, the average value of over the sphere (the boundary of a ball) with radius centered at is:

Density associated with a potential

If φ denotes the electrostatic potential associated to a charge distribution q, then the charge distribution itself is given by the negative of the Laplacian of φ:

where ε0 is the electric constant.

This is a consequence of Gauss's law. Indeed, if V is any smooth region with boundary V, then by Gauss's law the flux of the electrostatic field E across the boundary is proportional to the charge enclosed:

where the first equality is due to the divergence theorem. Since the electrostatic field is the (negative) gradient of the potential, this gives:

Since this holds for all regions V, we must have

The same approach implies that the negative of the Laplacian of the gravitational potential is the mass distribution. Often the charge (or mass) distribution are given, and the associated potential is unknown. Finding the potential function subject to suitable boundary conditions is equivalent to solving Poisson's equation.

Energy minimization

Another motivation for the Laplacian appearing in physics is that solutions to Δf = 0 in a region U are functions that make the Dirichlet energy functional stationary:

To see this, suppose f : UR is a function, and u : UR is a function that vanishes on the boundary of U. Then:

where the last equality follows using Green's first identity. This calculation shows that if Δf = 0, then E is stationary around f. Conversely, if E is stationary around f, then Δf = 0 by the fundamental lemma of calculus of variations.

Coordinate expressions

Two dimensions

The Laplace operator in two dimensions is given by:

In Cartesian coordinates,

where x and y are the standard Cartesian coordinates of the xy-plane.

In polar coordinates,

where r represents the radial distance and θ the angle.

Three dimensions

In three dimensions, it is common to work with the Laplacian in a variety of different coordinate systems.

In Cartesian coordinates,

In cylindrical coordinates,

where represents the radial distance, φ the azimuth angle and z the height.

In spherical coordinates:

or
by expanding the first term, these expressions read
where φ represents the azimuthal angle and θ the zenith angle or co-latitude.

In general curvilinear coordinates (ξ1, ξ2, ξ3):

where summation over the repeated indices is implied, gmn is the inverse metric tensor and Γl mn are the Christoffel symbols for the selected coordinates.

N dimensions

In arbitrary curvilinear coordinates in N dimensions (ξ1, ..., ξN), we can write the Laplacian in terms of the inverse metric tensor, :

from the Voss-Weyl formula[3] for the divergence.

In spherical coordinates in N dimensions, with the parametrization x = RN with r representing a positive real radius and θ an element of the unit sphere SN−1,

where ΔSN−1 is the Laplace–Beltrami operator on the (N − 1)-sphere, known as the spherical Laplacian. The two radial derivative terms can be equivalently rewritten as:

As a consequence, the spherical Laplacian of a function defined on SN−1RN can be computed as the ordinary Laplacian of the function extended to RN∖{0} so that it is constant along rays, i.e., homogeneous of degree zero.

Euclidean invariance

The Laplacian is invariant under all Euclidean transformations: rotations and translations. In two dimensions, for example, this means that:

for all θ, a, and b. In arbitrary dimensions,
whenever ρ is a rotation, and likewise:
whenever τ is a translation. (More generally, this remains true when ρ is an orthogonal transformation such as a reflection.)

In fact, the algebra of all scalar linear differential operators, with constant coefficients, that commute with all Euclidean transformations, is the polynomial algebra generated by the Laplace operator.

Spectral theory

The spectrum of the Laplace operator consists of all eigenvalues λ for which there is a corresponding eigenfunction f with:

This is known as the Helmholtz equation.

If Ω is a bounded domain in Rn, then the eigenfunctions of the Laplacian are an orthonormal basis for the Hilbert space L2(Ω). This result essentially follows from the spectral theorem on compact self-adjoint operators, applied to the inverse of the Laplacian (which is compact, by the Poincaré inequality and the Rellich–Kondrachov theorem). It can also be shown that the eigenfunctions are infinitely differentiable functions. More generally, these results hold for the Laplace–Beltrami operator on any compact Riemannian manifold with boundary, or indeed for the Dirichlet eigenvalue problem of any elliptic operator with smooth coefficients on a bounded domain. When Ω is the n-sphere, the eigenfunctions of the Laplacian are the spherical harmonics.

Vector Laplacian

The vector Laplace operator, also denoted by , is a differential operator defined over a vector field. The vector Laplacian is similar to the scalar Laplacian; whereas the scalar Laplacian applies to a scalar field and returns a scalar quantity, the vector Laplacian applies to a vector field, returning a vector quantity. When computed in orthonormal Cartesian coordinates, the returned vector field is equal to the vector field of the scalar Laplacian applied to each vector component.

The vector Laplacian of a vector field is defined as

This definition can be seen as the Helmholtz decomposition of the vector Laplacian.

In Cartesian coordinates, this reduces to the much simpler form as

where , , and are the components of the vector field , and just on the left of each vector field component is the (scalar) Laplace operator. This can be seen to be a special case of Lagrange's formula; see Vector triple product.

For expressions of the vector Laplacian in other coordinate systems see Del in cylindrical and spherical coordinates.

Generalization

The Laplacian of any tensor field ("tensor" includes scalar and vector) is defined as the divergence of the gradient of the tensor:

For the special case where is a scalar (a tensor of degree zero), the Laplacian takes on the familiar form.

If is a vector (a tensor of first degree), the gradient is a covariant derivative which results in a tensor of second degree, and the divergence of this is again a vector. The formula for the vector Laplacian above may be used to avoid tensor math and may be shown to be equivalent to the divergence of the Jacobian matrix shown below for the gradient of a vector:

And, in the same manner, a dot product, which evaluates to a vector, of a vector by the gradient of another vector (a tensor of 2nd degree) can be seen as a product of matrices:

This identity is a coordinate dependent result, and is not general.

Use in physics

An example of the usage of the vector Laplacian is the Navier-Stokes equations for a Newtonian incompressible flow:

where the term with the vector Laplacian of the velocity field represents the viscous stresses in the fluid.

Another example is the wave equation for the electric field that can be derived from Maxwell's equations in the absence of charges and currents:

This equation can also be written as:

where
is the D'Alembertian, used in the Klein–Gordon equation.

Generalizations

A version of the Laplacian can be defined wherever the Dirichlet energy functional makes sense, which is the theory of Dirichlet forms. For spaces with additional structure, one can give more explicit descriptions of the Laplacian, as follows.

Laplace–Beltrami operator

The Laplacian also can be generalized to an elliptic operator called the Laplace–Beltrami operator defined on a Riemannian manifold. The Laplace–Beltrami operator, when applied to a function, is the trace (tr) of the function's Hessian:

where the trace is taken with respect to the inverse of the metric tensor. The Laplace–Beltrami operator also can be generalized to an operator (also called the Laplace–Beltrami operator) which operates on tensor fields, by a similar formula.

Another generalization of the Laplace operator that is available on pseudo-Riemannian manifolds uses the exterior derivative, in terms of which the "geometer's Laplacian" is expressed as

Here δ is the codifferential, which can also be expressed in terms of the Hodge star and the exterior derivative. This operator differs in sign from the "analyst's Laplacian" defined above. More generally, the "Hodge" Laplacian is defined on differential forms α by

This is known as the Laplace–de Rham operator, which is related to the Laplace–Beltrami operator by the Weitzenböck identity.

D'Alembertian

The Laplacian can be generalized in certain ways to non-Euclidean spaces, where it may be elliptic, hyperbolic, or ultrahyperbolic.

In Minkowski space the Laplace–Beltrami operator becomes the D'Alembert operator or D'Alembertian:

It is the generalization of the Laplace operator in the sense that it is the differential operator which is invariant under the isometry group of the underlying space and it reduces to the Laplace operator if restricted to time-independent functions. The overall sign of the metric here is chosen such that the spatial parts of the operator admit a negative sign, which is the usual convention in high-energy particle physics. The D'Alembert operator is also known as the wave operator because it is the differential operator appearing in the wave equations, and it is also part of the Klein–Gordon equation, which reduces to the wave equation in the massless case.

The additional factor of c in the metric is needed in physics if space and time are measured in different units; a similar factor would be required if, for example, the x direction were measured in meters while the y direction were measured in centimeters. Indeed, theoretical physicists usually work in units such that c = 1 in order to simplify the equation.

The d'Alembert operator generalizes to a hyperbolic operator on pseudo-Riemannian manifolds.

Representation of a Lie group

From Wikipedia, the free encyclopedia https://en.wikipedia.org/wiki/Representation_of_a_Lie_group...