Differential operators

-


Given the function \(f(x,y)\), we have considered its partial derivatives, such as

\[\begin{eqnarray*} f_x(x,y) &=&\frac{\partial}{\partial x}f(x,y),\\ f_y(x,y) &=&\frac{\partial}{\partial y}f(x,y). \end{eqnarray*}\]

We may interpret partial differentiation in the following manner:

The derivative \(f_x(x,y)\) is obtained by applying \(\frac{\partial}{\partial x}\) to the function \(f(x,y)\) from the left.

\(\frac{\partial}{\partial x}\) is neither a number nor a function. It's something different that we call a (partial) differential operator. The same argument applies to \(\frac{\partial}{\partial y}\). This interpretation of differential operators turns out to be useful in many situations. For example, for any constants \(a, b\in \mathbb{R}\), we may consider the following operator \(D\):

\[D = a\frac{\partial}{\partial x} + b\frac{\partial}{\partial y}.\]

If we apply this operator to the function \(f(x,y)\) from the left, we obtain \(af_x(x,y) + bf_y(x,y)\) as a result. That is,
\[Df(x,y) = af_x(x,y) + bf_y(x,y).\]
Note that the result is different if we apply the operator to \(f(x,y)\) from the right, which will be another differential operator rather than a function:
\[f(x,y)D = af(x,y)\frac{\partial}{\partial x} + bf(x,y)\frac{\partial}{\partial y}.\]
In other words, the "product" between an operator and a function is not commutative.


Let \(D\) and \(E\) be differential operators. We define their "product" (composition) \(DE\) as follows: For the function \(f(x,y)\),
\[DEf(x,y) = D(Ef(x,y)).\]
That is, first apply \(E\) to \(f(x,y)\), then apply \(D\) to the result. When \(D = E\), we write \(D^2 = DD\). For example,
\[\begin{eqnarray*} \frac{\partial^2}{\partial x^2} &=& \left(\frac{\partial}{\partial x}\right)^2,\\ \frac{\partial^2}{\partial x\partial y} &=& \frac{\partial}{\partial x}\cdot \frac{\partial}{\partial y}. \end{eqnarray*}\]

Example (\(\Delta\), Laplacian). The differential operator defined by
\[\Delta = \frac{\partial^2}{\partial x^2} + \frac{\partial^2}{\partial y^2}\]
is called the (two-variable) Laplacian after the French mathematician Pierre-Simon Laplace (1749-1827).
\[\Delta f(x,y) = f_{xx}(x,y) + f_{yy}(x,y).\]
The Laplacian appears in many physical problems such as heat transfer and diffusion. □

Example (\(\nabla\), nabla). We can formally define an ordered pair of the partial differential operators:
\[\nabla = \left(\frac{\partial}{\partial x}, \frac{\partial}{\partial y}\right).\]
This operator is called the nabla. When this operator is applied to a function \(f(x,y)\), we have an ordered pair of partial derivatives:
\[\nabla f(x,y) = \left(\frac{\partial}{\partial x}f(x,y), \frac{\partial}{\partial y}f(x,y)\right) = (f_x(x,y), f_y(x,y)).\]
The result is a vector function composed of the partial derivatives of \(f(x,y)\).
The nabla may be regarded as a vector. Suppose we have a vector function \(\mathbf{u}(x,y) = (u(x,y), v(x,y))\). Then, we can take their dot (scalar) product:
\[\nabla \cdot \mathbf{u}(x,y) = \frac{\partial}{\partial x}u(x,y) + \frac{\partial}{\partial y}v(x,y) = u_x(x,y) + v_y(x,y).\]
We can also calculate the scalar product between the nabla and itself:
\[\nabla\cdot\nabla = \frac{\partial}{\partial x}\frac{\partial}{\partial x} + \frac{\partial}{\partial y}\frac{\partial}{\partial y} = \frac{\partial^2}{\partial x^2} + \frac{\partial^2}{\partial y^2} = \Delta.\]
The result is the Laplacian. □
See also: Nabla symbol

Example. For \(a,b\in\mathbb{R}\), let \(a\frac{\partial}{\partial x} + b\frac{\partial}{\partial y}\) be a differential operator that operates on functions of class \(C^{\infty}\). Then, \(\frac{\partial^2}{\partial x\partial y} = \frac{\partial^2}{\partial y\partial x}\). Accordingly, the following holds:
\[\begin{equation*} \left(a\frac{\partial}{\partial x} + b\frac{\partial}{\partial y}\right)^2 = a^2\frac{\partial^2}{\partial x^2} + 2ab\frac{\partial^2}{\partial x\partial y} + b^2\frac{\partial^2}{\partial y^2}. \end{equation*}\]
More generally, we have
\[\left(a\frac{\partial}{\partial x} + b\frac{\partial}{\partial y}\right)^n=\sum_{k=0}^{n}\binom{n}{k}a^kb^{n-k}\frac{\partial^n}{\partial x^k\partial y^{n-k}}\tag{Eq:DObinom} \]
where \(\binom{n}{k}\) is the binomial coefficient:
\[\binom{n}{k} = \frac{n!}{k!(n-k)!}.\]
□

Exercise. Prove Eq. (Eq:DObinom). (Hint: Mathematical induction.)□



Comments

Post a Comment

Popular posts from this blog

Birth process

-
Image
  Defining the birth process  Consider a colony of bacteria that never dies. We study the following process known as  the birth process , also known as  the Yule process . The colony starts with \(n_0\) cells at time \(t = 0\). Assume that the probability that any individual cell divides in the time interval \((t, t + \delta t)\) is proportional to \(\delta t\) for small \(\delta t\). Further assume that each cell division is independent of others. Let \(\lambda\) be the  birth rate.  The probability of a cell division for a population of \(n\) cells during \(\delta t\) is \(\lambda n \delta t\). We assume that the probability that two or more births take place in the time interval \(\delta t\) is \(o(\delta t)\). That is, it can be ignored. Consequently, the probability that no cell divides during \(\delta t\) is \(1 - \lambda n \delta t - o(\delta t)\). Note that this process is an example of the Markov chain with states \({n_0}, {n_0 + 1}, {n_0 + 2}...
Read more

Branching processes: Mean and variance

-
Image
Generational growth Consider the following scenario (see the figure below): A single individual (cell, organism, etc.) produces \(j (= 0, 1, 2, \cdots)\) descendants with probability \(p_j\), independently of other individuals. The probability of this reproduction, \(\{p_j\}\), is known.  That individual produces no further descendants after the first (if any) reproduction. These descendants each produce further descendants at the next subsequent time with the same probabilities.  This process carries on, creating successive generations. Figure 1. An example of the branching process. Let \(X_n\) be the random variable representing the population size (number of individuals) of generation \(n\). In the above figure, we have \(X_0 = 1\), \(X_1=4\), \(X_2 = 7\), \(X_3=12\), \(X_4 = 9.\) We shall assume \(X_0 = 1\) as the initial condition. Ideally, our goal would be to find how the population size grows through generations, that is, to find the probability \(\Pr(X_n = k)\) for e...
Read more

Combining birth and death processes

-
Image
The birth-death process Combining birth and death processes with birth and death rates \(\lambda\) and \(\mu\), respectively, we expect to have the following differential-difference equations for the birth-death process : \[\begin{eqnarray}\frac{{d}p_0(t)}{{d}t} &=& \mu p_1(t),\\\frac{{d}p_n(t)}{{d}t} &=& \lambda(n-1)p_{n-1}(t) - (\lambda + \mu)np_n(t) + \mu(n+1)p_{n+1}(t),~~(n \geq 1).\end{eqnarray}\] You should derive the above equations based on the following assumptions: Given a population with \(n\) individuals, the probability that an individual is born in the population during a short period \(\delta t\) is \(\lambda n \delta t + o(\delta t)\). Given a population with \(n\) individuals, the probability that an individual dies in the population is \(\mu n \delta t + o(\delta t)\). The probability that multiple individuals are born or die during \(\delta t\) is negligible. (The probability of one birth and one death during \(\delta t\) is also negligible.) Consequ...
Read more