Introductory university-level calculus, linear algebra, abstract algebra, probability, statistics, and stochastic processes.
Special solution of inhomogeneous linear differential equations
Get link
Facebook
X
Pinterest
Email
Other Apps
-
The general solution of an inhomogeneous linear differential equation can be obtained as the sum of a special solution and the general solution of the corresponding homogeneous differential equation. We study the method of variation of parameters in particular.
Consider the linear differential equation of the form
\[F(D)y = q(x)\]
where \(F(t)\) is a polynomial and \(q(x)\) is a function. When \(q(x) = 0\), this is a homogeneous linear differential equation. Here, we assume \(q(x) \neq 0\).
Suppose we can factorize \(F(t)\) as \(F(t) = G(t)H(t)\). If \(y = y(x)\) is a solution of \(F(D)y = q\), then \(z = H(D)y\) is a solution of \(G(D)z = q\). Thus, the given differential equation \(F(D)y = q\) is decomposed into two parts:
\(G(D)z = q\) (a linear differential equation of \(z\), given \(q\)),
\(H(D)y = z\) (a linear differential equation of \(y\), given \(z\)),
and we can process one after the other. Thus, by factorizing the polynomial \(F(D)\), we only need to consider the case where \(F(t) = t - \alpha\) (\(\alpha \in \mathbb{C}\)). That is, \(y' - \alpha y = q.\) This ODE can be readily solved by using the method of variation of parameters. The general solution of this ODE is obtained as
Note that \(F(t) = t^2 + t - 6 = (t - 2)(t + 3)\) so the given ODE is \((D - 2)(D+3)y = \cos x\). Solving the homogeneous ODE \((D - 2)(D + 3)y = 0\), we have
\(y = Ae^{2x} + Be^{-3x}\) where \(A, B\) are constants. Let \(z = (D+3)y\), then we have \((D-2)z = \cos x\) and its special solution is given by
\[z = e^{2x}\int e^{-2x}\cos x dx = -\frac{2}{5}\cos x + \frac{1}{5}\sin x.\]
Similarly, solving \((D+3)y = -\frac{2}{5}\cos x + \frac{1}{5}\sin x\), we have a special solution
\[y = e^{-3x}\int e^{3x}\left(-\frac{2}{5}\cos x + \frac{1}{5}\sin x\right)\,dx = -\frac{7}{50}\cos x + \frac{1}{50}\sin x.\]
Thus, the general solution is
\[y = -\frac{7}{50}\cos x + \frac{1}{50}\sin x + Ae^{2x} + Be^{-3x}\]
where \(A, B\) are constants. □
Let's consider the more general case where \(F(t) = t^2 + at + b = (t - \alpha)(t - \beta)\) with \(\alpha \neq \beta\). In particular, when \(a^2 - 4b < 0\), we have \(\beta = \bar{\alpha}\). We want to solve the following second-order ODE:
\[(D - \alpha)(D - \beta)y = q.\]
Let \(z = (D-\beta)y\), and we have
\[(D - \alpha)z = q.\tag{eq:odea}\]
We first solve the homogeneous case \((D - \alpha)z = 0\) which yields
\[z = Ae^{\alpha x}.\]
Now, regarding \(A\) as a function of \(x\), substitute it into (eq:odea), we have
Note the symmetry between the two terms on the right-hand side. This means that swapping \(\alpha\) and \(\beta\) does not change the result. This is expected as the differential operators are commutative: \((D-\alpha)(D - \beta) = (D -\beta)(D - \alpha)\).
Example. Let us solve
\[y'' + y = \frac{1}{\cos x}.\]
The corresponding homogeneous equation is \(y'' + y = 0\). Noting \(D^2 + 1 = (D -i)(D+i)\), its solution is
\[y = Ae^{ix} + Be^{-ix} \tag{eg:hom}\]
where \(A, B \in \mathbb{C}\) are constants. Now, we use the method of variation of parameters by regarding \(A\) and \(B\) as functions of \(x\). According to the above result, we have
Using Euler's formula (\(e^{\pm i x} = \cos x \pm i \sin x\)), this can be further "simplified" (exercise!) as
\[y = (\log|\cos x| + C)\cos x + (x + D)\sin x\]
where \(C\) and \(D\) are constants. Note that this is a real-valued function if \(C\) and \(D\) are real. □
Next, let's consider \((D-\alpha)^2y = q.\) Of course, \((t - \alpha)^2 = (t-\alpha)(t-\alpha)\) so that we can apply the technique above. Let \(y_1 = (D-\alpha)y\), and we solve \((D-\alpha)y_1 = q\). As we have seen above,
\[y_1 = e^{\alpha x}\int e^{-\alpha x}q(x)\,dx.\]
Next, we solve \((D-\alpha)y_2 = y_1\). This gives
We can continue the same process to solve \((D-\alpha)^my = q\) for any \(m = 3, 4, \cdots\). Let the solution of \((D-\alpha)^my = q\) be \(y_m\) for \(m = 0, 1, 2, \cdots\). We can see that
Let \(\mathbf{X} = (X_1, X_2, \cdots, X_n)^\top\) be a vector of random variables. We say it follows the multivariate normal (Gaussian) distribution if its density is given by \[f(\mathbf{x}) = \frac{1}{\sqrt{(2\pi)^n|\Sigma|}}\exp\left(-\frac{1}{2}(\mathbf{x} - \boldsymbol{\mu})^\top\Sigma^{-1}(\mathbf{x} - \boldsymbol{\mu})\right)\tag{Eq:density}\] where \(\boldsymbol{\mu} = (\mu_1, \mu_2, \cdots, \mu_n)^\top \in \mathbb{R}^n\) is a vector, \(\Sigma\) is a symmetric positive definite \(n\times n\) matrix, and \(\Sigma^{-1}\) and \(|\Sigma|\) are the inverse and determinant of \(\Sigma\), respectively. It turns out that \(\boldsymbol{\mu}\) and \(\Sigma\) are the mean vector and covariance matrix of \(\mathbf{X}\), respectively. But we will not prove that here. In this post, we will show this density (Eq:density) is normalized (of course). That is, we prove that \[\int_{\mathbb{R}^n}f(\mathbf{x})d\mathbf{x} = 1.\] We assume that you already know how to prove the univariate nor...
Let \(\mathbf{X} = (X_1, X_2, \cdots, X_n)^\top \in \mathbb{R}^n\) be a vector of random variables. The covariance matrix \(\Sigma\) of \(\mathbf{X}\) is a square (\(n\times n\)) matrix whose elements are covariances between the components of \(\mathbf{X}\). That is, \[\Sigma_{ij} = \mathrm{Cov}(X_i,X_j)\] where \(\mathrm{Cov}(X_i,X_j)\) is the covariance between \(X_i\) and \(X_j\) , \(i,j = 1, 2, \cdots, n\): \[\mathrm{Cov}(X_i, X_j) = \mathbb{E}[(X_i - \mathbb{E}[X_i])(X_j - \mathbb{E}[X_j])].\] Here, \(\mathbb{E}[\cdot]\) indicates the expectation value of a random variable . Any covariance matrix has the following properties: Symmetric. That is, \[\Sigma = \Sigma^\top.\] Positive semi-definite. That is,\[\forall \mathbf{v} \in \mathbb{R}^n, \mathbf{v}^\top\Sigma\mathbf{v} \geq 0.\] See also : Positive definite matrix (Wolfram MathWorld) The symmetry is obvious from the definition of the covariance matrix. Now, let us prove that the covariance matrix is positive semi-...
We show some basic properties of differentiation, such as linearity, the product rule, the quotient rule, the chain rule, etc. We also introduce higher-order derivatives and differentiability classes. Theorem (Properties of differentiation) Let \(f(x)\) and \(g(x)\) be differentiable functions on an open interval \(I\). (Linearity) \[\frac{d}{dx}[kf(x) + lg(x)] = kf'(x) + lg'(x)\] where \(k, l\) are constants. (Product rule) \[\frac{d}{dx}[f(x)g(x)] = f'(x)g(x) + f(x)g'(x).\] (Quotient rule) \(\frac{f(x)}{g(x)}\) is differentiable on \(\{x \mid g(x) \neq 0, x\in I\}\) and \[\frac{d}{dx}\left[\frac{f(x)}{g(x)}\right] = \frac{f'(x)g(x) - f(x)g'(x)}{[g(x)]^2}.\] Proof . Exercise. Since \(f(x)\) is differentiable at \(x=a\), it is continuous at \(x=a\) so \(f(x) \to f(a)\) as \(x \to a\). For any \(a\in I\), \[\begin{eqnarray*} \frac{f(x)g(x) - f(a)g(a)}{x - a} &=& \frac{f(x)g(x) - f(x)g(a) + f(x)g(a) - f(a)g(a)}{x - a}\\ &=& f(x)\cdot\frac{g(x) ...
Comments
Post a Comment