URAL MATHEMATICAL JOURNAL, Vol. 1, No. 1, 2015
ON CONNECTIONS BETWEEN GENERALIZED SOLUTIONS OF PDE'S OF THE FIRST ORDER1
Ekaterina A. Kolpakova
N.N. Krasovskii Institute of Mathematics and Mechanics of the Ural Branch of the Russian Academy of Sciences, Ekaterinburg, Russia, [email protected]
The paper is devoted to the connection between generalized solutions of the Cauchy problem for Hamilton— Jacobi—Bellman equation and the corresponding first order quasilinear PDE in the of case ra-dimentional state space.
Keywords: Hamilton—Jacobi—Bellman equation, Quasilinear equation, Viscosity solution.
Introduction
The paper is concerned with the link between two major classes of the first order PDEs, namely Hamilton-Jacobi-Bellman equations and quasilinear PDEs. The classical solution may not exist globally for these equations. Thus both types of equations require the notion of generalized solution. For Hamilton-Jacobi equation the theory of generalized solution was developed by A.I. Subbotin [1] and M. Crandall, P.L. Lions [2], whereas the quasilinear case was studied by O.A. Oleinik, S.N. Kruzhkov [3]. The generalized solutions of Hamilton-Jacobi equations are called minimax solutions or viscosity solutions. A.I. Subbotin proved the equivalence of these notions. The generalized solutions of quasilinear PDEs are called entropy solutions. This term is due to entropy condition. The existence and uniqueness theorems for Hamilton-Jacobi PDEs can be found in [1,2], for quasilinear PDEs these theorems can be found in [3].
If we formally differentiate Hamilton-Jacobi equation with respect to phase variable, then in some cases we get the quasilinear equation. But the question about a link between these generalized solutions is opened, because the minimax/viscosity solution is only continuous function. Note that the minimax solution of Hamilton-Jacobi equation is not differentiable. Thus this differentiation should be performed with the help of methods of nonsmooth analysis.
First one-dimensional case was considered by N.N. Yanenko and B.L. Rozchdestveskii [4]. In that book a link between the Hamilton-Jacobi PDE and quasilinear equation was mentioned. The strong result is presented in [5].
In this paper we extend the results of [5] to n-dimensional case.
We assume that the Hamiltonian depends on the linear combination of impulse variables and is convex with respect to them. This type of equations describes the value function of optimal control problem with dynamics
( n \
x = Hs \t,x, ^ X^ , Xi E R, i = 1,... ,n,
where ||s|| < D. The restriction D is determined by the Hamiltonian. The purpose is to minimize the functional
T
I = a(x) + J(s, Hs(t, x, s)) — H(t, x, s)dt
to
*The work is supported by grants RFBR no. 14-01-00168, program of Presidium of RAS "Mathematical problems of modern control theory"
on the set of admissible controls s. It is known from the work of A.I. Subbotin, N.N. Subbotina, that if the Hamiltonian and boundary function a are smooth enough, then the value function is locally Lipschitz continuous. Thus the value function is differentiable almost everywhere.
In the paper we prove that the generalized divergence of the minimax/viscosity solution coincides with the generalized solution of the Cauchy problem for quasilinear equation. The structure of the entropy solution of the Cauchy problem for quasilinear equation is described in the work [6] in the cases of piecewise smooth solution and the solution belonging to the class of function with locally bounded variation. This structure is valid for derivatives of the minimax/viscosity solution for Hamilton-Jacobi equation.
1. Preliminaries
1.1. Viscosity solution
Let us consider the Cauchy problem for the Hamilton-Jacobi-Bellman equation
^ + H(t,x, £ A,J^) = 0, p(0,x) = a(x) (1.1)
i=1 i
Here (t, x) e n^ = [0, T] x Rn, A, e R. Remind the definition of Holder spaces.
Definition 1. The Holder space C 2+a is the space of twice continuously differentiable functions those the second derivatives are Holder continuous of order a e (0,1].
We assume that
(A1) the function H(t,x,s) e C2+a;
(A2) the function H(t, x, s) satisfies sublinear growth condition and it is convex with respect to s;
(A3) the function a(x) e C2+a and it is bounded in Rn.
In general case this problem has no continuously differentiable (classical) solution in the strip
nT [1].
The generalized solution of problem (1.1) can be approximated by the solutions of the following Cauchy problem
dt- + H(t,x, £ Aid^) = eAxp—, <p—(0,x) = a(x). (1.2)
i=1 i
n Q2
Here Ax = ^ is the Laplace operator, e C2+a. i=i oxi
It is proved in the work [2] for the viscosity solution p that
p(t,x) = lim p—(t,x) locally uniformly in n^.
——>0
It is known [1], that the viscosity solution exists, it is unique and it is locally Lipschitz function in n^. The superdifferential of the viscosity solution is not empty at all points of n^.
1.2. Entropy solution
Consider the Cauchy problem
+ £ AiHxt (t, x, w) = 0, w(0, x) = £ Ai^O^-. (1.3)
Here
H (txw)~ — + 9H 9W x* 7 7 Qxi dw dxi
Recall the definition of generalized (entropy) solution of problem (1.3), proposed by S.N. Kruzchkov [3].
Definition 2. A Lebesgue measurable function w : n^ ^ R is called an entropy solution of problem (1.3), if for any constant k £ R, nonnegative function f £ C§°, the inequality holds
n
w
i=l i=l
/ \w(t,x) — k\fT + sign(w(T, x) — k) ^ \i(H (t, x, k) — H (t, x, w))fxi dxdr+ ' = i=1
/n
sign(w(T, x) — k) ^ \iHXi (T,x,k)fdxdT > 0,
nT
n
nT
n
"Ox.
w(0,x) = J2 xi (x)•
i=l
Under assumptions (A1)-(A3) the entropy solution of problem (1.3) exists and it is unique in the class of locally bounded measurable functions [3]. Let us consider the Cauchy problem
+ E ^Hx,i(t,x,w£) = £AxWe, w£(0,x) = ^ ^• (1-4)
i=1 i=1 i
It is proved [7,8] that solution w£ of problem (1.4) exists, it is unique and w£ is continuously differentiable with respect to t and twice continuously differentiable with respect to x.
The classical solutions w£ of problem (1.4) pointwise converge to the solution w of problem (1-3), as e ^ 0 almost everywhere in n^ [3], [6].
Definition 3. A measurable function w : n^ ^ R is piecewise smooth, if there exists not more then countable set of open domains Di c n^ and dimension of Di equals n + 1, such that
(J clDi = nT, Di n Dj = 0 for i = j, the function w is continuously differentiable on clDi.
Here cl states for the closure.
The following property of solution of (1.3) is proved in [3]. If the solution of problem (1.3) is piecewise smooth in the neighborhood of the point of discontinuity, then the discontinuity surface satisfies the condition
\w1 — k\ cos vt + sign(w1 — k)(H(t, x, k) — H(t, x, w1)) cos(v, xi) <
(1.5)
\w2 — k\ cos vt + sign(w2 — k)(H (t, x, k) — H (t, x, w2)) cos(v, xi), i = 1, • • • ,n
for any k £ R, for any (t, x) £ clDi n clDj, i = j.
Here v is the normal to the discontinuity surface at the point (t,x) £ clDi n clDj, w1 = lim w(t, x), w2 = lim w(t, x).
(t, x)—>(t, x(t)+v) (t, x) —>(t, x(t)—v)
Recall a definition from measure theory [9].
Definition 4. A function w is of locally bounded variation on an open subset A c n^ if w £ L1oc(A) and grad w is a (Rn+1-valued) Radon measure M on A, i. e.,
— J w iw,,(t.*)*«« = /rt^wM.
A A
for any test function n £ C0¡o(A)•
Assertion 1. If w is the entropy solution of problem (1.3) then w £ BVloc(nT).
Proof. Since the function w is locally bounded measurable, w £ Ljoc(A). Here A c nT is a compact set. It suffices to prove [6,9], that
I = lim sup1 I \w(t + h,x + hEi) — w(t,x)\dxdt h^0 h J
A
is finite for any compact A c n^. Here vectors Ei c Rn, i = 1,... ,n form the orthonormal basis in Rn
Remind that w(t,x) = lim w£(t,x) almost everywhere. Here w£ is solution (1.4).
£—>0
According to Lousin's theorem [10] there exist the sets A and A£ such, that the measure /j.(A \ A£) < e and the function w is continuous on (t, x) £ A£. Consider the integral I. One can get
where
I < Ii + I2 + Is
1
Ii = lim sup1 I \w(t + h,x + hEi) — w£(t + h,x + hEi)\dxdt, h^0 h J
A
I2 = lim sup1 I \w£(t + h,x + hEi) — w£(t,x)\dxdt, h^0 h J
A
Is = lim sup1 I \w(t,x) — w£(t,x)\dxdt.
h J
A
The function w£ £ C2+a, since it belongs to BVioc. Therefore, I2 < 00. If we choose the parameter e = h2, then we have the estimates
|w(t + h,x + hEi) - w£(t + h,x + hEi)\ <e = h2, \w(t,x) - w£(t,x)\ <e = h2 for (t,x) £ A£. Consequently Ii ,I3 < 0. □
The domain nT is the union of three, pairwise disjoint, subsets C, J, and I with the following properties [6] :
a) C is the set of points of approximate continuity of w, i. e., with each (i, x) £ C is associated w0 £ R such that
lim—— \w(t,x) — w0\dxdt = 0.
r—0 rn+i J
Br (t,x)
b) J is the set of points of approximate jump discontinuity of w, i. e., with each (t, x) c J are associated N in unit sphere Sn and distinct w- , w+ £ R such that
1 f — ^ ,,±i
lino n+i J \w(t,x) — w±\dxdt = 0,
r^o rn+i
B± (t,x)
where B±(t, x) denote the semiballs Br(t, x) n {(t, x) : ((t — i, x — x),N) < 0} or Br(t, x) n {(t, x) : ((t—t, x—x), N) > 0}. Moreover, J is essentially covered by the countable union of C1 n-dimensional manifolds {Fi} embedded in Rn+1 : Hn(J \ UFi) = 0. Furthermore, when (t, x) £ J n Fi, then N is normal on Fi at (t, x).
(c) I is the set of irregular points of w; its n+1-dimensional Hausdorff measure is zero:Hn(I) = 0.
2. Connection between generalized solutions of problems (1.1) and (1.3)
Let us introduce a notion of generalized divergence of a nonsmooth field. This notion is similar to a notion of a divergence of a field.
Definition 4. The set Div y(t, x) = co { lim div y(tk, xk)} is called generalized
(tk,Xk )^(t,x)
divergence of the field y £ Rn at the point (t,x). Here divy(tk,xk) is the divergence of the field y with respect to x, (tk,xk) are the points of differentiability of y.
The map (t,x) — Div(p(t,x)X) is convex-valued, upper semicontinuous and locally bounded.
Really, the map is convex according to definition 4. The map is upper semicontinuous, because the d
supergradients ^— £ D+p(t,x) and D+p(t,x) is upper semicontinuous and locally bounded [1].
Hence we can choose a measurable selector w : n^ — R, w(t, x) £ Div(p(t, x)A), where p is the viscosity solution of problem (1.1) [10].
Assertion 2. If assumptions (A1)-(A3) are true, then the solution of problem (1.3) w(t,x) £ Div(Xp(t,x)), where p is the viscosity solution of problem (1.1).
Proof. Since the viscosity solution p is a Lipschitz continuous function, the map (t, x) — Div p(t,x)\ is single-valued almost everywhere. Let us denote by J the set of points (t,x) such, that the map (t,x) — Div p(t,x)\ is multivalued. The measure of J is equal zero. Consider the case Div(pA) < k. Let the function f be a finite function with compact support B a n^.
/n n „
(k - Div (p(t, x)X))fr + J2 Xi{ H{T, x,E X - H{T, x, k))fxi - XiHXi (T, x, k)fdxdt =
nT i=1 i=1 Xl
nT
/10
kfr -J2 Xi(H(t, x, k)fxi + Hxi(t, x, k)f )dxdt-
i=1
j Exi{dpfT+H(^EAijp.)fxi)dxdt (2.1)
nT\J i=1 i i=1 i
Let us calculate the first integral in (2.1):
J kfr - E Xi(H(T,x,k)fxi + Hxi(T,x,k)f )dxdt = j kfr - E Xi9(H(Tdxx;k)f) dxdt = 0
nT i=1 nT i=1 i
because the function f is finite.
Integrating the second integral in (2.1) by parts several times we set, that
¿2
/'n n n a n
EXi ^ fr + E Xi^T,x^Xi ^ fxi dxdt =J J2XiPfr\Ddlt
nT\J i=1 i i=1 i=1 i ti i=1
n n n
i PEXif + E XiH^x^Xi dp-J fxi dxdt = nT\j i=1 i i=1 i=1 i
¿2
lnT\J - f Iddt - dx-dx+
i=l tl -=1 D -=1 -
/n d f n n d
^ £ Xf + E XiH(T,X,^2 Xidxr) fxidxdt = nT\j i=1 i i=1 i=1 i
-EXi^fMj + /EXidpfdx + / p + Xi^T,x,eg)) EXi f Xt = 0,
i=1 D i=1 i nT\J i=1 i i=1 i
hence p satisfies equation (1.1) on the set n^ \ J.
Similarly one can consider the case Div pX > k. □
Corollary 1. If the viscosity solution p of problem (1.1) is piecewise smooth, then the set of point (t,x) £ n^, where the function p is not differentiable, has form (1.5).
Denote by D+p(t,x) the superdifferential of function p at the point (t,x). The map (t,x) ^ D+p(t,x) is upper semicontinuous, concave and locally bounded. So there exists a measurable selector, which belongs to Ljoc. Hence function w £ Div(pX) £ Ljoc. According to assertion 2 the set of definition of the viscosity solution is the union of three, pairwise disjoint, subsets C, J, and I:
a) C is the set of points, where the viscosity solution is continuously differentiable;
b) J is the set of points, where the viscosity solution has a jump. Moreover, J is essentially covered by the countable union of C1 n-dimensional manifolds {Fi} embedded in Rn+1 : Hn( J \ UFi) = 0. Furthermore, when i, X £ J n Fi, then N is normal on Fi at (t, x).
(c) I is the set of irregular points of p; its n-dimensional Hausdorff measure is zero:Hn(I) = 0.
REFERENCES
1. Subbotin A.I. Generalized Solutions of First-Order PDEs. The Dynamical Optimization Perspective. Boston etc., Birkhauser, 1995. 312 p.
2. Lions P.L. Generalized solutions of Hamilton—Jacobi equations. Boston: Pitman, 1982. 318 p.
3. Kruzhkov S.N. Generalized solutions of nonlinear first order equations with several independent variables. II // Mat. Sb. (N.S.) 1967. Vol. 72 (114), no. 1. P. 108-134.
4. Rozhdestvenskii B.L., Yanenko N.N. Systems of quasilinear equations and their applications to gas dynamics. Moscow: Nauka, 1978. 686 p.
5. Subbotina N, Kolpakova E. 6. On Structure of the Value Function // Proceedings of the 18-th World Congress IFAC (Milan, Italy). 2011, Vol. 18, Part I. Identifier: 10.3182/20110828-6-IT-1002.01451
6. Dafermos C.M. Hyperbolic conservation law in continuum physics. Springer, 2005. 708 p.
7. Oleinik O. A., Kruzhkov S.N. Quasi-linear second-order parabolic equations with many independent variables // Uspekhi Mat. Nauk. 1961. Vol. 16, no. 5(101). P. 115-155.
8. Ladyzhenskaya O.A., Solonnikov V.A., Uralceva N.N. Linear and quasilinear equations of parabolic type. M.: Nauka, 1967. 736 p.
9. Aliprantis C.D., Border K.C. Infinite Dimensional Analysis. Springer Berlin Heidelberg New York. 2006. 717 p.
10. Warga J. Optimal control of differential and functional equation. Academic Press New York and London, 1972. 531 p.