+ All Categories
Home > Documents > Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun ›...

Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun ›...

Date post: 24-Jun-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
21
Digital Object Identifier (DOI) 10.1007/s10107-005-0629-9 Math. Program., Ser. B 104, 561–581 (2005) Fanwen Meng · Defeng Sun · Gongyun Zhao Semismoothness of solutions to generalized equations and the Moreau-Yosida regularization This paper is dedicated to Terry Rockafellar on the occasion of his seventieth birthday Received: July 13, 2004 / Accepted: April 10, 2005 Published online: July 14, 2005 – © Springer-Verlag 2005 Abstract. We show that a locally Lipschitz homeomorphism function is semismooth at a given point if and only if its inverse function is semismooth at its image point. We present a sufficient condition for the semi- smoothness of solutions to generalized equations over cone reducible (nonpolyhedral) convex sets. We prove that the semismoothness of solutions to the Moreau-Yosida regularization of a lower semicontinuous proper convex function is implied by the semismoothness of the metric projector over the epigraph of the convex function. Key words. Semismooth – Generalized Equations – Moreau-Yosida Regularization 1. Introduction Strong regularity for generalized equations introduced by Robinson [39] and strong sta- bility for the Karush-Kuhn-Tucker (KKT) systems of nonlinear optimization problems introduced by Kojima [17] are two important concepts in perturbation analysis of opti- mization problems. The monograph [1] by Bonnans and Shapiro provided an excellent survey on this. Strong stability and strong regularity are intimately related to inverse and implicit function theorems for nonsmooth equations. Clarke [5] established an implicit function theorem for a locally Lipschitz continuous function under the nonsingularity assumption on the generalized Jacobian matrices. For a locally Lipschitz function , Kummer [20, 21] obtained a complete characterization of a locally Lipschitz homeomor- phism in terms of the set of strict derivatives D (x)(u)(see its definition in Section 2) and applied the results to nonsmooth parametric optimization. Furthermore, the inverse function theorem established by Kummer [20] was the first necessary and sufficient condition result for locally Lipschitz functions. In [28], Mifflin introduced an important subclass of Lipschitz functions – semi- smooth functions. The concept of semismoothness was then employed to analyze the F. Meng: School of Mathematics, University of Southampton, Highfield, Southampton SO17 1BJ, United Kingdom. e-mail: [email protected] D. Sun: Department of Mathematics, National University of Singapore, Singapore 117543, Republic of Singapore. e-mail: [email protected] G. Zhao: Department of Mathematics, National University of Singapore, Singapore 117543, Republic of Singapore. e-mail: [email protected] Mathematics Subject Classification (1991): 90C30, 90C31, 90C45, 49J52
Transcript
Page 1: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Digital Object Identifier (DOI) 10.1007/s10107-005-0629-9

Math. Program., Ser. B 104, 561–581 (2005)

Fanwen Meng · Defeng Sun · Gongyun Zhao

Semismoothness of solutions to generalized equationsand the Moreau-Yosida regularization

This paper is dedicated to Terry Rockafellar on the occasion of his seventieth birthday

Received: July 13, 2004 / Accepted: April 10, 2005Published online: July 14, 2005 – © Springer-Verlag 2005

Abstract. We show that a locally Lipschitz homeomorphism function is semismooth at a given point if andonly if its inverse function is semismooth at its image point. We present a sufficient condition for the semi-smoothness of solutions to generalized equations over cone reducible (nonpolyhedral) convex sets. We provethat the semismoothness of solutions to the Moreau-Yosida regularization of a lower semicontinuous properconvex function is implied by the semismoothness of the metric projector over the epigraph of the convexfunction.

Key words. Semismooth – Generalized Equations – Moreau-Yosida Regularization

1. Introduction

Strong regularity for generalized equations introduced by Robinson [39] and strong sta-bility for the Karush-Kuhn-Tucker (KKT) systems of nonlinear optimization problemsintroduced by Kojima [17] are two important concepts in perturbation analysis of opti-mization problems. The monograph [1] by Bonnans and Shapiro provided an excellentsurvey on this. Strong stability and strong regularity are intimately related to inverse andimplicit function theorems for nonsmooth equations. Clarke [5] established an implicitfunction theorem for a locally Lipschitz continuous function under the nonsingularityassumption on the generalized Jacobian matrices. For a locally Lipschitz function �,Kummer [20, 21] obtained a complete characterization of a locally Lipschitz homeomor-phism in terms of the set of strict derivatives D∗�(x)(u)(see its definition in Section 2)and applied the results to nonsmooth parametric optimization. Furthermore, the inversefunction theorem established by Kummer [20] was the first necessary and sufficientcondition result for locally Lipschitz functions.

In [28], Mifflin introduced an important subclass of Lipschitz functions – semi-smooth functions. The concept of semismoothness was then employed to analyze the

F. Meng: School of Mathematics, University of Southampton, Highfield, Southampton SO17 1BJ,United Kingdom. e-mail: [email protected]

D. Sun: Department of Mathematics, National University of Singapore, Singapore 117543, Republic ofSingapore. e-mail: [email protected]

G. Zhao: Department of Mathematics, National University of Singapore, Singapore 117543, Republic ofSingapore. e-mail: [email protected]

Mathematics Subject Classification (1991): 90C30, 90C31, 90C45, 49J52

Used Distiller 5.0.x Job Options
This report was created automatically with help of the Adobe Acrobat Distiller addition "Distiller Secrets v1.0.5" from IMPRESSED GmbH. You can download this startup file for Distiller versions 4.0.5 and 5.0.x for free from http://www.impressed.de. GENERAL ---------------------------------------- File Options: Compatibility: PDF 1.2 Optimize For Fast Web View: Yes Embed Thumbnails: Yes Auto-Rotate Pages: No Distill From Page: 1 Distill To Page: All Pages Binding: Left Resolution: [ 600 600 ] dpi Paper Size: [ 595 842 ] Point COMPRESSION ---------------------------------------- Color Images: Downsampling: Yes Downsample Type: Bicubic Downsampling Downsample Resolution: 150 dpi Downsampling For Images Above: 225 dpi Compression: Yes Automatic Selection of Compression Type: Yes JPEG Quality: Medium Bits Per Pixel: As Original Bit Grayscale Images: Downsampling: Yes Downsample Type: Bicubic Downsampling Downsample Resolution: 150 dpi Downsampling For Images Above: 225 dpi Compression: Yes Automatic Selection of Compression Type: Yes JPEG Quality: Medium Bits Per Pixel: As Original Bit Monochrome Images: Downsampling: Yes Downsample Type: Bicubic Downsampling Downsample Resolution: 600 dpi Downsampling For Images Above: 900 dpi Compression: Yes Compression Type: CCITT CCITT Group: 4 Anti-Alias To Gray: No Compress Text and Line Art: Yes FONTS ---------------------------------------- Embed All Fonts: Yes Subset Embedded Fonts: No When Embedding Fails: Warn and Continue Embedding: Always Embed: [ ] Never Embed: [ ] COLOR ---------------------------------------- Color Management Policies: Color Conversion Strategy: Convert All Colors to sRGB Intent: Default Working Spaces: Grayscale ICC Profile: RGB ICC Profile: sRGB IEC61966-2.1 CMYK ICC Profile: U.S. Web Coated (SWOP) v2 Device-Dependent Data: Preserve Overprint Settings: Yes Preserve Under Color Removal and Black Generation: Yes Transfer Functions: Apply Preserve Halftone Information: Yes ADVANCED ---------------------------------------- Options: Use Prologue.ps and Epilogue.ps: No Allow PostScript File To Override Job Options: Yes Preserve Level 2 copypage Semantics: Yes Save Portable Job Ticket Inside PDF File: No Illustrator Overprint Mode: Yes Convert Gradients To Smooth Shades: No ASCII Format: No Document Structuring Conventions (DSC): Process DSC Comments: No OTHERS ---------------------------------------- Distiller Core Version: 5000 Use ZIP Compression: Yes Deactivate Optimization: No Image Memory: 524288 Byte Anti-Alias Color Images: No Anti-Alias Grayscale Images: No Convert Images (< 257 Colors) To Indexed Color Space: Yes sRGB ICC Profile: sRGB IEC61966-2.1 END OF REPORT ---------------------------------------- IMPRESSED GmbH Bahrenfelder Chaussee 49 22761 Hamburg, Germany Tel. +49 40 897189-0 Fax +49 40 897189-71 Email: [email protected] Web: www.impressed.de
Adobe Acrobat Distiller 5.0.x Job Option File
<< /ColorSettingsFile () /AntiAliasMonoImages false /CannotEmbedFontPolicy /Warning /ParseDSCComments false /DoThumbnails true /CompressPages true /CalRGBProfile (sRGB IEC61966-2.1) /MaxSubsetPct 100 /EncodeColorImages true /GrayImageFilter /DCTEncode /Optimize true /ParseDSCCommentsForDocInfo false /EmitDSCWarnings false /CalGrayProfile () /NeverEmbed [ ] /GrayImageDownsampleThreshold 1.5 /UsePrologue false /GrayImageDict << /QFactor 0.9 /Blend 1 /HSamples [ 2 1 1 2 ] /VSamples [ 2 1 1 2 ] >> /AutoFilterColorImages true /sRGBProfile (sRGB IEC61966-2.1) /ColorImageDepth -1 /PreserveOverprintSettings true /AutoRotatePages /None /UCRandBGInfo /Preserve /EmbedAllFonts true /CompatibilityLevel 1.2 /StartPage 1 /AntiAliasColorImages false /CreateJobTicket false /ConvertImagesToIndexed true /ColorImageDownsampleType /Bicubic /ColorImageDownsampleThreshold 1.5 /MonoImageDownsampleType /Bicubic /DetectBlends false /GrayImageDownsampleType /Bicubic /PreserveEPSInfo false /GrayACSImageDict << /VSamples [ 2 1 1 2 ] /QFactor 0.76 /Blend 1 /HSamples [ 2 1 1 2 ] /ColorTransform 1 >> /ColorACSImageDict << /VSamples [ 2 1 1 2 ] /QFactor 0.76 /Blend 1 /HSamples [ 2 1 1 2 ] /ColorTransform 1 >> /PreserveCopyPage true /EncodeMonoImages true /ColorConversionStrategy /sRGB /PreserveOPIComments false /AntiAliasGrayImages false /GrayImageDepth -1 /ColorImageResolution 150 /EndPage -1 /AutoPositionEPSFiles false /MonoImageDepth -1 /TransferFunctionInfo /Apply /EncodeGrayImages true /DownsampleGrayImages true /DownsampleMonoImages true /DownsampleColorImages true /MonoImageDownsampleThreshold 1.5 /MonoImageDict << /K -1 >> /Binding /Left /CalCMYKProfile (U.S. Web Coated (SWOP) v2) /MonoImageResolution 600 /AutoFilterGrayImages true /AlwaysEmbed [ ] /ImageMemory 524288 /SubsetFonts false /DefaultRenderingIntent /Default /OPM 1 /MonoImageFilter /CCITTFaxEncode /GrayImageResolution 150 /ColorImageFilter /DCTEncode /PreserveHalftoneInfo true /ColorImageDict << /QFactor 0.9 /Blend 1 /HSamples [ 2 1 1 2 ] /VSamples [ 2 1 1 2 ] >> /ASCII85EncodePages false /LockDistillerParams false >> setdistillerparams << /PageSize [ 576.0 792.0 ] /HWResolution [ 600 600 ] >> setpagedevice
Page 2: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

562 F. Meng et al.

convergence of bundle type methods [25, 29, 43] for nondifferentiable optimizationproblems. In particular, the convergence of the nonsmooth approach for solving opti-mization problems with equilibrium constraints relies on the semismoothness [33]. Inorder to study the superlinear convergence of Newton’s method for solving nondiffer-entiable equations, Qi and Sun [38] extended the definition of semismoothness to vectorvalued functions. After the work of Qi and Sun [38], semismoothness was extensivelyused to establish superlinear/quadratic convergence of Newton’s methods for solving thecomplementarity problem and variational inequalities [9], the convex best interpolationproblem [6, 7], and the inverse eigenvalue problem [49], to name only a few.

The importance of the concept of semismoothness in the convergence analysis of var-ious methods (first order or second order) motivates us to investigate the semismoothnessof solutions to parameterized generalized equations over (nonpolyhedral) convex setsand the semismoothness of solutions to the Moreau-Yosida regularization of a lowersemicontinuous proper convex function. The study on these two seemingly differenttopics is connected by establishing a semismooth homeomorphism theorem for locallyLipschitz functions.

Let X, Y , and U be finite dimensional vector spaces each equipped with a scalarproduct denoted by 〈·, ·〉. Let ‖ ·‖ be the norm induced by 〈·, ·〉. We use Z to represent anarbitrary vector space from vector spaces X, Y, and U. Suppose that F : X ×U → X isa single valued continuously differentiable mapping and G : X×U → Y is a single val-ued twice continuously differentiable mapping. We denote by JxG(x, u) : X × U → Y

the derivative mapping of G with respect to x ∈ X. Let JxG(x, u)∗ : Y × U → X bethe adjoint of the derivative mapping JxG(x, u) and let K ⊆ Y be a closed convex set.The parameterized generalized equation, considered in Shapiro [46], is to find x ∈ X

such that

F(x, u) + JxG(x, u)∗λ = 0 , λ ∈ NK(G(x, u)) , (1)

where for any closed convex set D ⊆ Z, ND(z) denotes the normal cone of D at z:

ND(z) ={

{d ∈ Z | 〈d, c − z〉 ≤ 0 ∀ c ∈ D} if z ∈ D ,

∅ if z /∈ D .

It is noted that if the mapping F(x, u) is the derivative of a real valued function f :X×U → � with respect to x, i.e., F(x, u) = Jxf (x, u), then under some standard con-straint qualifications (see, e.g., [40]), (1) turns to be the first order necessary optimalityconditions of the following parameterized optimization problem

min f (x, u)

s.t. G(x, u) ∈ K ,

x ∈ X .

(2)

For any closed convex set D of the vector space Z and z ∈ Z, let �D(z) denote themetric projection of z onto D, i.e.,

�D(z) := argmin

{1

2‖d − z‖2 | d ∈ D

}.

Page 3: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 563

It is well known [53] that the metric projector �D(·) is contractive, i.e., for any twovectors z1, z2 ∈ Z,

‖�D(z1) − �D(z2)‖ ≤ ‖z1 − z2‖ .

Then, according to Eaves [8], problem (1) is equivalent to the following parameterizednonsmooth equation

H(x, λ, u) :=[

F(x, u) + JxG(x, u)∗λ

G(x, u) − �K [G(x, u) + λ]

]= 0 . (3)

For u ∈ U , let (x(u), λ(u)) (if exists) solve (3), i.e., H(x(u), λ(u), u) = 0. Shapiro[46] studied some perturbed properties including the Lipschitz continuity of (x(·), λ(·))at a given point u0 ∈ U . In this paper, we shall further study the semismoothness of(x(·), λ(·)) at u0.

In this paper, we also investigate another related yet quite different problem, thatis, the Moreau-Yosida regularization of a lower semicontinuous proper convex functionf : X → � ∪ {+∞}. Let ε be a positive number. The Moreau-Yosida regularization off [31, 52] is defined by

fε(u) := min{f (x) + ε

2 〈u − x, u − x〉} ,

s.t. x ∈ X .(4)

It is well known that fε is continuously differentiable on X and for any u ∈ X,

∇fε(u) = ε(u − x(u)),

where x(u) denotes the unique optimal solution of (4). It is also known that x(·) is glob-ally Lipschitz continuous, which implies that ∇fε is globally Lipschitz continuous [42,p.546]. Here, we are interested in the semismoothness of x(·) at a given point u0 ∈ X,which is a key condition for the superlinear convergence of an approximate Newton’smethod designed in Fukushima and Qi [12] for solving nonsmooth convex optimizationproblems.

The organization of this paper is as follows. In section 2, we discuss the semismooth-ness of locally Lipschitz homeomorphism functions. In particular, based on Kummer’sinverse function theorem for locally Lipschitz functions [20], we show that a locallyLipschitz homeomorphism function is G-semismooth at a given point if and only if itsinverse function is G-semismooth at its image point. In Section 3, we study the semi-smoothness of solutions to parameterized generalized equations. A sufficient conditionis presented for the semismoothness of solutions to parameterized equations over conereducible (nonpolyhedral) convex sets. In section 4, we reduce the semismoothness ofsolutions to the Moreau-Yosida regularization of a convex function to the semismooth-ness of the metric projector over the epigraph of the convex function. We make finalconclusions in Section 5.

Page 4: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

564 F. Meng et al.

2. Semismoothness of Locally Lipschitz Homeomorphism Functions

Let X and Y be finite dimensional vector spaces. Let O be an open set in X and � : O ⊆X → Y be a locally Lipschitz continuous function on the open set O. By Rademacher’stheorem, � is almost everywhere F(rechet)-differentiable in O. We denote by D� theset of points in O where � is F-differentiable. Let J�(x), which is a linear mappingfrom X to Y , denote the derivative of � at x ∈ O if � is F(rechet)-differentiable at x,and J�(x)∗ : Y → X the adjoint of J�(x). Then, the B-subdifferential of � at x ∈ O,denoted by ∂B�(x), is the set of V such that

V = limk→∞

J�(xk) ,

where {xk} ∈ D� is a sequence converging to x. The Clarke’s generalized Jacobian of� at x is the convex hull of ∂B�(x) (see [5]), i.e.,

∂�(x) = conv{∂B�(x)} .

For x ∈ O and u ∈ X, the strict derivative D∗�(x)(u) of � at x in the direction u

consists of all points y ∈ Y which is the limit of a sequence

yk := (�(xk + tku) − �(xk))/tk, xk → x, tk ↓ 0.

The set D∗�(x)(u) was first studied by Thibault [50, 51] (with a different notation) inorder to extend Clarke’s calculus to functions in abstract spaces. Kummer [20] calledit “Thibault’s directional derivative” and used it to get a complete characterization of aLipschitz homeomorphism function (see Definition 1). Since then the strict derivativehas been studied in Rockafellar and Wets [42, Ch.9] and Levy [26, 27] for both singlevalued functions and multifunctions.

It is known that D∗�(x)(u) is related to Clarke’s generalized Jacobian ∂� and theB-subdifferential ∂B� in the following way [20]:

∂B�(x)u ⊆ D∗�(x)(u) ⊆ ∂�(x)u , ∀ u ∈ X . (5)

In [20], Kummer gave a piecewise linear mapping to show that D∗�(x)(u) ⊂ ∂�(x)u

but D∗�(x)(u) �= ∂�(x)u.

Definition 1. A function � : O ⊆ X → X is said to be a locally Lipschitz homeo-morphism near x ∈ O if there exists an open neighborhood N ⊆ O of x such that therestricted map � |N : N → �(N ) is Lipschitz continuous and bijective, and its inverseis also Lipschitz continuous.

The following inverse function theorem is obtained by Kummer [20].

Theorem 1. Suppose that � : O ⊆ X → X is locally Lipschitz near x ∈ O. Then �

is locally Lipschitz homeomorphism near x if and only if the following nonsingularitycondition holds:

∀ u ∈ X, 0 ∈ D∗�(x)(u) �⇒ u = 0 .

Page 5: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 565

The purpose of this section is to show that if � : O ⊆ X → X is locally Lipschitzhomeomorphism near x ∈ O, then � is semismooth at x if and only if �−1, the localinverse mapping of � near x, is semismooth at �(x).

Semismoothness was originally introduced by Mifflin [28] for functionals. For study-ing the superlinear convergence of Newton’s method for solving nonsmooth equations,Qi and Sun [38] extended the definition of semismoothness to vector valued functions.There are several equivalent ways for defining the semismoothness. Here we use thefollowing definition.

Definition 2. Let � : O ⊆ X → Y be a locally Lipschitz continuous function on theopen set O. We say that � is semismooth at a point x ∈ O if

(i) � is directionally differentiable at x; and(ii) for any �x → 0 and V ∈ ∂�(x + �x),

�(x + �x) − �(x) − V (�x) = o(||�x||) . (6)

In the above definition on semismoothness, part (i) and part (ii) do not imply eachother. To see that (i) does not imply (ii), one may consider the example given in [28]:�(x) = x2 sin(1/x) if 0 �= x ∈ � and �(x) = 0 if x = 0. On the other hand, Shap-iro [45] constructed a one dimensional example to show that (ii) holds while (i) fails tohold. Condition (6), together with a nonsingularity assumption on ∂� at a solution point,was used by Kummer [19] to prove the superlinear convergence of Newton’s method forlocally Lipschitz equations. Gowda [13] called a locally Lipschitz continuous function �

“semismooth” at x if (6) holds. To distinguish Gowda’s definition on semismoothness of� at x, Pang et al. [34] called � to be G-semismooth at x if condition (6) holds. A stron-ger notion than semismoothness is strong semismoothness. We say that � is stronglyG-semismooth (strongly semismooth) at x, if � is G-semismooth (semismooth) at x

and for any �x → 0 and V ∈ ∂�(x + �x),

�(x + �x) − �(x) − V (�x) = O(||�x||2). (7)

We say that � is G-semismooth (semismooth, strongly G-semismooth, strongly semi-smooth) on a set D ⊆ O if � is G-semismooth (semismooth, strongly G-semismooth,strongly semismooth) at every point of D.

In order to show semismoothness, one often finds the following result useful. For aproof, see [48, Theorem 3.7] and [47, Lemma 2.1].

Lemma 1. Let � : O ⊆ X → Y be locally Lipschitz near x ∈ O. Then � is G-semi-smooth (strongly G-semismooth) at x if and only if for any �x → 0 and x + �x ∈ D�,

�(x + �x) − �(x) − J�(x + �x)(�x) = o(||�x||) (= O(||�x||2)) . (8)

Lemma 2. Let � : O ⊆ X → X be locally Lipschitz homeomorphism near x0 ∈ O.Then there exists an open neighborhood N ⊆ O of x0 such that � is F-differentiable atx ∈ N if and only if �−1, the locally inverse mapping of � near x0, is F-differentiableat y := �(x); and

(J�(x))−1 = J�−1(y). (9)

Moreover, there exists a positive number µ > 0 such that ||V −1|| ≤ µ, ||W−1|| ≤ µ forall V ∈ ∂B�(u), W ∈ ∂B�−1(z), u ∈ N , and z ∈ �(N ).

Page 6: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

566 F. Meng et al.

Proof. By Definition 1, there exist a neighborhood N ⊆ O of x0 and a locally Lipschitzfunction �−1 defined on the open neighborhood �(N ) of �(x0) such that �(�−1(z)) =z and �−1(�(u)) = u for any u ∈ N and z ∈ �(N ). On the other hand, by Theo-rem 1 and (5), we know that any V ∈ ∂B�(x0) is nonsingular. Hence, by shrinking Nif necessary, we know from [36] that there exists a positive number µ > 0 such thatmax{‖V ‖, ||V −1||} ≤ µ for all V ∈ ∂B�(u) and u ∈ N .

Suppose that � is F-differentiable at some point x ∈ N . Then, because J�(x) ∈∂B�(x), J�(x) is nonsingular. If �−1 is not F-differentiable at y = �(x), then thereexists a sequence {�yk} converging to 0 such that �yk �= 0 and

�k

||�yk|| → α �= 0, (10)

where �k := �−1(y + �yk) − �−1(y) − (J�(x))−1(�yk) and α ∈ X is finite. Then,

�−1(y + �yk) = �−1(y) + (J�(x))−1(�yk) + �k.

Now

�(�−1(y) + (J�(x))−1(�yk) + �k) − �(x)

= �(�−1(y + �yk)) − �(�−1(y)) = y + �yk − y = �yk.

So, we obtain

�(�−1(y) + (J�(x))−1(�yk) + �k) − �(x)

= �(x + (J�(x))−1(�yk) + �k) − �(x) = �yk.

Then, it follows from the F-differentiability of � at x and the local Lipschitz continuityof �−1 that

J�(x)[(J�(x))−1(�yk) + �k] + o(||�yk||) = �yk.

Thus

�yk + J�(x)(�k) + o(||�yk||) = �yk,

which implies that

J�(x)

(�k

||�yk||)

+ o(1) = 0.

Hence, J�(x)(α) = 0. Therefore, α = 0, which contradicts (10). This contradictionshows that �−1 is F-differentiable at y = �(x) and J�−1(y) = (J�(x))−1.

Similarly, we can show the converse part.Evidently, ||W−1|| ≤ µ for all W ∈ ∂B�−1(z) and z ∈ �(N ). ��

Theorem 2. Let � : O ⊆ X → X be locally Lipschitz homeomorphism near x0 ∈ O.Then there exists an open neighborhood N ⊆ O of x0 such that

Page 7: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 567

(i) � is G-semismooth (strongly G-semismooth) at some point x ∈ N if and only if�−1, the local inverse mapping of � near x0, is G-semismooth (strongly G-semi-smooth) at y := �(x); and

(ii) � is semismooth (strongly semismooth) at some point x ∈ N if and only if �−1 issemismooth (strongly semismooth) at y := �(x).

Proof. (i) By Lemma 2, there exist an open neighborhood N ⊆ O of x0 and a positivenumber µ > 0 such that � is F-differentiable at x ∈ N if and only if �−1 is F-differen-tiable at �(x) and that ||V −1|| ≤ µ, ||W−1|| ≤ µ for all V ∈ ∂B�(x), W ∈ ∂B�−1(y),x ∈ N , and y ∈ �(N ). Then, by Lemma 2, for any y ∈ �(N) ∩ D�−1 and y → y wehave

�−1(y) − �−1(y) − J�−1(y)(y − y)

= �−1(�(x)) − x − (J�(x))−1(�(x) − �(x))

= x − x − (J�(x))−1(�(x) − �(x))

= (J�(x))−1[�(x) − �(x) − J�(x)(x − x)]

= O(‖�(x) − �(x) − J�(x)(x − x)‖) , (11)

where x := �−1(y). Hence, Lemma 1, together with (11), shows that �−1 is G-semi-smooth (strongly G-semismooth) at y if � is G-semismooth (strongly G-semismooth)at x.

By reversing the above arguments, we obtain that � is G-semismooth (stronglyG-semismooth) at x if �−1 is G-semismooth (strongly G-semismooth) at y.

(ii) By [22, Lemma 2], � is directionally differentiable at x if and only �−1 isdirectionally differentiable at �(x). Therefore, statement (ii) follows by statement (i)and the definitions of semismoothness and strong semismoothness. ��

Note that in [13], among many other results for inverse and implicit function the-orems, by assuming that a locally Lipschitz continuous function � : O ⊆ X → X issemismooth on the open set O, Gowda provided a necessary and sufficient conditionfor the existence of a semismooth inverse function of �. Various equivalent forms toGowda’s condition were given in [34]. Here, in Theorem 2 we showed that a locally Lips-chitz homeomorphism � : O ⊆ X → X is semismooth at a point if only if its inversemapping is semismooth at its image point. A Lipschitz continuous function which issemismooth at a certain point may be not semismooth on an neighborhood of this point.For example, for any closed convex cone D ⊆ X, �D(·) is strongly semismooth atthe origin [35] while we know nothing about the semismoothness of �D(·) at otherpoints. Another simple example would be a locally Lipschitz function which is strictlyFrechet differentiable at one point. Then, by [38, Corollary 2.5], the Lipschitz functionis semismooth at this point and there is no guarantee that it is semismooth on an openneighborhood of this point. So, discussions given in Theorem 2 are necessary if we onlyknow the semismoothness of � at the point concerned.

In [2, 15], the authors introduced the concept of slant differentiability for designingsuperlinearly convergent Newton’s method for nondifferentiable operator equations in

Page 8: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

568 F. Meng et al.

function spaces. The analysis on the superlinear convergence of Newton’s method forslantly differentiable equations carried out in [2, 15] can be actually regarded as a spe-cial case in [19, Proposition 3]. In finite dimensional spaces, if � : O ⊆ X → X isG-semismooth on an open set N ⊆ O, then G is slantly differentiable on N (cf. [15,Definition 1]). However, the converse may not be true [2, Remark (6)]. So, it wouldbe interesting to know if Theorem 2 can be extended from G-semismooth functions toslantly differentiable functions. The main difficulty lies in the fact that for a locally Lips-chitz homeomorphism function � : O ⊆ X → X the nonsingularity of the Bouligandderivative of � at any x0 ∈ O is guaranteed to hold while the nonsingularity of the slantderivative of � at x0 holds or not remains unknown.

Next, we consider the equation H(x, u) = q, where H : X × Y → X is locallyLipschitz continuous near (x0, u0) ∈ X × Y with H(x0, u0) = q0. Let us make thefollowing assumption:

Assumption 1. There exist an open neighborhood N (q0, u0) ⊆ X × Y of (q0, u0) anda Lipschitz continuous function x(q, u) defined on N (q0, u0) such thatH(x(q, u), u) = q for every (q, u) ∈ N (q0, u0).

Under the above assumption, we have the following result.

Corollary 1. Suppose that Assumption 1 holds. Then, x(·, ·) is G-semismooth (stronglyG-semismooth, semismooth, strongly semismooth) at some point (q, u) ∈ N (q0, u0)

if and only if H is G-semismooth (strongly G-semismooth, semismooth, strongly semi-smooth) at (x(q, u), u).

Proof. Define the mapping � : X × Y → X × Y in the form of

�(x, u) :=[

H(x, u)

u

].

Then �(x0, u0) =[q0u0

]. By Assumption 1, � is locally Lipschitz homeomorphism

near (x0, u0) with its inverse mapping �−1 given by

�−1(q, u) :=[

x(q, u)

u

], (q, u) ∈ N (q0, u0) .

Therefore, by Theorem 2, �−1 is G-semismooth (strongly G-semismooth, semismooth,strongly semismooth) at some point (q, u) ∈ N (q0, u0) if and only if H is G-semi-smooth (strongly G-semismooth, semismooth, strongly semismooth) at (x(q, u), u).This completes the proof. ��

In [21], Kummer showed that Assumption 1 is equivalent to the following nonsin-gularity condition:

∀ d ∈ X, 0 ∈ D∗H(x0, u0)(d, 0) �⇒ d = 0 . (12)

Then, we have the following implicit function theorem, which is a direct consequenceof Corollary 1 and does not need a proof.

Page 9: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 569

Corollary 2. Suppose that the nonsingularity condition (12) is satisfied. Let q0 = 0.Then, there exist an open neighborhood N ⊆ Y of u0 and a Lipschitz continuous func-tion x(·) defined on N such that H(x(u), u) = 0 for every u ∈ N . Moreover, x(·)is G-semismooth (strongly G-semismooth, semismooth, strongly semismooth) at somepoint u ∈ N if H is G-semismooth (strongly G-semismooth, semismooth, strongly semi-smooth) at (x(u), u).

The first part of Corollary 2 first appeared in [21]. Based on Clarke’s implicit func-tion theorem [4, 5], a related result to the second part of the above corollary is obtainedin [47, Theorem 2.1] under Clarke’s nonsingularity condition:

∀ d ∈ X, 0 ∈ ∂H(x0, u0)(d, 0) �⇒ d = 0, (13)

which is a more restrictive condition than (12) (cf. [20]).

3. Semismoothness of Solutions to Generalized Equations

Let X, Y, and U be finite dimensional vector spaces. Suppose that F : X × U → X iscontinuously differentiable, G : X × U → Y is twice continuously differentiable, andK ⊆ Y is a closed convex set. Let H : X × Y × U → X × Y be defined by (3). Now,let us consider the following parameterized generalized equation

(GEu)

H(x, λ, u) =[

F(x, u) + JxG(x, u)∗λ

G(x, u) − �K [G(x, u) + λ]

]= 0 . (14)

For a given point u0 ∈ U of the parameter vector, we view the corresponding general-ized equation (GEu0) as unperturbed, and write (GEu) for the parameterized generalizedequation. Let (x0, λ0) be a solution of (GEu0).

For u ∈ U near u0, let (x(u), λ(u)) (if exists) solve (GEu), i.e., H(x(u), λ(u), u)

= 0. In [46], Shapiro studied some perturbed properties of (x(·), λ(·)) near u0 ∈ U .In this section, we will investigate its semismoothness at u0. Denote S := {x ∈X | G(x, u0) ∈ K}. Let TK(y) denote the tangent cone of K at y and lin(C) the linealityspace of the closed convex cone C, i.e., lin(C) = C ∩ (−C). The following definitionof nondegeneracy is taken from [1, 46], which is a basic assumption of this section.

Definition 3. We say that a point x0 ∈ S is nondegenerate, with respect to the mappingG and the set K , if

JxG(x0, u0)X + lin(TK(y0)) = Y, (15)

where y0 := G(x0, u0).

Under the above nondegeneracy assumption at x0 ∈ S, Shapiro [46] showed that themultiplier λ satisfying H(x0, λ, u0) = 0 is unique.

By using the cone reducibility notion, Shapiro [46] reduced the discussion on sen-sitivity analysis of (x(·), λ(·)) to a new problem. In this case, the sensitivity analysisbecomes simpler, at least notationally. In the following analysis, we will adopt this idea.The concept of cone reducibility below is taken from [1, 46].

Page 10: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

570 F. Meng et al.

Definition 4. A closed (not necessarily convex) set C ⊆ Y is called cone reducible ata point y0 ∈ C if there exist a neighborhood V ⊆ Y of y0, a pointed closed convexcone Q in a finite dimensional space Z and a twice continuously differentiable mapping : V → Z such that: (i) (y0) = 0 ∈ Z, (ii) the derivative mapping J(y0) : Y → Z

is onto, and (iii) C ∩ V = {y ∈ V | (y) ∈ Q}. If C is cone reducible at every pointy0 ∈ C (possibly to a different cone Q), then we say that C is cone reducible.

Many interesting sets such as the polyhedral convex set, the second-order cone, andthe cone Sn+ of positive semidefinite n × n symmetric matrices are all cone reducible[1, 46]. In the subsequent analysis, we assume that the convex set K is cone reducibleat the point y0 := G(x0, u0) to a pointed closed convex cone Q ⊆ Z by a mapping .

Define the mapping G(x, u) := (G(x, u)). Then, it is known [1, 46] that for all (x, u)

in a neighborhood of (x0, u0), the generalized equations (GEu) can be written in thefollowing equivalent form

(GEu)

HG(x, µ, u) :=[

F(x, u) + JxG(x, u)∗µ

G(x, u) − �Q(G(x, u) + µ)

]= 0 (16)

in the sense that locally, (x(u), λ(u)) is a solution of (GEu) if and only if (x(u), µ(u))

is a solution of (GEu) and

λ(u) = [J(G(x(u), u))]∗µ(u) . (17)

Moreover, by Definition 4, we can derive that for (x, u) sufficiently close to (x0, u0),the multiplier µ(u) is defined uniquely by (17). In particular, the unperturbed problem(GEu0) has solution (x0, µ0) with µ0 being uniquely determined by

λ0 = [J(G(x0, u0))]∗µ0 .

Hence, in what follows, we only need to study the semismooth sensitivity of the solutionof (GEu) near u0. By Definition 4, we have G(x0, u0) = 0 with the unique multiplierµ0.

Theorem 3. Let (x0, µ0) be a solution of (GEu0). Suppose that the convex set K is conereducible at the point y0 := G(x0, u0) to a pointed convex closed cone Q ⊆ Z by amapping . Suppose that the following condition holds:

∀ (�x, �µ)∈X×Z, 0 ∈ D∗HG(x0, µ0, u0)(�x, �µ, 0)�⇒�x =0, �µ=0. (18)

The following statements hold:

(i) there exist an open neighborhood N of u0 and a Lipschitz continuous function(x(·), µ(·)) defined on N such that HG(x(u), µ(u), u) = 0 for every u ∈ N ;

(ii) if �Q is G-semismooth (semismooth) at G(x0, u0) + µ0, then (x(·), µ(·)) is G-semismooth (semismooth) at u0; and

(iii) if �Q is strongly G-semismooth (strongly semismooth) at G(x0, u0) + µ0 and thederivative of F and the second derivative of G are locally Lipschitz continuous near(x0, u0), then (x(·), µ(·)) is strongly G-semismooth (strongly semismooth) at u0.

Page 11: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 571

Proof. Statements (i) and (ii) are direct consequences of Corollary 2.For statement (iii), we observe that HG is strongly G-semismooth (strongly semi-

smooth) at (x0, µ0, u0) if �Q is strongly G-semismooth (strongly semismooth) atG(x0, u0) + µ0 and the derivative of F and the second derivative of G are locallyLipschitz continuous near (x0, u0) (cf. [11]). Then, by the same corollary, we get (iii). ��

Condition (18) used in Theorem 3 is mild according to discussions in Section 2, butmay be difficult to verify in general. Next, we will consider a sufficient condition forguaranteeing (18) to hold. For this purpose, we need the characterizations of Clarke’sgeneralized Jacobian of the metric projector �K(·), which is Lipschitz continuous withLipschitz constant 1. Define φ : X → R by

φ(y) := 1

2[〈y, y〉 − 〈y − �K(y), y − �K(y)〉], y ∈ X . (19)

It is known [53] that θ(y) := 12 ||y − �K(y)||2, y ∈ X is continuously differentiable

with

∇θ(y) = y − �K(y) , y ∈ X.

Thus, φ is also continuously differentiable with

∇φ(y) = y − (y − �K(y)) = �K(y) , y ∈ X .

Therefore, by mimicking the proof in [32, 3.3.4], we can get the following result. Weomit the details here for brevity.

Lemma 3. Let K ⊆ X be a closed convex set. If �K is F -differentiable at x ∈ X, thenJ�K(x) is self-adjoint, i.e.,

J�K(x) = J�K(x)∗. (20)

Proposition 1. Let K ⊆ X be a closed convex set. Then, for any x ∈ X and V ∈∂�K(x), we have

(i) V is self-adjoint;(ii) 〈d, V d〉 ≥ 0, ∀ d ∈ X; and

(iii) 〈V d, d − V d〉 ≥ 0, ∀ d ∈ X.

Proof. (i) By Lemma 3 and the definition of ∂B�K(x), any V ∈ ∂B�K(x) is self-adjoint.This further implies that any V ∈ ∂�K(x) = conv∂B�K(x) is self-adjoint.

(ii) Suppose that �K(·) is F-differentiable at some point x ∈ X. Since �K(·) ismonotone [53], we have

〈�K(x + td) − �K(x), td〉 ≥ 0, for all t ≥ 0,

which implies that for all d ∈ X,

〈J�K(x)d, d〉 ≥ 0.

Page 12: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

572 F. Meng et al.

Hence, by the definition of ∂�K(·), for any x ∈ X and V ∈ ∂�K(x),

〈d, V d〉 ≥ 0, ∀d ∈ X .

(iii) First, we consider y ∈ D�K. By [53], for any d ∈ X and t ≥ 0, we have

〈�K(y + td) − �K(y), td〉 ≥ ||�K(y + td) − �K(y)||2, for all t ≥ 0.

Hence,

〈J�K(y)d, d〉 ≥ 〈J�K(y)d, J�K(y)d〉. (21)

Next, let V ∈ ∂�K(x). Then, by Caratheodory’s theorem, there exist a positiveinteger κ > 0, V i ∈ ∂B�K(x), i = 1, 2, . . . , κ such that

V =κ∑

i=1

λiVi ,

where λi ≥ 0, i = 1, 2, . . . , κ, and∑κ

i=1 λi = 1. Let d ∈ X. For each i = 1, . . . , κ

and k = 1, 2, . . . , there exists xik ∈ D�Ksuch that

||x − xik || ≤ 1/k

and

||J�K(xik ) − V i || ≤ 1/k.

By (21), we have

〈J�K(xik )d, d〉 ≥ 〈J�K(xik )d, J�K(xik )d〉.Hence,

〈V id, d〉 ≥ 〈V id, V id〉,and so,

κ∑i=1

λi〈V id, d〉 ≥κ∑

i=1

λi〈V id, V id〉. (22)

Define θ(x) := ||x||2, x ∈ X. By the convexity of θ , we have

θ( κ∑

i=1

λiVid

)≤

κ∑i=1

λiθ(V id) =κ∑

i=1

λi〈V id, V id〉 =κ∑

i=1

λi ||V id||2 .

Hence,κ∑

i=1

λi ||V id||2 ≥⟨ κ∑

i=1

λiVid,

κ∑i=1

λiVid

⟩. (23)

By using (22) and (23), we obtain for all d ∈ X that

〈V d, d〉 ≥ 〈V d, V d〉.The proof is completed. ��

Page 13: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 573

Set L0 := {z ∈ X | JxG(x0, u0)z ∈ C�Q(G(x0,u0)+µ0)}, where C�Q(G(x0,u0)+µ0) :={V h | V ∈ ∂�Q(G(x0, u0) + µ0), h ∈ Z}. For a general closed convex set K , it is notclear what L0 looks like. But, if K has special structures, then it is likely to know L0exactly. For example, ∂�Q, and so L0, has a complete characterization if Q is either asecond order cone or Sn+ [34].

Proposition 2. Suppose that x0 ∈ S is nondegenerate, with respect to the mapping G

and the closed convex set K , and K is cone reducible at the point y0 := G(x0, u0) to apointed closed convex cone Q ⊆ Z by a mapping . Suppose that

∀ 0 �= �x ∈ L0 �⇒ 〈�x, (JxF (x0, u0) + J 2xxG(x0, u0)

∗µ0)(�x)〉 > 0 . (24)

Then, the nonsingularity condition (18) in Theorem 3 holds.

Proof. Let (�x, �µ) ∈ X × Z be such that

0 ∈ ∂HG(x0, µ0, u0)(�x, �µ, 0) .

Then, according to the definition ofHG and Clarke [5], there existsV ∈ ∂�Q(G(x0, u0)+µ0) such that

[JxF (x0, u0) + J 2

xxG(x0, u0)∗µ0](�x) + JxG(x0, u0)

∗(�µ) = 0,

JxG(x0, u0)(�x) − V [JxG(x0, u0)(�x) + �µ] = 0.

(25)

Let �H := JxG(x0, u0)(�x) + �µ. Then we have

�H − �µ = JxG(x0, u0)(�x) = V (�H).

So,

〈V (�H), �H − V (�H)〉 − 〈V (�H), �µ〉 = 0. (26)

Since, by Proposition 1, the first term on the left hand side of (26) is nonnegative, wehave

〈V (�H), �µ〉 ≥ 0.

It follows from (25) that

〈V (�H), �µ〉 = 〈JxG(x0, u0)(�x), �µ〉= 〈�x, JxG(x0, u0)

∗(�µ)〉= −〈�x, [JxF (x0, u0) + J 2

xxG(x0, u0)∗µ0](�x)〉 .

Thus,

〈�x, [JxF (x0, u0) + J 2xxG(x0, u0)

∗µ0](�x)〉 ≤ 0.

From the second equation of (25), we know that �x ∈ L0. Then, by condition (24), weobtain

�x = 0.

Page 14: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

574 F. Meng et al.

Hence

JxG(x0, u0)∗(�µ) = 0.

Since Q is a pointed closed convex cone, under the assumptions, from [46] we knowthat the mapping JxG(x0, u0) is onto. Thus, �µ = 0. This, together with (5), shows thatthe nonsingularity condition (18) in Theorem 3 holds. ��

By using Proposition 2 and Theorem 3, we get the following result:

Corollary 3. Suppose that x0 ∈ S is nondegenerate, with respect to the mapping G

and the closed convex set K , and K is cone reducible at the point y0 := G(x0, u0)

to a pointed closed convex cone Q ⊆ Z by a mapping . Then all the conclusions ofTheorem 3 hold if condition (18) in Theorem 3 is replaced by (24).

Let X = Sn and K := Sn+. Let (x0, u0) ∈ X×U be such that G(x0, u0) ∈ K of rankr . Then, by [1, Example 3.140], one can construct an infinitely many differentiable (evenanalytic) reduction mapping from a neighborhood of G(x0, u0) into a linear space Sn−r

with the corresponding cone Q := Sn−r+ . Since, in this case �Q(·) is strongly semi-

smooth everywhere [48], we can study the semismoothness of (x(·), µ(·)) by Theorem3 and Corollary 3.

4. The Moreau-Yosida Regularization

Let X be a finite dimensional vector space and f : X → � ∪ {+∞} be a lower semi-continuous proper convex function. Let ε > 0 be a positive number. Let fε be theMoreau-Yosida regularization of f defined by (4). For any u ∈ X, let x(u) denote theunique optimal solution of (4). Define F : X → X by

F(u) := ∇fε(u) = ε(u − x(u)) , u ∈ X. (27)

The function F is globally Lipschitz continuous because x(·) is so [42, p. 546]. How-ever, F may fail to be semismooth. To see this, let us consider the indicator functionf (x) = δ(x|D) defined as f (x) = 0 if x ∈ D and f (x) = +∞ if x /∈ D, where D ⊂ X

is a nonempty closed convex set. The corresponding Moreau-Yosida regularization off can be written as

min{δ(x|D) + ε

2〈u − x, u − x〉 | x ∈ X

}

= min{ε

2〈u − x, u − x〉 | x ∈ D

}.

(28)

Hence,

F(u) = ε(u − �D(u)) , u ∈ X.

Since in general �D(·) is not everywhere directionally differentiable on X, in particularfor D constructed in [18, 44] for instance, it follows that F is not semismooth every-where. Actually, the same example given in [44] can also be used to show that F failsto be G-semismooth everywhere on X.

Page 15: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 575

Regarding the Moreau-Yosida regularization, see [16, 42] for more general proper-ties and [12, 23, 24, 30, 37] for second order properties. In this section, we will studythe semismoothness of F by virtue of the projection onto the epigraph of f . It is evidentthat (4) can be rewritten as

fε(u) = min ε

{1

εf (x) + 1

2〈u − x, u − x〉

}s.t. x ∈ X.

(29)

Then, for any u ∈ X, fε(u) is the optimal value of the following parameterized optimi-zation problem

min ε

{t + 1

2〈u − x, u − x〉

}s.t. εt ≥ f (x),

(x, t) ∈ Z,

(30)

where Z := X × �. Let � be the epigraph of f , i.e.,

� := epi(f ) = {(x, t) ∈ X × � | t ≥ f (x)} .

The set � is a closed convex set [41, p.51]. Then, problem (4) can be written in the form of

min

{1

εt + 1

2〈u − x, u − x〉

},

s.t. (x, t) ∈ �,

(31)

which has a unique optimal solution (x(u), t (u)), where t (u) := f (x(u)). In the fol-lowing, we will investigate the semismoothness of (x(·), t (·)).

Let H : X × � × X → X × � be defined by

H (x, t, u) :=[

x

t

]− �� (G(x, t, u)) , (32)

where

G(x, t, u) :=[

x

t

]−

[x − u

1/ε

]=

[u

t − 1/ε

]. (33)

Then, for any u ∈ X, we have

H(x(u), t (u), u) = 0 . (34)

Lemma 4. For any u ∈ X, G(x(u), t (u), u) /∈ �.

Page 16: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

576 F. Meng et al.

Proof. Suppose on the contrary that for some u ∈ X, G(x(u), t (u), u) ∈ �. Then wehave

��(G(x(u), t (u), u)) = G(x(u), t (u), u) =[

x(u)

t (u)

]−

[x(u) − u

1/ε

].

So, it follows from (32) that

H(x(u), t (u), u) =[

x(u)

t (u)

]−

[(x(u)

t (u)

)−

(x(u) − u

1/ε

)]

=[

x(u) − u

1/ε

]�= 0,

which leads to a contradiction with (34). Hence, we have G(x(u), t (u), u) /∈ �. ��Lemma 5. Let C be a closed convex set of a finite dimensional space Y and w be apoint in Y with w /∈ C. Let x := �C(w). Let P := {s ∈ Y | 〈s, w − x〉 = α} be thesupporting hyperplane of C at x such that C ⊆ P− := {s ∈ Y | 〈s, w − x〉 ≤ α}, whereα := 〈x, w − x〉. Then for any z /∈ P−, one has ||�C(z) − x|| ≤ ||�P (z) − x||.Proof. Let y := �C(z). Then, we have

〈z − y, y − c〉 ≥ 0, ∀ c ∈ C ,

which, implies

||z − x||2 = ||z − y||2 + ||y − x||2 + 2〈z − y, y − x〉≥ ||z − y||2 + ||y − x||2. (35)

Now, since y ∈ C ⊆ P− and z /∈ P−, we have

〈y, w − x〉 ≤ α < 〈z, w − x〉 .

Thus, there exists θ ∈ [0, 1] such that 〈θz+(1−θ)y, w−x〉 = α, i.e., θz+(1−θ)y ∈ P .Hence,

||z − �P (z)|| ≤ ‖z − [θz + (1 − θ)y]‖ ≤ ‖z − y‖ ,

which, together with (35), implies

||z − y||2 + ||�P (z) − x||2 ≥ ||z − �P (z)||2 + ||�P (z) − x||2= ||z − x||2 ≥ ||z − y||2 + ||y − x||2.

Hence, the desired result is valid. ��According to Proposition 1 and Lemma 5, we derive the following result regard-

ing the B-subdifferential of ��. For any z = (x, t) ∈ X × �, let ��(z)x ∈ X and��(z)t ∈ � be such that ��(z) = (��(z)x, ��(z)t ). Let int(dom(f )) denote theinterior part of the domain of f .

Page 17: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 577

Proposition 3. Let z′ = (x′, t ′) ∈ X × � be such that z′ /∈ � and ��(z′)x ∈int(dom(f )). Then, there exists 0 < η < 1 such that for any W ∈ ∂B��(z′),

0 ≤ 〈e, We〉 ≤ η < 1, (36)

where e := (0, 1) ∈ X × �.

Proof. By the assumption that z′ /∈ �, there exists x′ ∈ X such that (x′, f (x′)) =��(z′). Let z′ := (x′, f (x′)). Because f is locally Lipschitz continuous near x′, thereexist a neighborhood N1(x

′) of x′ and a constant σ > 0 such that

‖ξ‖ ≤ σ < ∞, ∀ ξ ∈ ∂f (x), x ∈ N1(x′).

Since �� is globally Lipschitz continuous, there exists a neighborhood N2(z′) of z′

such that for any z ∈ N2(z′),

z /∈ � and ��(z)x ∈ N1(x′).

For any W ∈ ∂B��(z′), there exists a sequence, say {zk} ⊂ D�� , satisfying zk → z′and W = limk→∞ J��(zk). Thus, by (ii) of Proposition 1, to show (36), it only needsto show that there exists 0 < η < 1 such that

〈e, J��(z)e〉 ≤ η, ∀ z ∈ N2(z′) ∩ D�� .

Let z ∈ N2(z′). Then, there exists x ∈ X such that

z :=[

x

f (x)

]= ��(z) .

For any given �t > 0, let z + �z := (x, t + �t). Then, for all �t > 0 sufficientlysmall, z + �z /∈ � and there exists xt ∈ X such that

zt :=[

xt

f (xt )

]= ��(z + �z) .

Hence, for any z ∈ N2(z′) ∩ D�� ,

〈e, J��(z)e〉 = lim�t↓0

��(z + �z)t − ��(z)t

�t= lim

�t↓0

f (xt ) − f (x)

�t.

This means that, to show (36), it suffices to show that there exists 0 < η < 1 such thatfor all �t > 0 sufficiently small,

|f (xt ) − f (x)| ≤ η|�t |, ∀ z ∈ N2(z′) ∩ D��.

Let P := {(s, τ ) ∈ X ×� | 〈(s, τ ), (x − x, t − f (x))〉 = α} be the supporting planeP of � at (x, f (x)) such that

� ⊆ P− := {(s, τ ) ∈ X × � | 〈(s, τ ), (x − x, t − f (x))〉 ≤ α} ,

Page 18: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

578 F. Meng et al.

where α := 〈(x, f (x)), (x − x, t − f (x))〉. By shrinking N (z′) if necessary, we mayassume z /∈ P− because z′ /∈ P−. Then, for all �t > 0 sufficiently small, z + �z =(x, t + �t) /∈ P− and from Lemma 5,

|f (xt ) − f (x)| ≤ ||(xt , f (xt )) − (x, f (x))|| = ‖zt − z‖ ≤ ||�P (z + �z) − z||.Let θt be the angle between z − z and (z +�z)− z. Since both (z +�z)−�P (z +�z)

and z − z are perpendicular to the hyperplane P , we have for all �t > 0 sufficientlysmall that

|f (xt ) − f (x)| ≤ ‖�P (z + �z) − z‖ = ‖(z + �z) − z‖ sin θt = |�t | sin θt .

It remains to estimate the value of sin θt . Since � is the epigraph of f and � ⊆ P−, wehave for all s ∈ X and τ ≥ f (s) that

〈s − x, x − x〉 + (τ − f (x))(t − f (x)) ≤ 0 ,

which, implies that t − f (x) < 0 and for all s ∈ X,

f (s) − f (x) ≥ 〈s − x, (x − x)/(f (x) − t)〉.Hence, ξ := (x − x)/(f (x) − t) ∈ ∂f (x) and for all �t > 0 sufficiently small,

| cos θt | =∣∣∣∣ 〈z − z, �z〉‖z − z‖‖�z‖

∣∣∣∣ =∣∣∣∣ 〈(ξ, −1), (0, �t)〉

‖(ξ, −1)‖∣∣∣∣ = 1√

‖ξ‖2 + 1.

It follows that for all �t > 0 sufficiently small,

sin θt =√

1 − cos2 θt = ‖ξ‖√‖ξ‖2 + 1

.

Hence, for all �t > 0 sufficiently small,

sin θt ≤ σ√σ 2 + 1

=: η < 1.

This completes the proof. ��Proposition 4. For u0 ∈ X, let x0 := x(u0) and t0 := f (x(u0)). Suppose that��(G(x0, t0, u0))x ∈ int(dom(f )). Then, it holds that

∀ hx ∈ X, ht ∈ �, 0 ∈ ∂H(x0, t0, u0)(hx, ht , 0) �⇒ hx = 0, ht = 0. (37)

Proof. Let hx ∈ X and ht ∈ � be such that

0 ∈ ∂H(x0, t0, u0)(hx, ht , 0) .

Let

h :=[

hx

ht

].

Page 19: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 579

Then, according to the definition of H and [5], there exists W ∈ ∂��(G(x0, t0, u0))

such that

0 =[

hx

ht

]− W(0, ht ) = 0. (38)

By Lemma 4, G(x0, t0, u0) /∈ �. So, according to Proposition 3 and noticing thatW is a convex combination of some finitely many elements in ∂B��(G(x0, t0, u0), wehave

0 ≤ 〈e, We〉 ≤ η < 1, (39)

where e and η are defined as in Proposition 3. By (38), we obtain

|ht |2 = 〈(0, ht ), (hx, ht )〉 = 〈(0, ht ), W(0, ht )〉 = |ht |2〈e, We〉 ,

which, together with (39), implies ht = 0. By virtue of (38), hx = 0. Therefore, condi-tion (37) holds. ��

By (5), Corollary 2, and Proposition 4, we get the following result immediately.

Theorem 4. For u0 ∈ X, let x0 := x(u0) and t0 := f (x(u0)). Then (x(·), t (·)) andF(·) are G-semismooth (strongly G-semismooth, semismooth, strongly semismooth) atu0 if ��(G(x0, t0, u0))x ∈ int(dom(f )) and ��(·) is G-semismooth (strongly G-semi-smooth, semismooth, strongly semismooth) at G(x0, t0, u0).

The significance of Theorem 4 is that it allows us to exploit the rich properties ofthe metric projector over closed convex sets (cf. [9, Ch.4]) to study the semismoothnessof solutions to the Moreau-Yosida regularization. The condition ��(G(x0, t0, u0))x ∈int(dom(f )) in Theorem 4 holds automatically if f is finite valued everywhere.

5. Conclusions

In this paper, we showed that a locally Lipschitz homeomorphism function is G-semi-smooth (strongly G-semismooth, semismooth, strongly semismooth) at a given point ifand only if its inverse function is G-semismooth (strongly G-semismooth, semismooth,strongly semismooth) at its image point. We then used this result and its corollaries tostudy the semismoothness of solutions to parameterized generalized equations and theMoreau-Yosida regularization of a convex function.

By analyzing the properties of Clarke’s generalized Jacobian of the metric projectorover closed convex sets, we presented a sufficient condition for the semismoothness ofsolutions to parameterized generalized equations over cone reducible (nonpolyhedral)convex sets. It would be interesting to see results relaxing this sufficient condition. Bya careful study about the structure of Clarke’s generalized Jacobian of the metric pro-jector over the epigraph of a convex function, we showed that the semismoothness ofsolutions to the Moreau-Yosida regularization of a convex function can be obtained viathe semismoothness of the metric projector over the epigraph of the convex function. Weleave the study on the semismoothness of the metric projector over various interestingclosed convex sets such as closed homogeneous cones [3, 10] and the set of correlationmatrices [14] as a future research topic.

Page 20: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

580 F. Meng et al.

Acknowledgements. The authors are grateful to the referees for their helpful comments and suggestions.

References

1. Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer-Verlag, New York,2000

2. Chen, X., Nashed, Z., Qi, L.: Smoothing methods and semismooth methods for nondifferentiable operatorequations. SIAM Journal on Numerical Analysis 38, 1200–1216 (2000)

3. Chua, C.B.: Relating homogeneous cones and positive definite cones via T -algebras. SIAM Journal onOptimization 14, 500–506 (2004)

4. Clarke, F.H.: On the inverse function theorem. Pacific Journal of Mathematics 64, 97–102 (1976)5. Clarke, F.H.: Optimization and Nonsmooth Analysis. John Wiley and Sons, New York, 19836. Dontchev, A.L., Qi, H.-D., Qi, L.: Convergence of Newton’s method for convex best interpolation. Nu-

merische Mathematik 87, 435–456 (2001)7. Dontchev, A.L., Qi, H.-D., Qi, L.: Quadratic convergence of Newton’s method for convex interpolation

and smoothing. Constructive Approximation 19, 123–143 (2003)8. Eaves, B.C.: On the basic theorem of complementarity. Mathematical Programming 1, 68–75 (1971)9. Facchinei, F., Pang, J.S.: Finite-Dimensional Variational Inequalities and Complementarity Problems,

Vols I and II. Springer-Verlag, New York, 200310. Faybusovich, L.: On Nesterov’s approach to semi-infinite programming. Acta Applicandae Mathematicae

74, 195–215 (2002)11. Fischer, A.: Solution of monotone complementarity problems with locally Lipschitzian functions. Math-

ematical Programming 76, 513–532 (1997)12. Fukushima, M., Qi, L.: A global and superlinear convergent algorithm for nonsmooth convex minimiza-

tion. SIAM Journal on Optimization 6, 1106–1120 (1996)13. Gowda, M.S.: Inverse and implicit function theorems for H-differentiable and semismooth functions.

Optimization Methods and Software 19, 443–461 (2004)14. Higham, N.J.: Computing the nearest correlation matrix – a problem from finance. IMA Journal of

Numerical Analysis 22, 329–343 (2002)15. Hintermuller, M., Ito, K., Kunisch, K.: The primal-dual active strategy as a semismooth Newton method.

SIAM Journal on Optimization 13, 865–888 (2003)16. Hiriart-Urruty, J.B., Lemarechal, C.: Convex Analysis and Minimization Algorithms. Springer, Berlin,

199317. Kojima, M.: Strongly stable stationary solutions in nonlinear programs. In: Robinson, S. M. ed., Analysis

and Computation of Fixed Points. Academic Press, New York, 1980, pp 93–13818. Kruskal, J.: Two convex counterexamples: A discontinuous envelope function and a nondifferentiable

nearest-point mapping. Proceedings of the American Mathematical Society 23, 697–703 (1969)19. Kummer, B.: Newton’s method for non-differentiable functions. In: Guddat, J., et al., eds., Advances in

Mathematical Optimization. Akademie-Verlag, Berlin, 1988, pp 114–12520. Kummer, B.: Lipschitzian inverse functions, directional derivatives, and applications in C1,1-optimiza-

tion. Journal of Optimization Theory and Applications 70, 559–580 (1991)21. Kummer, B.: An implicit-function theorem for C0,1-equations and parametric C1,1-optimization. Journal

of Mathematical Analysis and Applications 158, 35–46 (1991)22. Kummer, B.: Newton’s method based on generalized derivatives for nonsmooth functions-convergence

analysis. In: Oettli, W., Pallaschke D. eds., Lecture Notes in Economics and Mathematical Systems 382;Advances in Optimization. Springer, Berlin, 1992, pp 171–194

23. Lemarechal, C., Sagastizabal, C.: An approach to variable metric methods. In: Henry, J., Yvon, J. P.eds., Systems Modelling and Optimization, Lecture Notes in Control and Information Sciences 197,Springer-Verlag, Berlin, 1994 pp 144–162

24. Lemarechal, C., Sagastizabal, C.: Practical aspects of the Moreau-Yosida regularization I: theoreticalpreliminaries. SIAM Journal on Optimization 7, 367–385 (1997)

25. Lemarechal, C., Strodiot, J.-J., Bihain, A.: On a bundle algorithm for nonsmooth optimization. NonlinearProgramming 4, (Madison, Wisconsin, 1980), Academic Press, New York, 1981 pp 245–282

26. Levy, A.B.: Nonsingularity conditions for multifunctions. Set-Valued Analysis 7, 89–99 (1999)27. Levy, A.B.: Lipschitzian multifunctions and a Lipschitzian inverse mapping theorem. Mathematics of

Operations Research 26, 105–118 (2001)28. Mifflin, R.: Semismooth and semiconvex functions in constrained optimization. SIAM Journal on Control

and Optimization 15, 957–972 (1977)

Page 21: Semismoothness of solutions to generalized equations and ... › ama › profile › dfsun › Meng... · introduced by Kojima [17] are two important concepts in perturbation analysis

Semismoothness of solution mappings 581

29. Mifflin, R.: Convergence of a modification of Lemarechal’s algorithm for nonsmooth optimization. Pro-gress in nondifferentiable optimization, 85–95, IIASA Collaborative Proc. Ser. CP-82, 8, Internat. Inst.Appl. Systems Anal., Laxenburg, 1982

30. Mifflin, R., Qi, L., Sun, D.: Properties of the Moreau-Yosida regularization of a piecewise C2 convexfunction. Mathematical Programming 84, 269–281 (1999)

31. Moreau, J.J.: Proximite et dualite dans un espace hilbertien. Bulletin de la Societe Mathematique deFrance 93, 273–299 (1965)

32. Ortega, J. M., Rheinboldt, W. C.: Iterative Solution of Nonlinear Equations in SeveralVariables.AcademicPress, New York, 1970

33. Outrata, J., Kocvara, M., Zowe, J.: Nonsmooth Approach to optimization Problems with EqulibriumConstraints: Theory, Applications and Numerical Results. Kluwer Academic Publishers, Dordrecht, 1998

34. Pang, J.S., Sun, D., Sun, J.: Semismooth homeomorphisms and strong stability of semidefinite and Lorentzcomplementarity problems. Mathematics of Operations Research 28, 39–63 (2003)

35. Penot, J. P.: Private Communication. 200136. Qi, L.: Convergence analysis of some algorithms for solving nonsmooth equations. Mathematics of

Operations Research 18, 227–244 (1993)37. Qi, L.: Second-order analysis of the Moreau-Yosida regularization. in Nonlinear Analysis and Convex

Analysis (Niigata, 1998), World Scientific Publishing, River Edge, New Jersey, 1999 pp 16–2538. Qi, L., Sun, J.: A nonsmooth version of Newton’s method. Mathematical Programming 58, 353–367

(1993)39. Robinson, S.M.: Strongly regular generalized equations. Mathematics of Operations Research 5, 43–62

(1980)40. Robinson, S.M.: First order conditions for general nonlinear optimization. SIAM Journal on Applied

Mathematics 30, 597–607 (1976)41. Rockafellar, R.T.: Convex Analysis. Princeton, New Jersey, 197042. Rockafellar, R.T., Wets, R. J.-B.: Variational Analysis. Springer-Verlag, New York, 199843. Schramm, H., J. Zowe, J.: A version of the bundle idea for minimizing a nonsmooth function: conceptual

idea, convergence analysis, numerical results. SIAM Journal on Optimization 2, 121–152 (1992)44. Shapiro, A.: Directionally nondifferentiable metric projection. Journal of Optimization Theory and Appli-

cations 81, 203–204 (1994)45. Shapiro, A.: Private Communication. March, 200346. Shapiro, A.: Sensitivity analysis of generalized equations. Journal of Mathematical Sciences 115, 2554–

2565 (2003)47. Sun, D.: A further result on an implicit function theorem for locally Lipschitz functions. Operations

Research Letters 28, 193–198 (2001)48. Sun, D., J. Sun, J.: Semismooth matrix valued functions. Mathematics of Operations Research 27, 150–

169 (2002)49. Sun, D., Sun, J.: Strong semismoothness of eigenvalues of symmetric matrices and its applications in

inverse eigenvalue problems. SIAM Journal on Numerical Analysis 40, 2352–2367 (2003)50. Thibault, L.: Subdifferentials of compactly Lipschitzian vector-valued functions. Annali di Matematica

Pura ed Applicata 125, 157–192 (1980)51. Thibault, L.: On generalized differentials and subdifferentials of Lipschitz vector-valued functions. Non-

linear Analysis: Theory, Methods, and Applications 6, 1037-1053 (1982)52. Yosida, K.: Functional analysis. Springer Verlag, Berlin, 196453. Zarantonello, E.H.: Projections on convex sets in Hilbert space and spectral theory I and II. In Zaran-

tonello, E. H. ed., Contribution to Nonlinear Functional Analysis, Academic Press, New York, 1971, pp237–424


Recommended