+ All Categories
Home > Documents > KarcherMeaninElasticShapeAnalysiswhuang2/pdf/Poster_DIFFCV_Workshop.pdfKarcherMeaninElasticShapeAnalysis...

KarcherMeaninElasticShapeAnalysiswhuang2/pdf/Poster_DIFFCV_Workshop.pdfKarcherMeaninElasticShapeAnalysis...

Date post: 26-May-2020
Category:
Upload: others
View: 4 times
Download: 0 times
Share this document with a friend
1
Karcher Mean in Elastic Shape Analysis Wen Huang 1 , Yaqing You 2 K. A. Gallivan 2 , P.-A. Absil 1 1 Université catholique de Louvain, 2 Florida State University This paper presents research results of the Belgian Network DYSCO (Dynamical Systems, Control, and Optimization), funded by the Interuniversity Attraction Poles Programme initiated by the Belgian Science Policy Office. This work was supported by grant FNRS PDR T.0173.13. Introduction Shape analysis of curves is important in vari- ous area such as computer vision, medical di- agnostics, and bioinformatics. The basic idea is to obtain a boundary curve of an object in a 2D image or contours of a 3D object and analyse those curves to characterize the original object. Elastic shape analysis is receiving increasing at- tention due to its superior theoretical results and effectiveness. The price for the improved effectiveness is the relative increase in expense in computing various objects, e.g., geodesic- s and means. In this poster, we compare the performance of recent geodesic algorithm in [YHGA15] to the existing geodesic algorithm in [SKJJ11] in computing Karcher mean. Elastic Shape Analysis Inelastic shape analysis invariants: (i) Rescal- ing (ii) Translation (iii) Rotation. Elas- tic shape analysis additional invariant: (vi) Reparametrization. Figure 1: All are the same shape. Elastic shape analysis has been studied in many papers, e.g., [You98, KSMJ04, YMSM08, SKJJ11]. Figure 2: Geodesics without and with reparameterization are given by the frameworks of landmark-based Kendall’s shape analysis [Ken84, DM98] and elastic shape analysis [SKJJ11] re- spectively. Square Root Velocity The square root velocity (SRV) framework giv- en in [SKJJ11] for elastic shape analysis of gen- eral n dimensional curves is considered. In this poster, we only consider closed curves β (t): S 1 R n . Its square root velocity (SRV) function is q (t)= ˙ β (t) k ˙ β (t)k , where k·k denotes 2-norm. The preshape space l n (that removes translation and rescaling) is q L 2 | Z S 1 ||q (t)||dt =1, Z S 1 q (t)||q (t)||dt =0 . The shape space L n (that further removes rota- tion and reparameterization) is l n /× SO(n)) = { [q ]|q l n }, where [q ] denotes the closure of [q ] := O (q γ ) ˙ γ |(γ,O ) Γ × SO(n) , and SO(n) and Γ denote the rotation group and the repa- rameterization group respectively. Karcher Mean The Karcher mean of shapes [q i ],i =1, 2,...,N is defined to be the minimizer of the cost func- tion [q * ] = arg min [q ]∈L n 1 2N N X i=1 d 2 L n ( [q ], [q i ]). (1) where d L n ( [q ], [q i ]) = inf (γ,O)Γ×SO(n) d l n (q,O (q i γ ) p ˙ γ ). A representation of the gradient of (1) is giv- en by 1 N N i=1 ˙ α i (1), where α i l n is the mini- mum geodesic such that α i (1) = q and α i (0) [q i ]. (Numerically, we only guarantee to find a constant velocity geodesic.) Geodesic Algorithm The closed form of distance d L n is unknown, hence we compute it with an algorithm s- ketched in Figure 3. l n q 1 q 2 γ 0 γ 1 ...... γ * l n q 1 q 2 L n [q 1 ] [q 2 ] -grad q 2 dist l n q 1 2 ...... q * 2 Figure 3: Left: Path-straightening method [SKJJ11] in l c n ; Right: Remove rotation and reparameterization. Two approaches for removing rotation and reparameterization (i.e., finding q * 2 in [q 2 ]) are used: (i) Coordinate descent method [SKJJ11] (ii): Riemannian quasi-Newton method [YHGA15]. references [DM98] I. L. Dryden and K. V. Mardia. Statistical shape analysis. Wiley, 1998. [DS83] J. E. Dennis and R. B. Schnabel. Numerical methods for unconstrained optimization and nonlinear equations. Springer, New Jersey, 1983. [Ken84] D. G. Kendall. Shape manifolds, procrustean metrics, and complex projective spaces. Bulletin of the London Mathematical Society, 16(2):81–121, March 1984. [KSMJ04] E. Klassen, A. Srivastava, W. Mio, and S. H. Joshi. Analysis of planar shapes using geodesic paths on shape spaces. IEEE transactions on pattern analysis and machine intelligence, 26(3):372–83, March 2004. doi:10.1109/TPAMI.2004.1262333. [SKJJ11] A. Srivastava, E. Klassen, S. H. Joshi, and I. H. Jermyn. Shape analysis of elastic curves in Euclidean spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(7):1415–1428, September 2011. doi:10.1109/TPAMI.2010.184. [Uni] Temple University. Shape similarity research project. www.dabi.temple.edu/ shape/MPEG7/dataset.html. [YHGA15] Y. You, W. Huang, K. A. Gallivan, and P.-A. Absil. A Riemannian Approach for Computing Geodesics in Elastic Shape Analysis. In Proceedings of the 3rd IEEE Global Conference on Signal and Information Processing, Accepted, 2015. [YMSM08] L. Younes, P. Michor, J. Shah, and D. Mumford. A metric on shape space with explicit geodesics. Rendiconti Lincei - Matematica e Applicazioni, 9(1):25–57, 2008. doi:10.4171/RLM/506. [You98] L. Younes. Computable elastic distances between shapes. SIAM Journal on Applied Mathematics, 58(2):565–586, April 1998. doi:10.1137/S0036139995287685. Algorithm Algorithm 1 Karcher Mean Input: Curves β i ,i =1,...,N and initial iter- ate β (0) . 1: Compute the representations q (0) of β (0) and q i of β i , i =1,...,N in l n . Set k =0. 2: Compute the shortest curve α i such that α i (1) = q (k) and α i (0) [q i ] for all i = 1,...,N . The values of the cost function (1) and its gradient are obtained during this computation. 3: Apply the backtracking line search algo- rithm [DS83, Algorithm A6.3.1] and find the step size λ k and the next iterate q (k+1) = R q (k) (-λ k ζ k ), (2) where ζ k = 1 N N i=1 ˙ α i (1) is the gradient of (1). 4: If some stopping criterion is satisfied, then stop. Else, k k +1 and goto Step 2. Experiments The MPEG-7 dataset [Uni] is used in the ex- periments. Algorithm 1 with the approach- es in [SKJJ11] and [YHGA15] are denoted by MeanCD and MeanLRBFGS respectively. Table 1: Computational time, number of iterations and final cost function values of reported tests. t, iter and f denote com- putational time (second), number of iterations and final cost function value respectively. The subscript k indicates a scale of 10 k . MeanCD [SKJJ11] MeanLRBFGS [YHGA15] t iter f t iter f Figure 4 2.94 2 27 5.03 -2 9.87 1 8 4.99 -2 Figure 5 7.05 2 26 3.93 -2 4.55 2 14 3.67 -2 Figure 6 1.46 3 19 1.18 -1 6.77 2 8 7.40 -2 Figure 4: A representative test. The sample shapes and the Karcher means by MeanCD and MeanLRBFGS, cost function values and computational time are given. Figure 5: A representative test. The sample shapes and the Karcher means by MeanCD and MeanLRBFGS are given. Figure 6: A representative test. The samples shapes, Karcher means by MeanCD and MeanLRBFGS are given. Conclusion and Future Work Two approaches for computing elastic shape geodesics required have been given in [SKJJ11] and [YHGA15]. Here we have compared their performance in computing the Karcher mean. We have shown that Algorithm 1 with the ap- proach in [YHGA15] converges faster. In the future, we will test the quality of the Karcher mean by MeanLRBFGS in the sense of superior clustering, classification and stochas- tic analysis.
Transcript
Page 1: KarcherMeaninElasticShapeAnalysiswhuang2/pdf/Poster_DIFFCV_Workshop.pdfKarcherMeaninElasticShapeAnalysis Wen Huang1, Yaqing You2 K. A. Gallivan2, P.-A. Absil1 1Université catholique

Karcher Mean in Elastic Shape AnalysisWen Huang1, Yaqing You2 K. A. Gallivan2, P.-A. Absil1

1Université catholique de Louvain, 2Florida State UniversityThis paper presents research results of the Belgian Network DYSCO (Dynamical Systems, Control, and Optimization), funded by the Interuniversity Attraction Poles Programme initiated by the Belgian Science Policy Office. This

work was supported by grant FNRS PDR T.0173.13.

IntroductionShape analysis of curves is important in vari-ous area such as computer vision, medical di-agnostics, and bioinformatics. The basic idea isto obtain a boundary curve of an object in a 2Dimage or contours of a 3D object and analysethose curves to characterize the original object.Elastic shape analysis is receiving increasing at-tention due to its superior theoretical resultsand effectiveness. The price for the improvedeffectiveness is the relative increase in expensein computing various objects, e.g., geodesic-s and means. In this poster, we compare theperformance of recent geodesic algorithm in[YHGA15] to the existing geodesic algorithm in[SKJJ11] in computing Karcher mean.

Elastic Shape AnalysisInelastic shape analysis invariants: (i) Rescal-ing (ii) Translation (iii) Rotation. Elas-tic shape analysis additional invariant: (vi)Reparametrization.

Figure 1: All are the same shape.

Elastic shape analysis has been studied inmany papers, e.g., [You98, KSMJ04, YMSM08,SKJJ11].

Figure 2: Geodesics without and with reparameterization aregiven by the frameworks of landmark-based Kendall’s shapeanalysis [Ken84, DM98] and elastic shape analysis [SKJJ11] re-spectively.

Square Root VelocityThe square root velocity (SRV) framework giv-en in [SKJJ11] for elastic shape analysis of gen-eral n dimensional curves is considered.In this poster, we only consider closed curvesβ(t) : S1 → Rn. Its square root velocity (SRV)function is q(t) = β̇(t)√

‖β̇(t)‖, where ‖ · ‖ denotes

2-norm.The preshape space ln (that removes translationand rescaling) is{q ∈ L2|

∫S1||q(t)||dt = 1,

∫S1q(t)||q(t)||dt = 0

}.

The shape space Ln (that further removes rota-tion and reparameterization) is

ln/(Γ× SO(n)) = {[q]|q ∈ ln},

where [q] denotes the closure of [q] :={O(q ◦ γ)

√γ̇|(γ,O) ∈ Γ× SO(n)

}, and SO(n)

and Γ denote the rotation group and the repa-rameterization group respectively.

Karcher MeanThe Karcher mean of shapes [qi], i = 1, 2, . . . , Nis defined to be the minimizer of the cost func-tion

[q∗] = arg min[q]∈Ln

1

2N

N∑i=1

d2Ln

([q], [qi]). (1)

where

dLn([q], [qi]) = inf

(γ,O)∈Γ×SO(n)dln(q,O(qi◦γ)

√γ̇).

A representation of the gradient of (1) is giv-en by 1

N

∑Ni=1 α̇i(1), where αi ⊂ ln is the mini-

mum geodesic such that αi(1) = q and αi(0) ∈[qi]. (Numerically, we only guarantee to find aconstant velocity geodesic.)

Geodesic AlgorithmThe closed form of distance dLn is unknown,hence we compute it with an algorithm s-ketched in Figure 3.

lnq1

q2

γ0

γ1

......γ∗

lnq1

q2

Ln[q1] [q2]

−gradq2distln

q12

......

q∗2

Figure 3: Left: Path-straightening method [SKJJ11] in lcn;Right: Remove rotation and reparameterization.

Two approaches for removing rotation andreparameterization (i.e., finding q∗2 in [q2]) areused: (i) Coordinate descent method [SKJJ11](ii): Riemannian quasi-Newton method[YHGA15].

references[DM98] I. L. Dryden and K. V. Mardia. Statistical shape analysis. Wiley, 1998.[DS83] J. E. Dennis and R. B. Schnabel. Numerical methods for unconstrained optimization and nonlinear equations. Springer, New Jersey, 1983.

[Ken84] D. G. Kendall. Shape manifolds, procrustean metrics, and complex projective spaces. Bulletin of the London Mathematical Society, 16(2):81–121, March 1984.[KSMJ04] E. Klassen, A. Srivastava, W. Mio, and S. H. Joshi. Analysis of planar shapes using geodesic paths on shape spaces. IEEE transactions on pattern analysis and machine intelligence, 26(3):372–83,

March 2004. doi:10.1109/TPAMI.2004.1262333.[SKJJ11] A. Srivastava, E. Klassen, S. H. Joshi, and I. H. Jermyn. Shape analysis of elastic curves in Euclidean spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(7):1415–1428,

September 2011. doi:10.1109/TPAMI.2010.184.[Uni] Temple University. Shape similarity research project. www.dabi.temple.edu/ shape/MPEG7/dataset.html.

[YHGA15] Y. You, W. Huang, K. A. Gallivan, and P.-A. Absil. A Riemannian Approach for Computing Geodesics in Elastic Shape Analysis. In Proceedings of the 3rd IEEE Global Conference on Signaland Information Processing, Accepted, 2015.

[YMSM08] L. Younes, P. Michor, J. Shah, and D. Mumford. A metric on shape space with explicit geodesics. Rendiconti Lincei - Matematica e Applicazioni, 9(1):25–57, 2008. doi:10.4171/RLM/506.[You98] L. Younes. Computable elastic distances between shapes. SIAM Journal on Applied Mathematics, 58(2):565–586, April 1998. doi:10.1137/S0036139995287685.

AlgorithmAlgorithm 1 Karcher Mean

Input: Curves βi, i = 1, . . . , N and initial iter-ate β(0).

1: Compute the representations q(0) of β(0)

and qi of βi, i = 1, . . . , N in ln. Set k = 0.2: Compute the shortest curve αi such thatαi(1) = q(k) and αi(0) ∈ [qi] for all i =1, . . . , N . The values of the cost function (1)and its gradient are obtained during thiscomputation.

3: Apply the backtracking line search algo-rithm [DS83, Algorithm A6.3.1] and findthe step size λk and the next iterate

q(k+1) = Rq(k)(−λkζk), (2)

where ζk = 1N

∑Ni=1 α̇i(1) is the gradient

of (1).4: If some stopping criterion is satisfied, then

stop. Else, k ← k + 1 and goto Step 2.

ExperimentsThe MPEG-7 dataset [Uni] is used in the ex-periments. Algorithm 1 with the approach-es in [SKJJ11] and [YHGA15] are denoted byMeanCD and MeanLRBFGS respectively.Table 1: Computational time, number of iterations and finalcost function values of reported tests. t, iter and f denote com-putational time (second), number of iterations and final costfunction value respectively. The subscript k indicates a scale of10k .

MeanCD [SKJJ11] MeanLRBFGS [YHGA15]t iter f t iter f

Figure 4 2.942 27 5.03−2 9.871 8 4.99−2Figure 5 7.052 26 3.93−2 4.552 14 3.67−2Figure 6 1.463 19 1.18−1 6.772 8 7.40−2

Figure 4: A representative test. The sample shapes and theKarcher means by MeanCD and MeanLRBFGS, cost functionvalues and computational time are given.

Figure 5: A representative test. The sample shapes and theKarcher means by MeanCD and MeanLRBFGS are given.

Figure 6: A representative test. The samples shapes, Karchermeans by MeanCD and MeanLRBFGS are given.

Conclusion and Future WorkTwo approaches for computing elastic shapegeodesics required have been given in [SKJJ11]and [YHGA15]. Here we have compared theirperformance in computing the Karcher mean.We have shown that Algorithm 1 with the ap-proach in [YHGA15] converges faster.In the future, we will test the quality of theKarcher mean by MeanLRBFGS in the sense ofsuperior clustering, classification and stochas-tic analysis.

Recommended