of 57
8/9/2019 Parallel Computation of the Singular Value Decomposition
1/57
ISSN0
249-6399
ISRNI
NRIA/RR--4694--FR+ENG
apport
de re che rch e
INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
Parallel computation of the singular value
decomposition
Michael W. Berry , Dani Mezher , Bernard Philippe , Ahmed Sameh
N4694
Janvier 2003
THME 4
8/9/2019 Parallel Computation of the Singular Value Decomposition
2/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
3/57
Unit de recherche INRIA RennesIRISA, Campus universitaire de Beaulieu, 35042 RENNES Cedex (France)Tlphone : 02 99 84 71 00 - International : +33 2 99 84 71 00Tlcopie : 02 99 84 71 71 - International : +33 2 99 84 71 71
8/9/2019 Parallel Computation of the Singular Value Decomposition
4/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
5/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
6/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
7/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
8/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
9/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
10/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
11/57
3.5 3 2.5 2 1.5 1 0.5 0 0.5 1
1
0.5
0
0.5
1
=1.09272e01
=6.67291e02
=4.42368e02
7 6 5 4 3 2 1 0
1.5
1
0.5
0
0.5
1
1.5 =1.09272e01
=6.67291e02
=4.42368e02
=1.85130e01
=1.17346e01
=1.51263e01
0.8644 0.8646 0.8648 0.865 0.8652 0.8654 0.8656 0.8658 0.866
6
4
2
0
2
4
6
x 104
=1.41959e04
=1.65758e04
=1.87017e04
8/9/2019 Parallel Computation of the Singular Value Decomposition
12/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
13/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
14/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
15/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
16/57
-
-
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
17/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
18/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
19/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
20/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
21/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
22/57
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
23/57
-
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
24/57
-
-
-
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
25/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
26/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
27/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
28/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
29/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
30/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
31/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
32/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
33/57
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
34/57
-
-
-
-
-
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
35/57
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
8/9/2019 Parallel Computation of the Singular Value Decomposition
36/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
37/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
38/57
t
y
x=t+z
z
x+y
O
8/9/2019 Parallel Computation of the Singular Value Decomposition
39/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
40/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
41/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
42/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
43/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
44/57
15 20 25 30 35 40 45 50 55 601000
2000
3000
4000
5000
6000
7000
8000
Number of processors
Time(ms)for1000AV(ATV)
Product A.V
. Product AT.V
15 20 25 30 35 40 45 50 55 6010
15
20
25
30
35
40
45
50
55
Number of processors
Speedup(referencedonr=17processors)
Product A.V
. Product AT.V
8/9/2019 Parallel Computation of the Singular Value Decomposition
45/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
46/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
47/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
48/57
0 .5 0.49 0.48 0.47 0.46 0.45 0.44 0.43 0.42 0.41
0.97
0.98
0.99
1
1.01
1.02
1.03
1.04
1.05
8/9/2019 Parallel Computation of the Singular Value Decomposition
49/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
50/57
0 2 4 6 8 10 12 14 16 18 200
5
10
15
OLM1000
RDB3200L
DW8192S
max
0 2 4 6 8 10 12 14 16 18 200.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1.1
1.2E
max
OLM1000
RDB3200L
DW8192
8/9/2019 Parallel Computation of the Singular Value Decomposition
51/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
52/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
53/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
54/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
55/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
56/57
8/9/2019 Parallel Computation of the Singular Value Decomposition
57/57
Unit de recherche INRIA Lorraine, Technople de Nancy-Brabois, Campus scientifique,615 rue du Jardin Botanique, BP 101, 54600 VILLERS LS NANCY
Unit de recherche INRIA Rennes, Irisa, Campus universitaire de Beaulieu, 35042 RENNES CedexUnit de recherche INRIA Rhne-Alpes, 655, avenue de lEurope, 38330 MONTBONNOT ST MARTIN
Unit de recherche INRIA Rocquencourt, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY CedexUnit de recherche INRIA Sophia-Antipolis, 2004 route des Lucioles, BP 93, 06902 SOPHIA-ANTIPOLIS Cedex
diteurINRIA, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY Cedex (France)
ISSN 0249-6399