National Computational Science Alliance A Review of User Projects at the Alliance Leading Edge Site...

National Computational Science Alliance

A Review of User Projects at the Alliance Leading Edge Site

• Opening Talk to the Alliance Allocation Board

• Hosted by the Maui High Performance Computing Center, Maui, Hawaii, December 5, 1998.


The National PACI Program -Partners and Supercomputer Users

850 Projects in 280 Universities60 Partner Universities


PITAC Draft Refinement of High-End Acquisition Recommendation

• Fund the Acquisition of the Most Powerful High-End Computing Systems to Support Long Term Basic Research in Science and Engineering

• Access for (Highest Priority):

– ALL Academic Researchers– ALL Disciplines– ALL Universities

• Access for (Second Priority):– Government Researchers– Industrial Researchers


Emerging Multi-Agency Effort to Create a Persistent National Technology Grid

• NSF Establishes PACI Program• DOE Raises the Bar

– ASCI and SSP– Data and Visualization Corridors

• DoE Discussing with NSF: – How to Get Highest-End Capacity– PACI ET and AT Teams Linking to ASCI, SSP

• NASA and NSF on Information Power Grid• DoD Mod. PET Innovating Infrastructure • NIH Seen As Critical Partner


Deputy Director Bordogna on NSF Leadership in Information Technologies

• Three Important Priorities for NSF in the Area of IT for the Future:

– The First Area Is Fundamental and High-Risk IT Research and Advanced Computation Research.

– The Second Priority Area for NSF Is Competitive Access and Use of High-end Computing and Networking.

– The Third Priority Is Investing in IT Education at All Levels.

Congressional Testimony 10/6/98


NCSA is Combining Shared Memory Programming with Massive Parallelism

1

10

100

1000

10000

Jan

-94

Jan

-95

Jan

-96

Jan

-97

Jan

-98

Jan

-99

Jan

-00

Jan

-01

SG

I Pro

cess

ors

Doubling Every Nine Months!

Challenge

Power Challenge

Origin

SN1


The Rapid Increase in High End Capacity at NCSA

0

1

2

3

4

5

FY93 FY94 FY95 FY96 FY97 FY98

NU

s U

se

d A

nn

ua

lly (

Mill

ion

s)

Millions of NUs Used at NCSA FY93 to FY98


NCSA Users by System -SGI Origin Takes Off!

0

100

200

300

400

500

600S

ep

94

Nov9

4

Jan

95

Mar9

5

May9

5

Jul9

5

Sep

95

Nov9

5

Jan

96

Mar9

6

May9

6

Jul9

6

Sep

96

Nov9

6

Jan

97

Mar9

7

May9

7

Jul9

7

Sep

97

Nov9

7

Jan

98

Mar9

8

May9

8

Jul9

8

Sep

98

Nu

mb

er

of

Users

SGI Power Challenge ArrayCM5

Convex C3880Convex ExemplarCray Y-MPOriginSPP-2000

C3880 (retired 10/95)

SPP-1200

Y-MP

(retired 12/94)

Origin

SPP-2000

CM-5(retired 1/97)

PCA(retired 7/98)

(retired 5/98)


Distribution of Project Size at NCSA in FY98

10

100

1000

10000

100000

1000000

1

34

67

10

0

13

3

16

6

19

9

23

2

26

5

29

8

33

1

Projects in Ranked Order

An

nu

al N

Us

Pe

r P

roje

ct Super

Medium

Large

Small

Tiny

AAB

SAC

NRAC


NCSA Has Greatly Increased High-End Capacity

0

500000

1000000

1500000

2000000

2500000

Super Large Medium Small Tiny

NU

s P

er

Ye

ar

FY94

FY98


Little Percentage Change in Shares Over Five Years

0

0.1

0.2

0.3

0.4

0.5

0.6


Perc

en

t o

f To

tal FY94

FY98


Migration of NCSA User Distribution Toward the High End

0

20

40

60

80

100

120

140

160

180

200


Nu

mb

er

of

An

nu

al P

roje

cts

FY94

FY98

+400%

+350%

+114%

-27%

-79%

Number of Projects


Let’s Blow This Up!Let’s Blow This Up!

The Growth Rate of the National Capacity is Slowing Down Again

10,000

100,000

1,000,000

10,000,000

100,000,000

1,000,000,000

1986

1988

1990

1992

1994

1996

1998

2000

2002

Fiscal Year

No

rmal

ized

CP

U H

ou

rs

Total NU

70% Annual Growth This Year

Source: Quantum Research


Major Gap Has Developed in National Usage at NSF Supercomputer Centers

-

500,000

1,000,000

1,500,000

2,000,000

2,500,000

3,000,000

3,500,000

Oct

-95

Ap

r-96

Oct

-96

Ap

r-97

Oct

-97

Ap

r-98

Oct

-98

Ap

r-99

Oct

-99

NU

s U

sed

Per

Yea

r

Grand Total

70% Growth Rate

Projection


Fastest Machine in Top500 vs. Fastest Machine in NSF Supercomputer Centers

0

500

1000

1500

1994 1995 1996 1997 1998

Year

Gig

afl

op

sHighest NSF highest

Source: ACIR, NSF


Alliance Efforts to Increase Capacity and Capability

• Alliance LES– Took Early Delivery of 5th and 6th 128p Origin in June ‘98– Just Ordered 256 SSI Origin to Complete 1024p

– Goal is Production by March ‘99

– Hardening the 256p NT Supercluster for Selected Users– May Upgrade HP Exemplar to HPUX V-Series– Sun E10000 Data Mining Server?

• Alliance PACS– Allocating up to 1 Million SUs in FY99– LES/PACS Discussions on:

– Linux Intel Superclusters at Maui– Combining HPs at U Kentucky– Linux/NT Compaq (DEC) Alpha SMP Cluster at BU– Grid Alpha/Beta Testbed in CIC


The Transformation of an Industry in Five Years- TOP500 Systems by Vendor

TOP500 Reports: www.netlib.org/benchmark/top500.html

CRI

SGI

IBM

Convex

HP

SunTMCIntel

DECCompaqJapanese

Other

0

100

200

300

400

500Ju

n-9

3

No

v-93

Jun

-94

No

v-94

Jun

-95

No

v-95

Jun

-96

No

v-96

Jun

-97

No

v-97

Jun

-98

No

v-98

Nu

mb

er

of

Sy

ste

ms

Other

Japanese

Compaq

DEC

Intel

TMC

Sun

HP

Convex

IBM

SGI

CRI


Cycles Used by NSF Community at the NSF Supercomputer Centers by Vendor

SGI/Cray

IBM

HP

DEC

SGI SN1 is the Natural Upgrade for 84% of Cycles!

June 1, 1997 through May 31, 1998CTC, NCSA, PSC, SDSC

1019 Projects Using 100% of the Cycles

T3D/EOrigin/PC

C/T90


• Clustered Shared Memory Architecture– Will Dominate for 5-10 Years– Builds on Market Supported Segments

• Scalability Has Acquired Two Dimensions– Parallelism of Shared Memory Nodes– Number of Shared Nodes in Cluster

• New Challenges for Supercomputing Users– Memory Hierarchies– Fault Tolerance– Hybrid Programming Models

Capability Computing Will Be Done on Scalable Clusters of Shared Memory Modules


Most Capacity in High End Computing Will Be Local

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1995 1996 1997

Wo

rkst

atio

ns

Sh

ipp

ed (

Mill

ion

s)

UNIX

NT

The Emerging Wintel Supercomputer

Linux, NT Scalable ClustersCondor, Symera LANs of Workstations

Harvesting the Web


128 Hewlett Packard 300 MHz

64 Compaq 333 MHz

• Andrew Chien, CS UIUC-->UCSD• • Rob Pennington, NCSA• Reagan Moore, SDSC

• Plan to Link UCSD & UIUC Clusters

“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft

PACI Fostering Commodity Computing

Various Applications Sustain 7 GF on 128 Processors


0

1

2

3

4

5

6

7

0

10

20

30

40

50

60

Processors

Gig

afl

op

s

Origin-DSM

Origin-MPI

NT-MPI

SP2-MPI

T3E-MPI

SPP2000-DSM

Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems

Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner

(2D 1024x1024)

Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD)

VariousApplicationsSustaining

7 GF on 128 Processors

NT Supercluster


QCD Performance on Various High End Computers

Doug Toussaint and Kostas Orginos, University of Arizona

Conjugate Gradient Calculation of Quark Propagators in QCD With Kogut-Susskind Quarks


User Web BrowserOutput to User

User Input

Format Translator, Query Engine and Program Driver

Workbench Server

Results to User

User Instructions and queries

Application Programs

(May have varyinginterfaces and be written in different

languages)Results

Instructions

Information Sources(May be of

varying formats)

Information

Queries

NCSA Computational Biology Group

The NCSA Information Workbench - An Architecture for Web-Based Computing


Structure & Function

Pathways & Physiology

Populations& Evolution

Ecosystems

Genomes

Gene Products

Using a Web Browser to Run Programs and Analyze Data Worldwide

NCSA Biology WorkbenchHas Over 10,000 Users From Over 25 Countries

Date post:	19-Jan-2016
Category:	Documents
Upload:	doris-obrien
View:	212 times
Download:	0 times

National Computational Science Alliance A Review of User Projects at the Alliance Leading Edge Site...

Documents