Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.

Post on 16-Jan-2016

221 views 4 download

Tags:

transcript

Dr Neil Geddes CCLRC Head of e-Science

Director of the UK Grid Operations Support Centre

UK Core e-Science programme - Situation Today

* LeedsManchester *

* OxfordRAL *

Level-2 Grid

National Grid Service

* DL

The Future According to Hey

NGS

UK Grid OperationsSupport Centre

NGS “Today”

Projectse-Mineralse-MaterialsOrbital Dynamics of GalaxiesBioinformatics (using BLAST) GEODISE projectUKQCD Singlet meson projectCensus data analysis MIAKT projecte-HTPX project.RealityGrid (chemistry)

Users LeedsOxfordUCLCardiffSouthamptonImperialLiverpoolSheffieldCambridgeEdinburghQUBBBSRCCCLRC.

InterfacesOGSI::LiteOGSI::LiteWSRF::LiteWSRF::Lite

SRB serviceOGSA-DAI service

Also includes:

http://www.csar.cfs.ac.uk/256 Itanium2 processor SGI Altix512 processor Origin3800

•Thus, the NGS provides access to over 2000 processors, over 36TB of "data-grid"

capacity, common scientific applications and extensive data archives.

•Other resource providers anticipated to join in the future …

http://www.hpcx.ac.uk/Full installation = 1600 IBM p690+ Regatta processors currently 1236 processors

EMBL Nucleotide Sequences

NCBI, BLAST, EMBOSS, FASTA, Gaussian

GOSC Roles UK Grid Services

National Services Authentication, authorisation, certificate management, VO management,

security, network monitoring, help desk + support centre. NGS Services

Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre.

NGS core-node Services CPU, (meta-) data storage, key software

Services to be coordinated with others (eg OMII, NeSC, LCG): Integration testing, compatibility & Validation Tests, User Management,

training

Administration: Policies and acceptable use SLA’s, SLD’s Coordinate deployment and Operations

UKCampus

andother Grids

GOSC + ETF

• Core of GOSC built around experience in deploying and running National Grid Service (NGS)

– Support service

• Important to coordinate and integrate this with deployment and operations work in EGEE, LCG and similar projects.

– e.g. EGEE – low level services, CA, GOC, CERT...

• Focus on deployment and operations, NOT development.

OMII

ETF

NGSOther software sources Software with proven

capability & realistic deployment experience

‘Gold’ services

Prototypes &specifications

Feedback & future requirements

EGEE…

Deployment/testing/advice

Operations

ETF• Registry

– A freely available UDDI implementation has been deployed/tested between 4 sites – Experience passed on to the GRIMOIRES OMII project.

• Secure Flocking of Condor– Condor pools at 4 sites have been flocked together, through firewalls– authentication through use of X.509 certifcates– OMII test bed

• Portals– Support access to the NGS.– Tied in with JISC VRE developments

• Evaluations– InnerGrid - Contractual issues delayed start - just started.– OMII – Start later this month– GT4 – Start later this month– gLite – start next month

Stuff We Don’t Do

• Run a repository• Develop software

– contribute to developments to influence/adapt cf “I’ve got one of those you can have. You just need to …”

• (Training – Edinburgh/NeSC are part of GOSC)• Extensive user hand-holding and app support

– Need the e-Science Centres– Priorities will be driven by users

UofA

HPCx

UofD

GOSC

NGS Core Nodes: Host core services, coordinate integration, deployment and support+free to access resources for all VOs. Monitored interfaces + services

NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services

NGS Connected Sites: Integrated with NGS, support for some VO’sMonitored interfaces (+security etc.)

RAL Oxford

LeedsMan. CSAR

UofB

UofC

CommercialProvider

PSRE

How do I Join ?

• Acceptable use and Security policies• Install required interfaces (~EGEE)

– VDT– EGEE CE and SE interfaces (and

Authorisation)– Monitoring and accounting

• Provide services as defined in your own SLD– Buys you representation at the board (?)

GOSC Timeline

Q2 Q4 Q2 Q3Q1Q4Q3Q2Q1Q3

2004 20062005

EGEE gLite alpha release

gLite release 1

OMII release

NGS Expansion(Bristol, Cardiff…)

OGSA-DAI

WS plan

NGS ProductionService

NGS WS Service

EGEE gLite releaseOMII Release

NGS Expansion

WS2 plan

NGS WS Service 2

“Tomorrow”

Web Services based National Grid Infrastructure

UK e-Infrastructure

LHC ISIS TS2HPCx + HECtoR

Regional and Campus grids

Users get common access, tools, information, Nationally supported services, through NGS

Integratedinternationally

VRE, VLE, IE

Core services to facilitate collaborative (grid) computing – run by GOSC

•Authentication (PKI X509)•Job submission/batch service•Resource brokering•Authorisation•Virtual Organisation management •Certificate management•Information service•Data access/integration services (SRB/OGSA-DAI/DQPS)•National Registry (of registry’s)•Data replication•Data caching•Grid monitoring•Accounting

UK e-Science Cert.gsi-ssh, globus-job-submit, condorGEDG-RBVOM/VOMSVOMS (+Grid3/EGEE)myProxy(++)BDII/Glue

? ETF ?? EGEE ?? EGEE ?EGEE/LCG + ETF +TeraGridEGEE/LCG/ETF/GGF

Web Services interfa

ces

Timeline

Q2 Q4 Q2 Q3Q1Q4Q3Q2Q1Q3

2004 20062005

EGEE gLite alpha release

gLite release 1

OMII release

NGS Expansion(Bristol, Cardiff…)

OGSA-DAI

WS plan

NGS ProductionService

NGS WS Service

EGEE gLite releaseOMII Release

NGS Expansion

WS2 plan

NGS WS Service 2

The End

NGS Status October 2004• All 4 cluster nodes (+HPC) operational

– Pre-Production 5th April– Production Service from September 1

• 120 registered users– 20 users registered since 1 September 2004– Not yet “full”