Migliori@enea.it ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT WORKSHOP...

transcript

migliori@enea.itwww.cresco.enea.it

ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY

AND THE ENVIRONMENT

WORKSHOPREMOTE MICROSCOPY FOR ELECTRON MICROSCOPY

ContentsENEA-GRID infrastructure (www.afs.enea.it/project/eneagrid)

CRESCO and Telemicroscopy(www.cresco.enea.it)

Silvio Migliori; Giovanni Bracco; Salvatore Podda; Andrea Quintiliani; Marco Vittori

ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM)

CRESCO Supercomputer and Telemicroscopy integrated in ENEA-GRID infrastructure

ENEA-GRID

Sensor nets

ENEA-GRID

Born in 1998 with 6 Italian geographic clusters Main aim

– Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software

– Build an homogeneous ICT infrastructure but with a distributed and delegated control

– Integrate the ENEA-GRID with National and International GRIDS

www.afs.enea.it/project/eneagrid

Data archivesColleagues & 3D

Softwarecatalogs

ComputersApplication

Fabric

Connectivity

Resource

Collective

THE CONCEPT OF ENEA GRID INFRASTRUCTURETHE CONCEPT OF ENEA GRID INFRASTRUCTURE

QuickTime™ and a YUV420 codec decompressor are needed to see this picture.

Cell Centered Data Base Cell Centered Data Base ““CCDB”CCDB”

IMAGING-INSTRUMENTSIMAGING-INSTRUMENTS COMP.-RESOURCESCOMP.-RESOURCES MULTI-SCALE-DATA-BASESMULTI-SCALE-DATA-BASES

NETWORKNETWORK

ADV.-COMP.-GRAPHICSADV.-COMP.-GRAPHICSDATA ANALYSISDATA ANALYSISDATA ACQUISITIONDATA ACQUISITION

By-Mark EllismanBy-Mark Ellisman

ENEA-GRID from the user point of view Main feature:

– Access from any kind of connection– Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client – Running any kind of programs – Access to National and International GRIDS

Sensor nets

Data archives

Computers

Portici (

Roma-1

Bologna EU…Brindisi Roma-2

Trisaia

Software catalogs

ComputersComputersComputers

Computers

Sensor netsEN

ENEA-GRID from application point of view Potentiality:

– Running all Software Model for any kind of computer architecture – Only one installation for each software for all geographical computers– All authorized users can have access the software from local site – Any application can share the data in the common geographical file system– All sensors can share the data easily using the geographical file systems

Sensor nets

Computers

Portici (

Roma-1

Bologna EU…Brindisi Roma-2

Trisaia

Software catalogs

Computers

Sensor netsEN

Software Model 1

Software Model 2

Software Model 3

Software Model ..

Computers

AFS Geographical cross platform & File System

AIX SGI SUN HP Win

Linux Alpha

User programs and commercial codes

LSF multi-cluster as integrator

Graphical User Interface

Application Portal (ICA-Protocol)

ICAWEB

ecovery

ENEA GRID

Load Leveler LSF

Graphic User Interface LSF multi-cluster as integratorTelnet

User programs & commercial code

ICAWEB

Cluster 5° ( Portici)

& File System

Load Leveler LSF

Graphic User Interface

Telnet

ICAWEB

Cluster 6° ( Brindisi)

AFS Geographical cross platform& File System

Load Leveler LSF

Graphic User Interface LSF multi-cluster as integrator

Telnet

ICAWEB

Cluster 2° (Casaccia)

Load Leveler LSF

Telnet

ICAWEB

Cluster 4° (Trisaia )

Load Leveler LSF

Telnet

ICAWEB

Cluster 3° (Frascati)

Load Leveler LSF

Telnet

ICAWEB

Cluster 1° ( Bologna)

A Simple view of ENEA GRID

CASACCIACASACCIA

FRASCATIFRASCATI

S.TeresaS.Teresa

SaluggiaSaluggia

IspraIspra

BOLOGNABOLOGNA

PORTICIPORTICI

TRISAIATRISAIA

BRINDISIBRINDISI

ManfredoniaManfredonia

ENEA-GRID Computational & 3D Centers

902750

#CPU/Core

ENEA-GRID Computational Resources

Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575)

Frascati(4), Portici(34),Trisaia(4), Brindisi(4)

10046Windows 32/64

Frascati(1), Trisaia(13)6014Mac OS X

Trisaia(4), Casaccia(2), Bologna(2)108Solaris

Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5)

4026IRIX

Casaccia30064Linux IA64 (Altix)

Frascati(140), Casaccia(54), Portici(2700),Trisaia(20), Brindisi(84)

25000>3000Linux x86 32/64

Frascati(258), Bologna(24), Portici(18),Brindisi(2)

3000>300AIX

Gflops#CPU/Core OS

HPC CRESCO INFRASTRUCTURE

Portici LAN

Interconnections InfiniBand4XDDR SERVERS GPFS

4 Nodi IBM 3650

High speed disc2 GByte/s

160 TByte IBM/DDN 9550

Backup system300 TByte

IBM Tape Library TS3500 with 4 drives

SERVERS BACKUP3 Nodi IBM 3650

GARR(WAN)

Section 1(Large memory)

42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton

Section 3(Special)

4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each.6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX54 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM

Double interconnection at 1 Gbit& 1 network at 1 Gbit for management

Section 2(MPP)

256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MHz/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown

4x10 Gbits 1000 Mbits

35 Node for services

Servers for :•Front-end•installations•AFS•…

CRESCO17 TFlops

1000 Mbits

CRESCO HPC hall

CRESCO HPC details

Sections 1 & 3 Section 2 & DDN

Control room backup systemnetwork: IB/GB

Corridor hotSections 1 &2

Computational abilityENEA-GRID & CRESCO

An heterogeneous system with more than 3000 CPU/cores

Code Risorsa

Serial Section 1 & ENEA-GRID

Parallel hardly coupled Section 2

Embarrassing parallel Section 1, 2, ENEA-GRID

System with several parallel codes

Section 1, 2, Section 1+2

Special ( FPGA, GB, CELL) Section 3

windows (serial and parallel) Section 3

Not LINUX ENEA-GRID

Large date “Data Base” Section 1,2,3 e GPFS

Jack Dongarra 2002

CRESCO in the Top500 List June 2008

Italy (06/2008)

90 CINECA

125 ENEA

131 ENI

135 CILEA

156 CINECA

226 Telecom

AccessoClient

AccessoWEB

sp4_-1.frascati.enea.it

boquad.bologna.enea.it

dafne.casaccia.enea.it

2 0 0 8

infocal.trisia.enea.it

Gatewayto

EGEE & GRISU

Portici

Brindisi

Kleos.portici.enea.it

ercules.brindisi.enea.it

AccessoDiretto www.afs.enea.it/project/eneagrid

CPUSENEA GRID

WEBICASSH

DNA Sequence system

( ABI Prism 3700)Trisaia

Electron Microscope (Brindisi)

300 KeV (sept. 2004)

ENEA GRID and experimental facilities

Controlled Nuclear Fusion:

FTUFrascati Tokamak

UpgradeVideo Acquisition

ENEA-GRID for experimental facilities Main feature:

– Access from any kind of connection– Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client

Sensor nets

Portici (

Roma-1

EU… USA…Brindisi Roma-2

Trisaia

Sensor nets

Logical access (AFS)

migliori@enea.itwww.cresco.enea.itCorso SISM 9-10 Ottobre 2007

migliori@enea,it

Università(Salerno)

ENEAPortici

ORNL(USA)

ENEA(Trisaia)

ENEA AFS ‘’DATA BASE’’

Università(……….)

Conceptual structure for TEM

300 KeV (sept. 2004)

RemoteLocal

Operation

TEM Room

Local Operation

Remote ControlledWeb-cam

Remote User

Local DataAFS Data Integration

> 4 TByte

Mtaframe

Special Driver for TEM

Local GRID Cluster

Conceptual structure from a remote user’s point of view

> 4 TByte

File server

Streaming server

Citrix XenApp Windows

Linux Cluster

WEB Sever

Citrix XenApp Unix

Web conferencing

Classroom

Local GRID Cluster

Main service

•View of TEM image•Programs & Data•E-learning tools

•View of TEM image•Programs & Data•Supercomputing •3D Display•E-learning tools

Remote Operation Users

Remote Application Users

+Remote operation

ICA protocol

migliori@enea,it

Data Sinconization AFS (1)

migliori@enea,it

Data Transfer AFS (2)

Gestione Documenti

migliori@enea,it

Data Transfer AFS (3)

Client AFS

PC user

migliori@enea,it

Shearing TEM images

RemoteLocal

OperationLocal

Operation

Remote UserROME

> 4 TByte

LocalTEM Images

Remote UserUSA

Remote UserFEI

ENEATools

Local UserBRINDISI

TEM RoomLocal GRID Cluster

Remote Controlled Web_cam

300 KeV (sept. 2004)

RemoteLocal

Operation

Local Operation

Remote User

TEM Room

Shearing TEM operation

300 KeV (sept. 2004)

RemoteLocal

Operation

Local Operation

Remote ControlledWeb-cam Remote User

Classroom

connectserver

http://connect.portici.enea.it/..........

TEM Room

migliori@enea,it

Remote TEM operation

ElMicroscope (Brindisi)

300 KeV (sept. 2004)

RemoteLocal

Operation

Local Operation

Remote Userable to operate

Coonectserver

SecurityUsing NAT

FEI Sotware for remote

FCS for

cameras

TEM Room Local User

internet

FCS Server

Monitor Signal

migliori@enea.itwww.cresco.enea.itmigliori@enea,it

www.campus.enea.it Selection Function

Virtual Room

www.campus.enea.it

Room Curses

On Line Curses

www.cresco.enea.itwww.cresco.enea.it Selection Function

Supercomputing

Collaborative work

Software

A new ENEA-GRID & Virtual LabNew material & TEM

University and research institute

Enterprise

New collaborations

GARR Others Entity

La ENEA-GRID interoperability with others GRID

ENEA has been developing the “shared proxy” solution

•Maintain the GRID internal architecture and autonomy

•Allow multiplatform impementations

•Under production on EGEE

•Under production on GRISU•Required by EFDA for EGEE

EFDAEGEE ?

CASACCIACASACCIA

FRASCATIFRASCATI

S.TeresaS.Teresa

SaluggiaSaluggia

IspraIspra

BOLOGNABOLOGNA

PORTICIPORTICI BRINDISIBRINDISI

ManfredoniaManfredonia

ENEA-GRID & GRISU & IGI

ENEA-GRID

TRISAIATRISAIA

INFN-GRID

IGIItalian GRID Infrastructure

CRESCO for EUROPEAN FUSION

Cresco 25 Tflops peak System for development and test of

computational codes for ITER (EFDA contract)

1 Tflops peak

To collaborate with CRESCOwww.cresco.enea.it

ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY

AND THE ENVIRONMENT

Migliori@enea.it ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT WORKSHOP...

Documents