38
migliori@enea .it www.cresco.enea. it ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT WORKSHOP REMOTE MICROSCOPY FOR ELECTRON MICROSCOPY
| Date post: | 27-Mar-2015 |
| Category: |
Documents |
| Upload: | samuel-stokes |
| View: | 220 times |
| Download: | 5 times |
ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
WORKSHOPREMOTE MICROSCOPY FOR ELECTRON MICROSCOPY
ContentsENEA-GRID infrastructure (www.afs.enea.it/project/eneagrid)
CRESCO and Telemicroscopy(www.cresco.enea.it)
Silvio Migliori; Giovanni Bracco; Salvatore Podda; Andrea Quintiliani; Marco Vittori
ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM)
CRESCO Supercomputer and Telemicroscopy integrated in ENEA-GRID infrastructure
ENEA-GRID
Sensor nets
ENEA-GRID
Born in 1998 with 6 Italian geographic clusters Main aim
– Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software
– Build an homogeneous ICT infrastructure but with a distributed and delegated control
– Integrate the ENEA-GRID with National and International GRIDS
www.afs.enea.it/project/eneagrid
Data archivesColleagues & 3D
Softwarecatalogs
ComputersApplication
Fabric
Connectivity
Resource
Collective
User
THE CONCEPT OF ENEA GRID INFRASTRUCTURETHE CONCEPT OF ENEA GRID INFRASTRUCTURE
QuickTime™ and a YUV420 codec decompressor are needed to see this picture.
Cell Centered Data Base Cell Centered Data Base ““CCDB”CCDB”
IMAGING-INSTRUMENTSIMAGING-INSTRUMENTS COMP.-RESOURCESCOMP.-RESOURCES MULTI-SCALE-DATA-BASESMULTI-SCALE-DATA-BASES
NETWORKNETWORK
ADV.-COMP.-GRAPHICSADV.-COMP.-GRAPHICSDATA ANALYSISDATA ANALYSISDATA ACQUISITIONDATA ACQUISITION
By-Mark EllismanBy-Mark Ellisman
ENEA-GRID from the user point of view Main feature:
– Access from any kind of connection– Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client – Running any kind of programs – Access to National and International GRIDS
Sensor nets
Data archives
Computers
Portici (
Roma-1
Bologna EU…Brindisi Roma-2
Trisaia
Software catalogs
ComputersComputersComputers
Computers
Sensor netsEN
EA
-GR
ID
ENEA-GRID from application point of view Potentiality:
– Running all Software Model for any kind of computer architecture – Only one installation for each software for all geographical computers– All authorized users can have access the software from local site – Any application can share the data in the common geographical file system– All sensors can share the data easily using the geographical file systems
Sensor nets
Computers
Portici (
Roma-1
Bologna EU…Brindisi Roma-2
Trisaia
Software catalogs
Computers
Computers
Sensor netsEN
EA
-GR
ID
Software Model 1
Software Model 2
Software Model 3
Software Model ..
Rules
Computers
AFS Geographical cross platform & File System
AIX SGI SUN HP Win
Linux
Linux Alpha
…
LSF
User programs and commercial codes
LSF multi-cluster as integrator
XTERM
Graphical User Interface
Application Portal (ICA-Protocol)
ICAWEB
Qu
ality
of
serv
ice
Mon
itori
ng
, A
uto
mati
c r
ecovery
Accau
nti
ng
ENEA GRID
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integratorTelnet
User programs & commercial code
ICAWEB
Cluster 5° ( Portici)
& File System
Load Leveler LSF
Graphic User Interface
Telnet
ICAWEB
Cluster 6° ( Brindisi)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 2° (Casaccia)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 4° (Trisaia )
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 3° (Frascati)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 1° ( Bologna)
A Simple view of ENEA GRID
8
CASACCIACASACCIA
FRASCATIFRASCATI
S.TeresaS.Teresa
SaluggiaSaluggia
IspraIspra
BOLOGNABOLOGNA
PORTICIPORTICI
TRISAIATRISAIA
BRINDISIBRINDISI
ManfredoniaManfredonia
ENEA-GRID Computational & 3D Centers
902750
400
140
30
#CPU/Core
45
ENEA-GRID Computational Resources
Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575)
Frascati(4), Portici(34),Trisaia(4), Brindisi(4)
10046Windows 32/64
Frascati(1), Trisaia(13)6014Mac OS X
Trisaia(4), Casaccia(2), Bologna(2)108Solaris
Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5)
4026IRIX
Casaccia30064Linux IA64 (Altix)
Frascati(140), Casaccia(54), Portici(2700),Trisaia(20), Brindisi(84)
25000>3000Linux x86 32/64
Frascati(258), Bologna(24), Portici(18),Brindisi(2)
3000>300AIX
Gflops#CPU/Core OS
HPC CRESCO INFRASTRUCTURE
Portici LAN
Interconnections InfiniBand4XDDR SERVERS GPFS
4 Nodi IBM 3650
IBFC
High speed disc2 GByte/s
160 TByte IBM/DDN 9550
Backup system300 TByte
IBM Tape Library TS3500 with 4 drives
SERVERS BACKUP3 Nodi IBM 3650
FCIB
GARR(WAN)
Section 1(Large memory)
42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton
Section 3(Special)
4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each.6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX54 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM
Double interconnection at 1 Gbit& 1 network at 1 Gbit for management
Section 2(MPP)
256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MHz/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown
4x10 Gbits 1000 Mbits
35 Node for services
Servers for :•Front-end•installations•AFS•…
CRESCO17 TFlops
1000 Mbits
CRESCO HPC details
Sections 1 & 3 Section 2 & DDN
Control room backup systemnetwork: IB/GB
Corridor hotSections 1 &2
Computational abilityENEA-GRID & CRESCO
An heterogeneous system with more than 3000 CPU/cores
Code Risorsa
Serial Section 1 & ENEA-GRID
Parallel hardly coupled Section 2
Embarrassing parallel Section 1, 2, ENEA-GRID
System with several parallel codes
Section 1, 2, Section 1+2
Special ( FPGA, GB, CELL) Section 3
windows (serial and parallel) Section 3
Not LINUX ENEA-GRID
Large date “Data Base” Section 1,2,3 e GPFS
Jack Dongarra 2002
CRESCO in the Top500 List June 2008
Italy (06/2008)
90 CINECA
125 ENEA
131 ENI
135 CILEA
156 CINECA
226 Telecom
AccessoClient
AccessoWEB
sp4_-1.frascati.enea.it
boquad.bologna.enea.it
dafne.casaccia.enea.it
2 0 0 8
GEANT
infocal.trisia.enea.it
Gatewayto
EGEE & GRISU
Portici
Brindisi
Kleos.portici.enea.it
ercules.brindisi.enea.it
AccessoDiretto www.afs.enea.it/project/eneagrid
DB_1
CPUSENEA GRID
WEBICASSH
DNA Sequence system
( ABI Prism 3700)Trisaia
DB_3
DB_2
Electron Microscope (Brindisi)
300 KeV (sept. 2004)
ENEA GRID and experimental facilities
Controlled Nuclear Fusion:
FTUFrascati Tokamak
UpgradeVideo Acquisition
ENEA-GRID for experimental facilities Main feature:
– Access from any kind of connection– Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client
Sensor nets
Portici (
Roma-1
EU… USA…Brindisi Roma-2
Trisaia
Sensor nets
EN
EA
-GR
ID
Logical access (AFS)
[email protected] SISM 9-10 Ottobre 2007
migliori@enea,it
Università(Salerno)
ENEAPortici
ORNL(USA)
ENEA(Trisaia)
ENEA AFS ‘’DATA BASE’’
Università(……….)
Conceptual structure for TEM
Electron Microscope (Brindisi)
300 KeV (sept. 2004)
RemoteLocal
Operation
TEM Room
Local Operation
Remote ControlledWeb-cam
Remote User
Local DataAFS Data Integration
> 4 TByte
Mtaframe
AFS
Special Driver for TEM
Local GRID Cluster
Conceptual structure from a remote user’s point of view
Local DataAFS Data Integration
> 4 TByte
File server
Streaming server
Citrix XenApp Windows
Linux Cluster
WEB Sever
Citrix XenApp Unix
Web conferencing
Classroom
Local GRID Cluster
Main service
•View of TEM image•Programs & Data•E-learning tools
EN
EA
GR
ID S
OF
TW
AR
E I
NF
RA
ST
RU
CT
UR
E
•View of TEM image•Programs & Data•Supercomputing •3D Display•E-learning tools
Remote Operation Users
Sp
ecia
l Dri
ver
for
TE
M
Remote Application Users
+Remote operation
ICA protocol
[email protected] SISM 9-10 Ottobre 2007
migliori@enea,it
Data Transfer AFS (3)
Client AFS
AFS
AFS
PC user
[email protected] SISM 9-10 Ottobre 2007
migliori@enea,it
Shearing TEM images
RemoteLocal
OperationLocal
Operation
Remote ControlledWeb-cam
Remote UserROME
Local DataAFS Data Integration
> 4 TByte
AFS
LocalTEM Images
Remote UserUSA
Remote UserFEI
ENEATools
Local UserBRINDISI
TEM RoomLocal GRID Cluster
Remote Controlled Web_cam
Electron Microscope (Brindisi)
300 KeV (sept. 2004)
RemoteLocal
Operation
Local Operation
Remote ControlledWeb-cam
Remote User
TEM Room
Shearing TEM operation
Electron Microscope (Brindisi)
300 KeV (sept. 2004)
RemoteLocal
Operation
Local Operation
Remote ControlledWeb-cam Remote User
Classroom
connectserver
http://connect.portici.enea.it/..........
TEM Room
Remote TEM operation
ElMicroscope (Brindisi)
300 KeV (sept. 2004)
RemoteLocal
Operation
Local Operation
Remote ControlledWeb-cam
Remote Userable to operate
Coonectserver
SecurityUsing NAT
FEI Sotware for remote
PAD
FCS for
cameras
TEM Room Local User
[email protected]@enea,it
www.campus.enea.it Selection Function
Virtual Room
www.campus.enea.it
Room Curses
On Line Curses
www.cresco.enea.itwww.cresco.enea.it Selection Function
Supercomputing
Collaborative work
Software
A new ENEA-GRID & Virtual LabNew material & TEM
Li
ENEA
University and research institute
Enterprise
New collaborations
GARR
PI2S2
GARR Others Entity
La ENEA-GRID interoperability with others GRID
ENEA has been developing the “shared proxy” solution
•Maintain the GRID internal architecture and autonomy
•Allow multiplatform impementations
•Under production on EGEE
•Under production on GRISU•Required by EFDA for EGEE
EFDAEGEE ?
CASACCIACASACCIA
FRASCATIFRASCATI
S.TeresaS.Teresa
SaluggiaSaluggia
IspraIspra
BOLOGNABOLOGNA
PORTICIPORTICI BRINDISIBRINDISI
ManfredoniaManfredonia
ENEA-GRID & GRISU & IGI
ENEA-GRID
SPACI
TRISAIATRISAIA
GRISU
INFN-GRID
IGIItalian GRID Infrastructure
CRESCO for EUROPEAN FUSION
Cresco 25 Tflops peak System for development and test of
computational codes for ITER (EFDA contract)
1 Tflops peak
IB
