24
IT4Innovations national supercomputing centerBranislav Jansí[email protected]
Anselm
Salomon
Data center infrastructure
Anselm and SalomonAnselm● Intel Sandy Bridge E5-2665● 2x8 cores● 64GB RAM at 60 GB/s● 209 nodes● 23 GPGPU Nvidia K20● 4 MIC Intel Xeon Phi
● Infiniband QDR (40 Gb/s)● Fat tree
● 320 + 146 TB storage● 330 GB local storage
● 2x 512 GB, 16 core Fat node
Salomon● Intel Haswell E5-2680v3● 2x12 cores● 128GB RAM at 100 GB/s● 1008 nodes● 0 GPGPU Nvidia K20● 864 MIC Intel Xeon Phi
● Infiniband FDR (56 Gb/s)● 7D hypercube
● 500 + 1690 TB storage● no local storage
● 1x 3328 GB, 112 core UV2000
Salomon vs Anselm
Salomon
Anselm
Intel Xeon Phi accelerator cards
Xeon Phi 7120P ● x86 architecture, 1.2TF● 864x Intel Xeon Phi 7120P● 61(244) cores, 512 bit FMA● 16 GB RAM
3.36TF per accelerated node
1.2TF
1.2TF
0.48TF
0.48TFLos Alamos Blue Mountain (2000)
3.07TF
Specs● 8 servers, dual socket● 14x Intel Xeon E5-4627v2, 8-core
3.3GHz processors● 14 NUMA nodes● 112 cores in total● 3328 GB of physical memory● 1x NVIDIA GM200 (GeForce GTX
TITAN X), 12GB RAM
Access● Name: uv1● Queue: qfat
UV 2000 SMP
SMP NUMA
Only AVX instructions.Binaries compiled for Salomon compute nodes do not run!
Available softwareChemistry, bioinformaticsCP2K, NWCHEM, MOLPRO, WIEN2K, VASP, BOWTIE2, BIOCONDUCTOROMICS MASTER, FIJI
CompilersINTEL, GNU, UPC, JAVA, (PGI), NVIDIA CUDA
LibsMKL, FFTW, GPI2, GSL, HDF5,MPI, NETCDF, ADIOS, MAGMA, LIBMESH, PETSC, TRILINOS, SLEPC,TBB, IPP
VirtualizationKVM/QEMU, WINE, VDE2
ToolsALLINEA DDT/MAP/PERF Reports, TOTALVIEW, VAMPIR, SCALASCA2, VALGRIND, SCOREP, VTUNE, IDB Engineering
ADAMS, ANSYS, COMSOL, CODE_SATURNE,HYPERMESH, ENSIGHT, MATLAB, OCTAVE, PARAVIEW, VISIT, LSDYNA, MODFLOW, OPENFOAM, ELMER, NASTRAN, parallel R
USE.OWNanything
Main services
● HPC resources
● Application and user support
● Training and documentation
Accessing HPC resources Grant competitions
Utilization
Epilogue
Grant competitions
Utilization
Epilogue
Grant competitions
Utilization
Epilogue
Accessing HPC resources Grant competitions● Open Access 3x per year ● Directors discretion
Utilization● System access and accounts● Code deployment● Execution● Free resources scavenging
Epilogue● Report and feedback● Publication registration
Proposal content and evaluation
Aims and objectivesMethods and state-of-the-art Impact and outlooks
Scientific readiness
max 2 pages1-5
Computational approachParallelization and scalabilityResources requested
Computationalreadiness
max 1 pages1-5
Socioeconomic impactOperational costsAmortization and renewal
Economic readiness
0-5
Obtaining login credentials
AllocationCommittee
PI
Resource Allocation
Collaborator 1
Collaborator 2
Collaborator n
Authorization to utilize resources
Authorization to utilize resources
Authorization to utilize resources
Authorization chain
Supporthttp://www.it4i.cz/support
Documentationhttp://docs.it4i.cz
Documentationhttp://docs.it4i.cz
Self servicehttp://extranet.it4i.cz
User support – request trackerhttp://support.it4i.cz/rt
Traininghttp://training.it4i.cz
• http://prace.it4i.cz• 14 training events in past 12 months• Diverse HPC domains are covered• Top notch, expert speakers• Highly recommended
Traininghttp://training.it4i.cz
ConclusionsComputational resources available to general academic community are allocated in competition of scientific and technical quality
Read the documentation, contact support, contact me!
IT4Innovations SuperComputer Center is here to run the computer and assist you in using it
Open access at IT4I ● Allocation committee meets 3x per year
● Call for proposals● 48 000 000 core hours for period of 9 months● Call will be closed after 40 working days● Evaluation: Scientific, technical and economic
assessment, external reviewers may be invited● In 20 working days, evaluation will be available ● 10 working days for rebuttal● Results announced in 5 working days
● Utilization 9 months● Summary report expected within 12 months
