Date post: | 21-Dec-2015 |
Category: |
Documents |
View: | 219 times |
Download: | 2 times |
Windows Compute Windows Compute Cluster Server And Cluster Server And Deskside ClustersDeskside ClustersAn OverviewAn Overview
Anand KrishnanAnand KrishnanProduct ManagerProduct ManagerWindows Server HPCWindows Server HPCMicrosoft CorporationMicrosoft Corporation
We’re Going To Talk About …We’re Going To Talk About …
What is HPC?What is HPC?
What’s happening with the HPC market?What’s happening with the HPC market?
What are customers looking for?What are customers looking for?
What is Microsoft planning to do in What is Microsoft planning to do in this space?this space?
How does this affect my business?How does this affect my business?
What Is HPC? What Is HPC?
Cutting edge problems in science, Cutting edge problems in science, engineering and business require engineering and business require capabilities beyond those of standard capabilities beyond those of standard desktops and serversdesktops and servers
Improved Vehicle Improved Vehicle AerodynamicsAerodynamics
Computational Fluid Dynamics (CFD) Packages Computational Fluid Dynamics (CFD) Packages used to model vehicle aerodynamicsused to model vehicle aerodynamics
Source: Source: www.fluent.com/ about/news/pr/pr48.html ; www.fluent.coml ; www.fluent.com
Safer Structural ElementsSafer Structural Elements
Finite Element Analysis (FEA) packages model Finite Element Analysis (FEA) packages model element stress-profiles under various conditionselement stress-profiles under various conditions
More Efficient Oil ExtractionMore Efficient Oil Extraction
Reservoir simulation packages model oil/gas Reservoir simulation packages model oil/gas reservoir rock and fluid propertiesreservoir rock and fluid properties
Source: http://www.geocap.no/products/a4.eclipse.shtmlSource: http://www.geocap.no/products/a4.eclipse.shtml
Some Clarification On Some Clarification On Terminology …Terminology …
HPC Systems
Shared Memory Distributed Memory
Dedicated Compute Clusters Non-Dedicated Clusters
Collections of Collections of computers, networked computers, networked together and acting as a together and acting as a single large machinesingle large machine
Each ‘node’ is Each ‘node’ is dedicated to the dedicated to the compute clustercompute cluster
Collections of Collections of computers, networked computers, networked together and acting as a together and acting as a single large machinesingle large machine
Nodes have ‘day-jobs’ Nodes have ‘day-jobs’ and can only provide and can only provide cycles when unusedcycles when unused
Entry Price-points For HPC Entry Price-points For HPC Have DroppedHave Dropped
Distributed Memory Distributed Memory Becoming The NormBecoming The Norm
Clusters over 70%
Commercial Adoption Is On Commercial Adoption Is On The RiseThe Rise
Industry usage rising
HPC system growth: 70% in 2004; 25% in 2005 (IDC)HPC system growth: 70% in 2004; 25% in 2005 (IDC)
Growth being driven by <$250k segment (clusters)Growth being driven by <$250k segment (clusters)
x86 server clusters growing faster than market (15%-20% for HPC x86 server clusters growing faster than market (15%-20% for HPC clusters, 11.4% for x86 overall)clusters, 11.4% for x86 overall)
Market Growth Driven By Market Growth Driven By The Low EndThe Low End
Challenges in HPC todayChallenges in HPC today
““.. want to do more .. want to do more science & less IT”science & less IT”
““..apps not keeping up ..apps not keeping up with ideas”with ideas”
“…“…takes a village to takes a village to raise a cluster”raise a cluster”
““...parallel programming ...parallel programming is difficult”is difficult”
““..not enough tools”..not enough tools”
App availability and App availability and integrationintegration
Simpler job submission Simpler job submission and monitoringand monitoring
Easier deployment and Easier deployment and setupsetup
Simplified mgmt Simplified mgmt environmentenvironment
Integrated & complete Integrated & complete development development environmentenvironment
Platform standardsPlatform standards
End Users
IT Pros
Developers
Microsoft’s Vision For HPCMicrosoft’s Vision For HPC
Empower scientists and engineers to Empower scientists and engineers to interactively employ massive interactively employ massive computational resources to solve complex computational resources to solve complex technical problemstechnical problems
Make distributed computing resources Make distributed computing resources productive to develop for and cost-productive to develop for and cost-effective to operateeffective to operate
Microsoft Initiatives In HPCMicrosoft Initiatives In HPC
Develop a complete productDevelop a complete productWindows Compute Cluster Server 2003Windows Compute Cluster Server 2003
Grow the ecosystemGrow the ecosystemWork with partners to build & sell solutionsWork with partners to build & sell solutions
Work with the HPC communityWork with the HPC communityPartner with academia and industry to Partner with academia and industry to develop standards and advance researchdevelop standards and advance research
Raise AwarenessRaise AwarenessEvangelize parallel computingEvangelize parallel computing
Compute Cluster Server Compute Cluster Server 2003 (CCS)2003 (CCS)
Complete, integrated platform for computational Complete, integrated platform for computational clusteringclustering
Core PlatformCore PlatformWindows Server 2003 Compute Cluster EditionWindows Server 2003 Compute Cluster Edition
x64 onlyx64 only
Cluster ToolsCluster ToolsMicrosoft Compute Cluster PackMicrosoft Compute Cluster Pack
Built-in Cluster Mgmt, Job Scheduler & MPIBuilt-in Cluster Mgmt, Job Scheduler & MPI
Interconnect support leveraging Winsock DirectInterconnect support leveraging Winsock Direct
AvailabilityAvailabilityPre-release bits at Pre-release bits at http://www.microsoft.com/http://www.microsoft.com/hpchpc
RTM in JuneRTM in June
The CCS Value PropositionThe CCS Value Proposition
Faster time-to-insight Faster time-to-insight ..through simplified cluster deployment, job ..through simplified cluster deployment, job submission and status monitoringsubmission and status monitoring
Integration with Windows infrastructureIntegration with Windows infrastructure… … allowing customers to use existing allowing customers to use existing technology and skill-setstechnology and skill-sets
Integrated development environmentIntegrated development environment… … allowing developers to write parallel allowing developers to write parallel applications from within the Visual Studio IDEapplications from within the Visual Studio IDE
Target VerticalsTarget Verticals
AutomotiveAutomotive AerospaceAerospaceLifeLife
SciencesSciencesGeoGeo
ServicesServicesFinancialFinancialServicesServices AcademiaAcademia GovernmentGovernment
PartnersPartners
University of Virginia
Charlottesville, VA USA
University of Tennessee
Knoxville, TN USA
Cornell Theory CenterIthaca, NY USA
University of Utah
Salt Lake City, UT USA
TACC – University of TexasAustin, TX USA
Southampton University
Southampton, UK
HLRS – University of Stuttgart
Stuttgart, Germany
Shanghai Jiao Tong UniversityShanghai, PRC
Tokyo Institute of Technology
Tokyo, Japan
Nizhni Novgorod UniversityNizhni Novgorod, Russia
HPC InstitutesHPC Institutes
Bringing HPC Into The Bringing HPC Into The MainstreamMainstream
Co
mp
uti
ng
Sca
le
Deskside Clusters
Datacenter Based Compute Clusters
Datacenter-Based Compute Datacenter-Based Compute ClusteringClustering
Sizes ranging from 8-1000+ nodesSizes ranging from 8-1000+ nodes……but 90+% of installs are <64 nodesbut 90+% of installs are <64 nodes
High affinity to workstations for interactive High affinity to workstations for interactive processingprocessing
Seamless interaction between workstation and Seamless interaction between workstation and cluster critical to end-userscluster critical to end-users
Integration into IT infrastructure critical to IT ProsIntegration into IT infrastructure critical to IT Pros
Purchasing decision driven by combination of Purchasing decision driven by combination of Corp IT and End-UserCorp IT and End-User
Deskside SupercomputingDeskside Supercomputing
End users that are caught between the desktop and End users that are caught between the desktop and the datacenterthe datacenter
Need access to 4-8 nodes for most of their processingNeed access to 4-8 nodes for most of their processing
Might have access to larger HPC systems but want ‘in-lab’ Might have access to larger HPC systems but want ‘in-lab’ clusters for development purposesclusters for development purposes
Allows user to refine algorithms and code before deployment on Allows user to refine algorithms and code before deployment on larger departmental clusterslarger departmental clusters
User profile: Engineers and scientists solving “what if” User profile: Engineers and scientists solving “what if” problems inproblems in
Life SciencesLife Sciences
Computer Aided EngineeringComputer Aided Engineering
FinanceFinance
Oil and gas/geophysicsOil and gas/geophysics
What Should A Deskside What Should A Deskside Cluster Look Like?Cluster Look Like?
True high performance parallel computersTrue high performance parallel computers
Small enough for the office and labSmall enough for the office and lab
Powered from a standard wall outletPowered from a standard wall outlet
Cool running and quietCool running and quiet
Priced under single-user purchase limitsPriced under single-user purchase limits
As easy to use as a PCAs easy to use as a PC
Comes with OS pre-installed (and Comes with OS pre-installed (and potentially app as well)potentially app as well)
Deskside ScenarioDeskside ScenarioMolecular ModelingMolecular Modeling
Personal 4 node clusterPersonal 4 node clusterPer node: Dual core, dual proc x64, Per node: Dual core, dual proc x64, 2GB RAM2GB RAM
Dual NIC (Ethernet + GigE or IB)Dual NIC (Ethernet + GigE or IB)
1 head node, 3 compute nodes1 head node, 3 compute nodes
110v pluggable, low noise, 110v pluggable, low noise, desk-side towerdesk-side tower
Front end workstation used to build, Front end workstation used to build, view and interact with the model in 3Dview and interact with the model in 3D
Coarse-grained simulations run Coarse-grained simulations run against desk-side cluster.against desk-side cluster.
Larger models handed off to Larger models handed off to datacenter-based resourcesdatacenter-based resources
SummarySummary
Parallel computing is here to stayParallel computing is here to stay
Windows Compute Cluster Server 2003 is Windows Compute Cluster Server 2003 is Microsoft’s first step towards bringing Microsoft’s first step towards bringing HPC into the computing mainstreamHPC into the computing mainstream
CCS will serve existing scenarios…CCS will serve existing scenarios…Datacenter-Based Compute ClusteringDatacenter-Based Compute Clustering
……and drive momentum around new onesand drive momentum around new onesDeskside SupercomputingDeskside Supercomputing
Call To ActionCall To Action
Download Compute Cluster Server 2003 Download Compute Cluster Server 2003 @ @ www.microsoft.com/www.microsoft.com/hpchpc
Think about taking HPC beyond the Think about taking HPC beyond the datacenterdatacenter
Build, Test and Prepare to ship products Build, Test and Prepare to ship products for CCSfor CCS
ResourcesResources
Microsoft HPC Web siteMicrosoft HPC Web sitehttp://www.microsoft.com/hpc/http://www.microsoft.com/hpc/
Microsoft Windows Compute Cluster Server 2003 Microsoft Windows Compute Cluster Server 2003 Beta ProgramBeta Program
http://www.microsoft.com/windowsserver2003/ccs/beta.mspxhttp://www.microsoft.com/windowsserver2003/ccs/beta.mspx
Microsoft Windows Compute Cluster Server 2003 Microsoft Windows Compute Cluster Server 2003 Community SiteCommunity Site
http://codegallery.gotdotnet.com/windowshpchttp://codegallery.gotdotnet.com/windowshpc
Windows Server x64 informationWindows Server x64 informationhttp://www.microsoft.com/64bit/http://www.microsoft.com/64bit/http://www.microsoft.com/x64/http://www.microsoft.com/x64/
Windows Server System informationWindows Server System informationhttp://www.microsoft.com/wss/http://www.microsoft.com/wss/
Get the Facts Web siteGet the Facts Web sitehttp://www.microsoft.com/http://www.microsoft.com/getthefactsgetthefacts
User AppUser App
MPIMPI
Node ManagerNode Manager
Job ExecutionJob Execution
Datacenter-Based Compute ClusteringDatacenter-Based Compute Clustering
DB/FSDB/FS
UserUser
Cmd lineCmd line
Desktop AppDesktop App
Job Mgr UIJob Mgr UI
AdminAdmin
AdminAdmin Console Console
Cmd lineCmd line
Head NodeHead Node
Job MgmtJob Mgmt
Resource MgmtResource Mgmt
Cluster MgmtCluster Mgmt
SchedulingScheduling
High speed, low latency interconnect
Tasks
Man
agem
ent
Jobs Policy, reports
Active Active DirectoryDirectory
Data
Inp
ut
Domain\UserADomain\UserA
© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions,
it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.