Date post: | 18-Jul-2015 |
Category: |
Technology |
Upload: | teraprocinc |
View: | 46 times |
Download: | 0 times |
Click to edit Master title style
Application Cluster-as-a-Service
Customer Presentation
Copyright 2015 Teraproc Inc. All rights reserved
About Teraproc
Canadian software company
Locations in Toronto, USA & China
Founders with extensive experience in HPC,
cloud and big data infrastructure
Deep technical skills
Active open-source committers
Cloud-based, high-performance cluster-as-a-service platforms for a variety of industries and applications
Copyright 2015 Teraproc Inc. All rights reserved
Customer Challenges
Clusters can be hard to deploy and manage
Special skills often required
Many discrete, specialized components
Cloud providers often provide infrastructure only
Even in the cloud, clusters can be costly & complex
Many workloads benefit from distributed clusters, but:
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc Cluster-as-a-Service
No infrastructure needed
Deploys in minutes
No special skills
All components pre-integrated, ready-to-run
Cost effective
Cloud-based clusters for a range of application workloads
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc Offerings
Teraproc R Analytics Cluster-as-a-Service
A complete ready-to-run R environment in the cloud
Pre-integrated with open-source tools & parallel frameworks
Teraproc HPC Application Cluster-as-a-Service
Turnkey cluster supporting a variety of application workloads
Pre-configured with workload management, MPI and more
Teraproc Cloud Manager
Designed to provision and manage private cloud environment
Deploy physical or virtual infrastructure with your choice of hypervisor
Teraproc OpenLava
Open-source, Platform LSF compatible workload manager
Deploy on-premises or on your choice of cloud platform
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc R Cluster-as-a-Service
No infrastructure needed
Includes R, R Studio Server, Shiny and a wealth of
R packages and components
Integrated with OpenLava, OpenMPI, BatchJobs
and Rmpi for easy parallel deployment
GPU support for added performance
Amazon spot pricing support for reduced costs
Free for use on Amazon free tier instances*
* Maximum free cluster size of three nodes
Scalable R clusters – you do the science, we do the rest
Linux Operating Environment
AMIAMIAMIAMIAMI
NFS File System Amazon S3
Openlava workload manager
MPI, R Libraries, Rmpi, RBatchJob
Auto-configured OS services
R user portal
R Studio Shiny CRAN
Reduce run-time, save costs,
avoid complexity
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc HPC Cluster-as-a-Service
Leverage hundreds of existing application integrations with
Platform LSF compatible workload management
Support serial jobs, arrays, MPI parallel workloads
Multi-user, multi-application clusters
CAE/CFD, electronics, life sciences & financial risk
Clusters deployed in minutes with integrated scheduler, MPI &
shared file system optimized for performance
Scale on demand, leverage spot pricing
Ensure service levels with OpenLava features including resource
sharing and preemptive scheduling
Scalable clusters for design & simulation HPC workloads
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc Cloud Manager
Easy-to-use management software for private cloud computing
environments
Quickly provision virtual and bare-metal infrastructure
Your choice of Hypervisor & container technologies – KVM,
VMware, LXC, OpenStack & more
Self-service user catalog
Policy-based tenant management, service-level management
Simple, affordable, on-premises cloud management
Improve service-levels, boost
utilization, reduce costs
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc OpenLava
Platform LSF compatible open-source scheduler
Free to use on-premises or in the cloud
Enhanced installation & documentation
Many enterprise features:
• Cloud-friendly auto-scaling, fairshare scheduling, job
pre-emption, job arrays
Teraproc OpenLava Support program
Top quality support backed by product developers
Open-source workload management
Copyright 2015 Teraproc Inc. All rights reserved
Delivering business value
Complete, ready-to-run environment
Deploys in minutes with no special skills
Highly cost-effective
100% open-source – no lock-in
Flexible deployment – on cloud, on premises
Free Development Clusters
High-quality technical support
Why Teraproc?
Copyright 2015 Teraproc Inc. All rights reserved
Thank you!www.teraproc.com
Cluster-as-a-Service
Demonstration
Copyright 2015 Teraproc Inc. All rights reserved
Teraproc R Cluster-as-a-Service
Create your free account at rcluster.teraproc.com
Teraproc R Cluster-as-a-Service
Once signed in, create your application cluster
Teraproc R Cluster-as-a-Service
Choose from machine types at a variety of price points
including free
Teraproc R Cluster-as-a-Service
Provide your Amazon credentials to access your
AWS EC2 account
Teraproc R Cluster-as-a-Service
For added savings, name your price and use AWS spot instances
Teraproc R Cluster-as-a-Service
create your cluster
Teraproc R Cluster-as-a-Service
Teraproc R Cluster-as-a-Service
Your cluster is ready to use
Teraproc R Cluster-as-a-Service
Details of the running cluster are shown in the
web interface
Teraproc R Cluster-as-a-Service
Scale the number of nodes while the cluster is running
Teraproc R Cluster-as-a-Service
We add 8 nodes to our 3 node cluster
Teraproc R Cluster-as-a-Service
Teraproc R Cluster-as-a-Service
8 nodes are added with cluster services re-
configured accordingly
Teraproc R Cluster-as-a-Service
Changes are reflected automatically in our
AWS account
Teraproc R Cluster-as-a-Service
Access R Studio via the provided URL
Teraproc R Cluster-as-a-Service
Login with credentials provided when the cluster
is defined
Teraproc R Cluster-as-a-Service
Users enter the familiar R Studio environment – identical to what
runs on a desktop or laptop
Teraproc R Cluster-as-a-Service
Ready-to-run code examples show how to extend R to use the
Teraproc cluster
Teraproc R Cluster-as-a-Service
Optionally access the OpenLavacommand line to launch, monitor and
manage cluster workloads
Teraproc R Cluster-as-a-Service
When finished, stop the cluster to avoid charges
Teraproc R Cluster-as-a-Service
The Teraproc portal shows the state of the cluster(s)
Teraproc R Cluster-as-a-Service
There is no need to manage machines in EC2
– this is automatic
Teraproc R Cluster-as-a-Service
Restart the cluster in future, and resume where
you left off
Additional Slideswww.teraproc.com
R Cluster-as-a-service Architecture
Application Cluster Manager
User/role changenotification
Authentication/AuthorizationNotificationOperation
User/Account
Manager
Credential Manager
Monitoring
Application Template Mgr
Operations
IaaS Adapters
NotificationOperation
R Cluster
R Studio (iPython Notebook / R Cloud)
OpenLava Resource Manager
R Script R Script R Script
OpenMPI
LDA
P
Mas
ter
Shared File system (NFS, HDFS, Lustre)
MASTER MACHINE INSTANCE
OpenLava Agent
R Script R Script R Script
OpenMPI
LDA
PC
lien
t
Shared File system (NFS, HDFS, Lustre)
CLIENT MACHINE INSTANCES
Web GUI Service
R Cluster
R Studio (iPython Notebook / R Cloud)
OpenLava Resource Manager
R Script R Script R Script
OpenMPI
LDA
P
Mas
ter
Shared File system (NFS, HDFS, Lustre)
MASTER MACHINE INSTANCE
OpenLava Agent
R Script R Script R Script
OpenMPI
LDA
PC
lien
t
Shared File system (NFS, HDFS, Lustre)
CLIENT MACHINE INSTANCES
R Cluster-as-a-service Portal R Cluster-as-a-service architecture supports multiple, multi-user tenants, each with multiple deployed clusters that can flex dynamically and take advantage of spot pricing
R Analysis Platform-as-a-Service
User/role changenotification
Authentication/AuthorizationNotificationOperation
User/Account
ManagerApplication Cluster Manager
Credential Mgr
Monitoring
App Template Mgr
Operations
IaaS Adapters
Notification Operation
iPython Notebook
OpenLava
R Script R ScriptOpenMPI
HBASE
Shared File system (NFS, HDFS, Lustre)
MASTER MACHINE INSTANCE
Web GUI Service
R Analysis Platform Portal R Analysis Platform-as-a-service architecture extends the cluster-as-a-service architecture supporting Hadoop, Spark, YARN, Slider, Policy-based scaling and external authnetication
iPython Notebook
Auto-scale Manager
Metrics
Planner
Policy
Action
External authentication (Google,Facebook etc.)
Operation NotificationGoogle Auth
Facebook Auth
Private Auth
Slider Slider
YARN
Slider
Spark/R
Slider
Map/R
Slider Au
to-s
cale
Man
ager OpenLava Agent
R Script R Script
HBASE
Shared File system (NFS, HDFS, Lustre)
Slider Slider
YARN
Slider
Spark/R
Slider
Map/R
Slider
OpenMPI
CLIENT MACHINE INSTANCES
R/Hadoop Cluster Additional R/Hadoop Cluster instances