Cloud Computing projects in Engineering

Harold Castro, Ph.D.

Associate professorSystems and Computing Engineering

COMIT (Communications and IT) Research GroupIMAGINE Research Group

http://sistemas.uniandes.edu.co/~comithttp://imagine.uniandes.edu.co

hcastro@uniandes.edu.co

Agenda

Context University and CS needs Uniandes’ approach Cloud support Projects in the short term

Universidad de los Andes 9 schools

Architecture and Design Arts and Humanities Economy Engineering Law Management Medicine Sciences Social sciences

School of Engineering Chemical Civil Electric Electronic Environmental Industrial Mechanical Systems and Computing

Source: www.uniandes.edu.co

Universities focus

University

Research

Education

Computing power

Experimenting laboratories

FastAccurateBigCollaborationOptimum

FlexibleRealOptimum

Research at Uniandes Federal organization

Independent and limited computing resources International projects

Collaboration tools Worldwide trend

Campus Grid Uniandes

Campus Grid Uniandes Institutional initiative (2007)

Lead by Sciences (HEP), Engineering (S&C) and DTI (Information Technology Office)

Linked to the world using local Internet 2 CMS (EGEE), EELA-2, ROC-LA Soon: GISELA, OSG

National projection Grid Colombia Hosting Colombian CA

Focus on new applications Bioinformatics, Optimization, Computational Chemistry

Grid Uniandes current status

Grid Uniandes challenges To increase the computing power

Weak funding schemes for research Private institution: Strong funding schemes for Education

To attract new users Inherent complexities of grid systems Rigid architectures for international compliances Difficulties porting applications

UnaGrid: Uniandes Opportunistic Grid

UnaGrid Desktop Grid and Volunteer Computing System

Customized Virtual Cluster (CVC)

Slave Slave

Slave SlaveMaster

Slave Slave

Slave SlaveMaster

Slave Slave

Slave SlaveMaster

Cluster/Grid User

Virtual Cluster D

Virtual Cluster A

GRID COMMUNITY

Virtual Cluster C

Middleware Grid

Cluster/Grid User

Cluster/Grid UserCertificate

Authority (CA)

Slave

Slave

Computer Lab 1

Slave

Slave

Slave Slave

Slave Slave

Virtual Cluster B

Slave

Slave

Computer Lab 2

Computer Lab 3

Master

Cluster/Grid User

Cluster/Grid User Cluster/Grid User

Cluster/Grid UserOn DemandDeployment

GUMA

Cluster/Grid UserVirtualization Priority management

Education in a S&C Engineering Dept Students need exposition to as many

technologies as possible This exposure must be achieved in

environments as real as possible

Software Architecture LaboratoryCustomized Virtual Cluster

Manufacture (2)TelcoBankUniversity

SAPSiebelPeoplesoftBES (RIM)

MicrosoftIBMOracleOpenSource

GUMA: Grid Uniandes Management Application Two different users

System administrators Enable UnaGrid on specific computer labs Deploy CVCs on selected machines Manage UnaGrid users

Users (researchers) Create his/her environment (includes apps)

Virtual machines: 1 core / 1 GB RAM, NAS - NFS Start/Stop a CVC on the opportunistic infrastructure

Specifying time and resources needed Very fast deployment & High utilization

Transfer input & output data

UnaGrid/GUMA challenges

Administration Manual CVC deployment

Difficult updates Manual IP assignment

Inexistent accountability Usage

Unfriendly interface SSH interface to master node Physical infrastructure awareness

Cloud to the rescue UnaGrid has interesting cloud features

Virtualization (VMWare campus agreement) Customized environments On demand deployment (Internet Web access) Delegated administration (partial)

But lack some other key characteristics On demand configuration (self service) Physical machines transparency Accountability Advanced administration tools Complex cluster configuration

ClouderOpportunistic cloud computing (IaaS)

Projects to the cloud

Traditional cluster based research projects (grid)•Master/slave model

Number crunching interactive projects•Visualization

Dynamic scenario projects•Professor/Student offline dialog

Cluster based research projects

Dedicated & opportunistic resources

clouder

Interactive number crunching projects

Data processing & storage

clouder

Multiscenario projects

Easy configurationFlexible deployment

clouder

Thank you

Questions?