Gc vit sttp cc december 2013

transcript

11-12-2013

GRID COMPUTING

Reference : Internet

SPEAKER’S BACKGROUND IN GRID AND CLOUD

COMPUTING

�An opening caveat

�This talk is based on my:

� My doctoral research in Grid Computing and

Shared memory

� Review and session chair experience for

various conferences

� Expert talks at various Institutes for faculty

and students in STTPs, Conferences etc.

� Experience as a Project mentor

11-12-2013

KEY TAKEAWAYS

�Widen personal technical spectrum

� Understand the evolution of recent

technologies

� Envision the upcoming technological trends

� Be useful in Teaching STTP related and allied

subjects

� Guiding projects –UG/PG

ELECTRICAL GRID

11-12-2013

WHY GRIDS ? LARGE SCALE EXPLORATION NEEDS

THEM—KILLER APPLICATIONS.

� Solving grand challenge applications using computer modeling,

simulation and analysis

Life Sciences

CAD/CAM

Aerospace

Military ApplicationsDigital Biology

Military ApplicationsMilitary Applications

Internet &

Ecommerce

WHAT IS A GRID?

�Early defs: Foster and Kesselman, 1998

“A computational grid is a hardware and software

infrastructure that provides dependable,

consistent, pervasive, and inexpensive access to

high-end computational facilities”

�Kleinrock 1969:

“We will probably see the spread of ‘computer

utilities’, which, like present electric and

telephone utilities, will service individual homes

and offices across the country.”

11-12-2013

GRID COMPUTING

ELEMENTS OF GRID COMPUTING

� Resource sharing

� Computers, data, storage, sensors, networks, …

� Sharing always conditional: issues of trust, policy,

negotiation, payment, …

� Coordinated problem solving

� Beyond client-server: distributed data analysis,

computation, collaboration, …

� Dynamic, multi-institutional virtual

organizations

� Community overlays on classic org structures

� Large or small, static or dynamic

11-12-2013

A Typical Grid Computing Environment

Grid Resource Broker

Resource Broker

Application

Grid Information Service

Grid Resource Broker

databaseR2R3

Grid Information Service

GRID COMPUTING: ATTRIBUTES (1)

� Virtualization: Abstracting grid entity into service

� It enables grid components to integrate tightly without creating rigidity and brittleness in the system.

� Components quickly react to change, and adapt failures without compromising performance and reliability.

� Dynamic Provisioning:

� It simply means distributing supplies where they are needed. Supplies mean request, data, computation

� A grid service broker links grid elements together automatically and dynamically, based on the knowledge about their requirements and attributes. and adjust the association according to the change and failures

11-12-2013

GRID COMPUTING: ATTRIBUTES (2)

� Resource Pooling: contributes to lower cost

� Consolidation and pooling is used for better utilization.

� Provide flexibility to optimize the association

� Self-Adaptive Software:

� Everyday task of administrator are automated and simplified. The bulk of maintenance and tuning is automated to reduce IT staff cost.

� Unified Management:

� Self-adaptive software does not eliminate human interaction. Unified management is provided to simplify the management process.

� Single tool can be used to provision, monitor, administer

HOW ARE GRIDS USED?

High-performance computing

Collaborative data-sharing

Collaborative design

Drug discovery

Financial modeling

Data center automation

High-energy physics

Life sciences

E-Business

E-Science

Natural language

processing

Utility computing

Business Intelligence

(Data Mining)

11-12-2013

12/11/2013 13DOE X-ray grand challenge: USC NIST, U.Chicago

tomographic reconstruction

real-time

collection

wide-area

dissemination

desktop & VR clients with shared controls

Advanced Photon Source

ONLINE ACCESS TO

SCIENTIFIC INSTRUMENTS

archival

storage

GRID COMPUTING: COMPONENTS

• Computation:– Computing cycles provided by processors of grid machines.

Simple, parallel, iterative uses of computing elements

• Networked Storage:– Integrated view of data storage (Datagrid). Local disk,

secondary storage, mountable, Unified name space

• Network interconnects:– Fast interconnection technologies. Redundant and external

Internet connections makes parallel processing faster, and management better.

• Software and licenses– Expensive software, Sharing Expensive licenses, Limited

use of multiple installation

11-12-2013

GRID ARCHITECTURE (SERVICE-ORIENTED)

Applications

Grid Architected Services

Web Services (Extended Web Services)

Servers NetworkStorage

Security MessagingDatabaseFilesystems Directory

GRID USERS GRID TYPES

� Grid developers

� Tool developers

� Application developers

� End Users

� System

Administrators

� Compute grid

� Data grid

� Grids on the Internet

11-12-2013

OPEN GRID SERVICES ARCHITECTURE

� Developed by the Global Grid Forum to define a

common, standard, and open architectures for

Grid-based applications.

� Provides a standard approach to all services on the

� VO Management Service.

� Resource discovery and management service:

� Job management service.

� Security services.

� Data management services.

� Built on top of and extends the Web Services

architecture, protocols, and interfaces.

CDAC: GARUDA COMPONENT ARCHITECTURE

11-12-2013

MANY GRID PROJECTS & INITIATIVES

� Australia

� Nimrod-G

� GridSim

� Virtual Lab

� Gridbus

� DISCWorld

� ..new coming up

� Europe

� UNICORE

� MOL

� UK eScience

� Poland MC Broker

� EU Data Grid

� EuroGrid

� MetaMPI

� Dutch DAS

� XW, JaWSJapan

� Ninf

� DataFarm

� Korea...

N*Grid

� USA

� Globus

� Legion

� OGSA

� Javelin

� AppLeS

� NASA IPG

� Condor-G

� Jxta

� NetSolve

� AccessGrid

� and many more...

� Cycle Stealing & .com Initiatives

� Distributed.net

� SETI@Home, ….

� Entropia, UD, Parabon,….

� Public Forums

� Global Grid Forum

� P2P Working Group

� IEEE TFCC

� Grid & CCGrid conferences

http://www.gridcomputing.com

GRID APPLICATIONS-DRIVERS

� Distributed HPC (Supercomputing):

� Computational science.

� High-throughput computing:

� Large scale simulation/chip design & parameter studies.

� Content Sharing

� Sharing digital contents among peers (e.g., Napster)

� Remote software access/renting services:

� Application service provides (ASPs).

� Data-intensive computing:

� Data mining, particle physics (CERN), Drug Design.

� On-demand computing:

� Medical instrumentation & network-enabled solvers.

� Collaborative:

� Collaborative design, data exploration, education.

11-12-2013

GLOBUS

Five parts:

�Common Runtime� GT Core for building new services

�Security� To provide secure access. Based upon Grid Security

Infrastructure (GSI)

�Execution management� Initiation, monitoring, management, scheduling and

coordination of executable programs (jobs)

�Data management� Discover, transfer, and access large data

� Information services� Discover & monitor dynamic services

GLOBUS TOOLKIT

11-12-2013

Data Management

SecurityCommonRuntime

Execution Management

Information Services

Web Services

Components

Non-WS

Components

Pre-WSAuthenticationAuthorization

GridFTP

GridResource

Allocation Mgmt(Pre-WS GRAM)

Monitoring& DiscoverySystem(MDS2)

C CommonLibraries

WSAuthenticationAuthorization

ReliableFile

Transfer

OGSA-DAI[Tech Preview]

GridResource

Allocation Mgmt(WS GRAM)

Java WS Core

CommunityAuthorization

ServiceGT3

ReplicaLocationService

CredentialManagement

Python WS Core[contribution]

C WS Core

CommunitySchedulerFramework

[contribution]

DelegationService

Globus Open Source Grid Software 12/1

Data Management

SecurityCommonRuntime

Execution Management

Information Services

Web Services

Components

Non-WS

Components

Pre-WSAuthenticationAuthorization

GridFTP

GridResource

Allocation Mgmt(Pre-WS GRAM)

C CommonLibraries

WSAuthenticationAuthorization

ReliableFile

Transfer

OGSA-DAI[Tech Preview]

GridResource

Allocation Mgmt(WS GRAM)

Java WS Core

CommunityAuthorization

ServiceGT3

ReplicaLocationService

CredentialManagement

Python WS Core[contribution]

C WS Core

CommunitySchedulerFramework

[contribution]

DelegationService

Globus Open Source Grid Software 12/1

11-12-2013

GRID SIMULATOR: OPTORSIM

� Models the interactions of the individual components of a

running Data Grid.

� Simulates optimization and replication

CONVERGENCE OF COMPETING

PARADIGMS/COMMUNITIES NEEDED

� Web

� Data Centres

� Utility Computing

� Service Computing

� Grid Computing

� P2P Computing

� Cloud Computing

� Market-Oriented Computing

� …

•Ubiquitous

access

•Reliability

•Scalability

•Autonomic

•Dynamic

discovery

•Composability

•QoS

•SLA

•…

Paradigms

Attributes/Capabilities

?-Trillion $ business

- Who will own it?

Manjrasoft

11-12-2013

VOLUNTEERS ARE SELDOM PAID; NOT

BECAUSE THEY ARE WORTHLESS, BUT

BECAUSE THEY ARE PRICELESS!

--AUTHOR UNKNOWN

Contact:

principal@vit.edu.in; 4.seema@gmail.com

+919833818846

Gc vit sttp cc december 2013

Education