+ All Categories
Home > Documents > TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of...

TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of...

Date post: 27-Mar-2015
Category:
Upload: kayla-blair
View: 218 times
Download: 0 times
Share this document with a friend
Popular Tags:
18
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007
Transcript
Page 1: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

TeraGrid Deployment Testof Grid Software

JP NavarroTeraGrid Software Integration

University of Chicago

OGF 21October 19, 2007

Page 2: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 2

Software BuildFinal step of middleware build

DeploymentAdministrator performs at least 1 manual functional

tests

Pre-Production and ProductionRoutine (where extensive TeraGrid testing happens)Regression (opportunity)

Testing Stages/Types

Page 3: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 3

Inca - User-level Grid monitoring

• Testing and performance measurement from a generic, impartial user’s perspective in order to detect and fix Grid infrastructure problems before the user’s notice them.

• User-level Grid monitoring system:– Runs from a standard user account– Executes using a standard GSI credential– Uses tests that are developed and configured based on user documentation

– Verifies user-accessible Grid access points

Page 4: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 4

Inca Architecture

Page 5: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 5

Collecting Monitoring Data

• Reporters – Executable program that measures some aspect of the system or installed software

– Requirements:•Supports specific command-line options•Writes XML (Inca Reporter schema) to stdout

– Supports multiple types of data– Extensive library support for perl scripts

– Most reporters < 30 lines of code– Independent of other Inca components

Page 6: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 6

Sharing Reporters

•Repositories: collection of reporters available via a URL– Supports package dependencies (Perl modules, Makefile, autoconf)

Packages versioned to allow for automatic updatesInca repository contains 157 reporters

Version, unit test, performance benchmark reportersGrid middleware and tools, compilers, math libraries, data tools, and viz tool

Screenshot of a repository using Inca GUI tool

Page 7: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 7

Centralized configuration and deployment

•Incat–GUI interface to enable a large number of monitoring results to be collected with a minimum of effort

–Configure the reporters to execute on a set of resources

–Configuration stored in a XML file and sent to Agent

•Agent–Implements the configuration specified by Inca administrator

–Stages and launches a reporter manager on each resource

–Sends package and configuration updates

Page 8: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 8

Storing data

•Depot–Stores configuration information and monitoring results

–Uses relational database backend via Hibernate

–Provides full archiving of reporter output–Supports SQL queries and provides predefined queries for latest monitoring results, report instance, and report history

–Supports notifications

Page 9: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 9

Displaying and publishing data

•Data Consumer–Web application that queries and displays monitoring data

–Packaged with Jetty –JSP tags to query data and format using XSL

•Web services–Query data from depot and return as XML

Page 10: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 10

Inca in Use: TeraGrid

• Currently monitoring all 18 allocated TeraGrid resources – Monitoring of

CTSSv4 (in progress)

– Grid jobs (Globus gatekeeper logs)

– CA certificate and CRL checking (notify if 2 weeks from expiration)

– Resource registration in MDS

Page 11: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 11

Summary status status view

Page 12: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 12

Historical data

Page 13: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 13

Inca in use: Grid Assessment Probes

•Set of probes designed to emulate Grid applications

•Deployed using Inca to GEON and TeraGrid

Page 14: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 14

Clients

Clients

Clients

Information Services

CacheCache

WS/RESTHTTP GET

WS/SOAP

WS MDS4

TomcatWebMDS

Apache 2.0

TeraGrid Wide Services

TeraGrid Repositories

WS/SOAPWS MDS4

Resource Provider Services

Page 15: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

Resources and Available Kits

Page 16: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 16

Information Services and Inca

REST

SOAP

TeraGrid Capability Kit transitionfrom Development --> Testing, Production

Triggers Inca Testing

Page 17: TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.

October 2007 OGF21 17

Extended regression testingComprehensive functionality suiteScalability/load testingMulti-service grid interaction testing (TeraGrid does some

already)(Reliability and failure testing)

ToolingInca, orMetronome, orMetronome mediated Inca?

SharingMulti-institution testing repositoriesContributions from software providers, integrators, and

users

Testing Opportunities


Recommended