Post on 16-Jan-2016
transcript
GEMINI
Indiana University, University of Kentucky
Overview
• Combine U. Kentucky’s INSTOOLS, perfSONAR and Periscope
• Support scalable, high-rate measurement across layers– Including infrastructure
Measurement Points
• Produce measurement data• Send data to a Measurement Store• Send metadata to UNIS• Standard perfSONAR and INSTOOLS MPs• BLiPP (Basic Lightweight Periscope Probes)
– High rate host monitoring– Adjustable frequency
• NetLogger and Calipers for application monitoring– Addressing scalability with in-line analysis and summarization– Example: system call monitoring to determine file transfer
bottleneck
Measurement Store
• Stores Measurement data (I know you didn’t see that coming)
• Supports high-rate data transfers• Publish/Subscribe interface• Multiple tiers with different characteristics– Surge tank near the source– Bottom of rack– Parallel storage for slice-wide data
MAP
• Measurement/Management and/Analysis Presentation Service
• Configuration GUI• Visualize data (from MS)• Visualize topology (obtained from UNIS)
Portal
• “One stop shop” to integrate various MAP services
MC
• Measurement controller/coordinator• Initiates measurement collection• Coordinates measurements• Fetches data from some MPs
UNIS
• Directory service• Topology data– As well as changes
• Service data• Measurement metadata
Cross cutting
• RESTful interface to perfSONAR (Periscope)• GEMINI Event Messaging Service (GEMS)– High rate data with JSON/BSON
Portal Login Windowing Standard Views Prefs
Operator
User
CF Control
FLACK
GUSH
Other…
IM Control
INSTOOLS
UNIS
Other…
MeasurementGraphs/Tables
INSTOOLSPeriscope MAP
Other…
CMS Interface
Drupal
Runtime Interface
-VNC
Archive Interface
Control Framework
Services
Archive
MP1
MP2
MP3
MPn……
CM
SA
Storage
Services…
VM to run
archiveCH
MCC MS
Local/Private Storage
Control And
(Data) Collection
AuthN/Z
UNIS
INSTOOLSGMOC
iRODS- ShellsLab Book
Management and Presentation (MAP)
I&M Services
GENI Resources
GEMINI ArchitectureGEMINI Global Registry (UNIS)
GENI I&MArchive
Portal and MAP
✓✓✓
Event Messaging Service
perfSONAR (REST and SOAP)
MPMeasurement
Points
BLiPP MP
NEW(Openflow, Layer2, Virtual Machine)
Meas. Stores
MA
GENI AuthN/Z
Instrumentize
GENIRACKS
GEMINISLICE
MCMeasurement
Controller /Collector
Network
MS
Status
• Initial merger of INSTOOLS, Periscope and perfSONAR (LAMP)
• MC functionality running together– Some duplicate functionality
• Development workflow• Migration to github• Jira• Collection of “user stories”
Demo Topology
Bottleneck Detection