GRID enabled remote instrumentation and sensors with distributed control

GRID enabled remote instrumentation and sensors with distributed control

Francesco LelliIstituto Nazionale di Fisica Nucleare – Laboratori di Legnaro

Legnaro (PD), Italy

EU FP6 Project

F. Lelli, Cairo 09 09 2007 2www.gridcc.org (EU FP6 Contract 511382)

The Grid Technologies to extend the limit of a single computer (center)

Grid Technologies

Grid Technologies

User Interface

Grid Gateway

ComputingComputingElementElement

StorageStorageElementElement




Extending the Grid Concepts

Grid Technologies

Grid TechnologiesSatellite views

to monitor the volcano

Control and Monitor RoomTo model calculations

and disaster predictions

Terrestrial probes to monitorThe volcano activities

Grid Gateway


GridCC

Instruments Grid Computational Grid

GridCC

+

Data for Model Calculations

Predictions


The GRIDCC project: Goals & Objectives

1. The GRIDCC - Grid Enabled Remote Instrumentation with Distributed Control and Computation – project has the main aim to bring Instruments to the GRID

2. It is a 3-years EU FP6 project started in September 2004

3. Web site: www.gridcc.org

4. More in particular the project goals are:1. Definition of a “Instrument Element” allowing a standard remote

access to any type of instrumentation

2. Tight integration between instrument grid and classical computational grid

3. Human interaction with Grids via Virtual Control Room (collaborative environment)

4. Enactment of complex workflows


The GRIDCC partners

Participant name Country

Istituto Nazionale di Fisica Nucleare Italy

Institute Of Accelerating Systems and Applications Greece

Brunel University UK

Consorzio Interuniversitario per Telecomunicazioni Italy

Sincrotrone Trieste S.C.P.A Italy

IBM (Haifa Research Lab) Israel

Imperial College of Science, Technology & Medicine UK

Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche

Italy

Universita degli Studi di Udine Italy

Greek Research and Technology Network S.A. Greece


GridCC: The Basic Idea

StorageElementsStorage

Elements

ComputingElement

ComputingElement

InstrumentElement

ComputingElement

StorageElement

InstrumentElement

InstrumentElement

Existing Grid Infrastructures

Virtual Control

Room

Virtual Control

Room

ExecutionService


GRIDCC Architecture

Web ServiceInterface

Execution

Service

WfMS

WMS

AS

Instrument elements

(IE)StorageElement

(SE)

Instrument elements

(IE)StorageElement

(SE)

Instrument Element

(IE)StorageElement

(SE)

Compute element

(CE)

Compute element

(CE)

Computing Element

(CE)

StorageElement

(SE)

StorageElement

(SE)

StorageElement

(SE)

Information System(BDII)

Virtual Control

Room

WMS Work Management System

WfMS Work Flow Mng System

AS Agreement ServiceBroker

gLite GRID

GRIDCC


GridCC PermanentTest Bed

VOMSVOMS

AS, KrbServerAS, KrbServer

VCR, SE, IE, BDIIVCR, SE, IE, BDII

IE, CE/CREAM,SE, LFC IE, CE/CREAM,SE, LFC

WMProxyWMProxy

WfMS WfMS

VCR, IE VCR, IE


GRIDCC main target areas(Large-scale) scientific

experimentsHigh energy particle physics

(Radio-) Telescopes

Remote process control Accelerator control (Tele-) Biomedicine

Robotics Automotive

Electronic microscopes

Widely Sparse Instrumentation Power Grids

Monitoring of the territory Monitoring of the seaGeo-hazard prediction

Distributed laboratories Transportation monitoring

Sensor network

GRIDCCMiddleware


GRIDCC pilot applications

Power Grid

Power Grid

High Energy Physics

CMS

High Energy Physics

CMS

Particle Accelerator

Particle Accelerator

Device Farm

Device Farm

Geohazard MonitoringGeohazard Monitoring

MeteorologyMeteorology


Instrument Element Requirements

Web Services

Instrument Element

Any Protocol or physical connection

Sensor Network

Instrument

Instrument

GridGrid

ComputingComputing ElementElement

StorageStorage ElementElement

ComputingComputing ElementElement InstrumentInstrument

ElementElement

W

EF

A

B

C

D

1: Provide a uniform access to the physical devices

2: Allow a standard grid access to the instruments

3: Allow the cooperation between different instruments that belong to different VOs


A new 4 channels element to fit the requirements: The Instrument Element (IE)

Inst

rum

enta

tion

Con

torl

GR

ID A

cces

s

Instruments Access

Data/Info Pubblishing

InstrumentElement

Web

Ser

vice

SR

M/G

RID

FT

P

Custom (JMS, ..... )

Custom

I’m here

Discovery

QoSAdvance Reservation


VIG

S

IMSProxy

ControlManager

DataCollector

Real Instruments

Data Flow

Control Flow

State FlowError FlowMonitor Flow

The term Instrument Element describes a set of services that provide the needed interface and implementation that enables the remote control and monitoring of physical instruments.

InputManager

EventProcessor

FSMEngine

ResourceProxy

Control Manager

IMSInstrument Element Architecture

ResourceService

IMS

ProblemSolver

InstrumentManager

Instrument Element

Data Publisher

Acc

ess

Con

trol

Man

ager

SRM/SEGridFTP

SE

IMS

Instrument Protocols


Virtual Control Room (VCR)

The VCR is a web portalBased on the Gridsphere framework(portlet technology) and providing• general cooperative tools

• event tools• resource tools• communicatin tools

• chat• video conf

• application specific tools• instrument control• log book• log reports• data monitor


VCR examples


GRIDCC at Work


Pilot applications: CMS - I The GridCC middleware has been deployed to control the run of the CMS

(Compact Muon Solenoid), one of the four high energy experiments in LHC (Large Hadron Collider) at CERN laboratory.

CMS Magnet Test and Cosmic Challenge (MTCC) I and II, a milestone in the CMS construction, positively carried out.

Top IE

CSCIE

TrackerIE

HCALIE

DAQIE

RPC IE

TriggerIE

DTIE

ECAL IE

DAQIM

FB RB FF

xdaq

xdaqxdaq

DAQRS

DAQIMS

UserInterface

CMS Control Structure

CMS Detector


CMS MTCC phase I and phase II carried out in 2006

Scale MTCC versus CMSFEDs: 20 out of 600 3%EVB RUs: 6 out of 600 1%Filter Farm: 14 out of 2000 0.3%Trigger rate: 100 Hz out of 100 kHz 0.1%Event size: 200 kB out of 1 MB 20%IEs 15 out of 150 10 %

Scale MTCC versus CMSFEDs: 20 out of 600 3%EVB RUs: 6 out of 600 1%Filter Farm: 14 out of 2000 0.3%Trigger rate: 100 Hz out of 100 kHz 0.1%Event size: 200 kB out of 1 MB 20%IEs 15 out of 150 10 %


Top IM

VCR

ServicesServicesServices

PSAChf d’Or

EVBChf d’Or

TrackingChf d’Or

StorageIM

SlwCtrlIM

EVB Sub- System Storage

Sub- System

PSA Sub-System Tracking Sub-System

SlowCtrl Sub- System

Maestro

Web Services

Main Data Flow(Narval Systems)

Resource ServiceLog CollectorError Collector…..

AncillaryIM

Ancillary Sub- System

Na

rval

Sys

tem

s

IM = Function Manager


Pilot applications: Power grid

Instrument Manager

Instrument Element

...

Virtual Control Room

Virtual Control Room

Gas

Solar Panel

Power Grid V.O.

GRIDCC deployed to monitor:• A 50kW generator• A 1 kw Photo-Voltaic array


Pilot applications: Remote Operation of an Accelerator

Elettra Synchrotron


GRIDCC: other applications Meteorology (Ensemble Limited Area Forecasting)

Weather forecasting system to detect hazardous weather

Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories The Device Farm consists of a pool of Measurement

Instruments for Telecommunication Experiments

Geo-hazards: Remote Operation of Geophysical Monitoring Network The monitoring net will be characterized by different levels of

activity: stand-by, pre-alert, alert, plus a control modality An event worth to be monitored is for example the evolution

of a “landslip”


Instrument Element: Scalable on embedded systems

FPGAPPC405

Xilink Virtex IV

Custom Board

Cus

tom

Ele

ctro

nics

1 Gbps Ethernet

Web

Ser

vice

Grid

CC

IM

Java

VM

Linu

x

USER INTERFACE

Custom Logic

Montavista www.montavista.com

JamVM http://jamvm.sourceforge.net

Standalone Axis

IEInstrument Manager


IE technologies Web Service compliant (WS-I)

Tomcat + Axis (and Java) and Axis standalone are the main technologies of the IE

All the services are deployed on a single or multiple instances of Tomcat, according to the needs of the application

Message oriented middleware (Pub/Sub) is based on the Java Messaging System (JMS). The following implementations are used in the project

Sun Narada Brokering RMM - JMS (GridCC IBM)

MySQL and Oracle are used as Data Base for the RS

SRM interface version 2.2 used


Conclusions I

The GRIDCC technology (based on web services) is used to have an homogenous backbone to control and monitor geographically widely distributed instrumentation.

Data taken from the instrumentation can be directly seen by the european computational and storage GRID

CMS experiment is using for its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes

AGaTA experiment is building its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes


Conclusions II

GRIDCC is ending this year having reached all the mail milestones foreseen and having, in particular, a production environment (CMS) daily running and serving hundreds of physicists in commanding and controlling either their sub detectors or the full experiment.

GRIDCC team is now keen to look for new exploitations of their outcomes in different contexts adding, possibly, new developments and customization of the middleware according to the new needs.

The control and monitor of pan European projects like EMSO and KM3NET appears to be very attractive in this sense, as it could be implemented like a new e-infrastructure across Europe dedicated to the remote control of big scientific apparatus. Moreover the online data integration with the computational and storage GRID provides to fill a gap in the existing computational grid and at the same time give a strong added value to the proposal of this new e-infrastructure.


Grid TechnologiesGrid Technologies

Lambda Lambda NetworkNetwork

Web 2.0 Web 2.0 ToolsTools

Pervasive Pervasive ComputingComputing

Conclusions IIIhttp://sadgw.lnl.infn.it:2002/MapsMonitor


Querring Client

Querring Client

Discovery Instruments (I) The discovery of the instruments or of the IEs is an issue

when the number of elements is high We can have two cases:

Quasi static cases The number of IEs are well defined and the single IE is quite complex with

a good hardware support In this case a register based discovery mechanism can be used. GRIDCC tesbed is using the LCG BDII (Berkely Database Information

Index ) based on LDAP The information collected in the BDII follow a GLUE schema and can be

used for match making querries

IE

IE

IE

BDIILocal BDII

Querring Client


Discovering Instruments (II)

Dynamic cases The number of IEs can change very quickly, they are very simple devices,

often with poor hardware support The discovery is just use to know which are the online IEs A new approach has been developed based on Peer to Peer (P2P)

protocols See the demo

IE

IE

IEIE

M1

M2

Querring Client

Querring Client

Querring Client


Question?

Thx for your time!The GRIDCC Project. Grid enabled Remote Instrumentation with Distribute Control and Computation. Official Webpage of FP6 European funded project. Video On-Line Demo. A sample video that shows the GRIDCC service orchestration.

Live Demo. A Peer to Peer Approach for the Geo-Location of a Grid of Instruments

GridCC in GRIDToday. Gaetano Maron and Francesco Lelli presented the GRIDCC project in one of the leading online journals.

GridCC in Wikipedia

Instrument Element Facade Online documentation for Instrument Elements developers.

More:

Date post:	22-Jan-2016
Category:	Documents
Upload:	cleta
View:	46 times
Download:	0 times

GRID enabled remote instrumentation and sensors with distributed control

Documents