Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel...

Post on 22-Dec-2015

217 views 2 download

Tags:

transcript

Virt

ual L

ab A

Mst

erda

m

VLAM-G Project

VLAM-G developers team

Computer Architecture and Parallel Systems GroupDepartment of Computer Science

Universiteit van Amsterdam

National Institute for Nuclear and High Energy Physics

Institute for Atomic and Molecular Physics

Virt

ual L

ab A

Mst

erda

m

Outline

Introduction Objectives VLAM-G Principles VLAM-G Architecture VLAM-G & DASII VLAM-G Application Examples Conclusions

Virt

ual L

ab A

Mst

erda

m

VLAM-GVirtual Laboratory AMsterdam

A collaborative analysis environment

for applied experimental science

Grid and VLAM is about sharing resources:

physical equipment (remote experimentation)Data & Information repositories

Virt

ual L

ab A

Mst

erda

m

Virtual Lab.

Application Layer

Grid Layer

Virt

ual L

ab A

Mst

erda

m

Objectives & realization Methods

• Enable VLAM-G users to define, execute, and monitor their experiments• Provide to VLAM-G users:

location independent experimentation,familiar experimentation environmentassistance during their experimentsEasy way to bring/port new/existing applications to the Grid

•Developing application prototypes to check ideas and to learn

Virt

ual L

ab A

Mst

erda

m

• Application layer

Case studies

Provides VLAM-G modules

• Middle layer (Top)

Hides the details of the Grid

Offers an information management system

Objectives & realization Methods

Virt

ual L

ab A

Mst

erda

m

Virt

ual L

ab A

Mst

erda

mVLAM-G Architecture

VLAM-G Client

collaboration

Assistant

VIMCO

Grid/Globus Services

PFT DBRTS DB

Resource A Resource B

M1

M2

Mn

RTS

Module Repository

SessionManager

Virt

ual L

ab A

Mst

erda

mVLAM-G Run Time System on

DAS-2

DAS-2

NIKHEF

VU

RTSM

VL module 5

VL module 4

VL module 2

VL module 3

VL module 1VLAM-G GUI

RTSM

VL module 1

- VLAM-G Run Time System Manager

- VLAM-G experiment module

VLAM-G GUI - VLAM-G Graphical User Interface

Virt

ual L

ab A

Mst

erda

m

Node 0

Job management on DAS-2

Node N

Node 2

Node 3

Node 1...

SM

PBSover

Globus

Subcluster (e.g. at NIKHEF)

node

node

node

node

node

node

node

node

node

Other subclusters:

...

RTSM

VL module 1

VL module 5

GUI

PBSover

Globus

Subcluster (e.g. at NIKHEF)

Other subclusters:

VL module 2

VL module 4

VL module 3

VIMCO

App. DBRTS DB

Virt

ual L

ab A

Mst

erda

mProcess Flow Template

(PFT)• Used as a blueprint for a specific type of

experiments

• PFT is designed offline by the experts in each scientific domain

• It is the main interface used by the VLAM-G users to perform a specific experimentation in the VLAM-G environment.

• It Guides the user while performing the experiment.

Virt

ual L

ab A

Mst

erda

m

The PFT (cont.)

PFT (GUI)

VIMCO RTS

Expressive MACS EFC

Application databasesResource A

Compose the experiment(GUI)

Define the context f the experiment(GUI)

Experiment Editor

Virt

ual L

ab A

Mst

erda

mProcess Flow Template

Owner

Empty

Literature

Extraction

Conversion

Q. Ctrl

DC Analys.

Sample

Treatment

Treated sample

Surface Scan Raw Data

Data CubeInterpretation

Photograph

Settings

Apparatus

Data Cube

Cerf. Tool

Ana Tool

Virt

ual L

ab A

Mst

erda

mStatus of the VLAM-G

Prototype The first Beta-release is almost ready This release will contain:

A tool to load modules in the VLAM-G database

A list of modules that can selected and used C/C++ API to write VLAM-G modules Support for the MACS and DNA array

experiments It should be conform to the Globus security It is going to be running on DAS-2

Virt

ual L

ab A

Mst

erda

m

The histogram demo

This demo. is about running jobs on different Grid enabled machines using the VLAM-G environment.

Two modules: Slider Visualization

Virt

ual L

ab A

Mst

erda

m Histogram demo

Virt

ual L

ab A

Mst

erda

m

Floating ball experiment

This experiment is about controlling remote external devices using the VLAM-G environment.

Two modules: controller Visualization

Virt

ual L

ab A

Mst

erda

mFloating ball experiment

Virt

ual L

ab A

Mst

erda

m

The MRI scan experiment

This experiment is about running jobs on different Grid enabled machines using the VLAM-G environment.

Four modules: MRI scanner Converter to NetCDF Visualization Modules: 2D and 3D

Virt

ual L

ab A

Mst

erda

mRMI Scan experiment

Virt

ual L

ab A

Mst

erda

mMACS (Material Analysis

of Complex Surfaces)

• Remote experimentation (-beam)

• Data storage

• Meta-data analysis (combine data from different sources)

Virt

ual L

ab A

Mst

erda

mMACS lab Devices

--beam beam

FTMSFTMSTOF-SIMSTOF-SIMS

FTIR FTIR scoopscoop

Virt

ual L

ab A

Mst

erda

m

What is needed?

• High speed network

• Huge computing power

• Analytical Instruments / Data

• Micro-beam, FTIR, TOF-SIMS, …

• Capable database, generic data format

• Software (“The glue”) The Virtual Laboratory env. “ VLAM-G”

Virt

ual L

ab A

Mst

erda

m

VL databaseVL databaseSamplSamplee

Meta-data analysis

Virt

ual L

ab A

Mst

erda

mExperiment Process Flow

Template

ObjectObject Photo_ImagPhoto_Imagee

LiteratureLiterature

OwnerOwner

SampleSample

Sample_ExtractionSample_Extraction

Treated_SampleTreated_Sample

Sample_TreatmentSample_Treatment

Material_AnalysisMaterial_AnalysisPhysics_DevicePhysics_Device

File_ConversionFile_ConversionConversion_ToolConversion_Tool

Data CubeData Cube Data CubeData CubeDC_AnalysisDC_Analysis

Analysis_ToolAnalysis_Tool

Results_ObservationsResults_Observations

Virt

ual L

ab A

Mst

erda

mDemo3: MACSLab Exp

Virt

ual L

ab A

Mst

erda

mConclusions

VLAM-G: a science portal for exp. analysis Workflow support for

Bio-informatics, Materials Scienceand Biomedical Simulation & Visualisation

Seamless access to distributed resources

Resource Management: based on Globus Content Management: VLAM-G middleware Current status: preparing the beta-release of

the VLAM-G toolkit.

Virt

ual L

ab A

Mst

erda

m

Where to find about the VLAM-G projects

VLAM-G home page http://www.dutchgrid.nl/VLAM-G