PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESSComputing PortalComputing Portal
Poznań Supercomputing and Networking Center (PSNC)Poznań Supercomputing and Networking Center (PSNC) PolandPoland
Cezary MazurekCezary Mazurek
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PSNC ActivityPSNC Activity
Operator of the Polish National Research and Education Network POL-34/622
Operator of the Poznań Metropolitan Area Network POZMAN
HPC Center Systems and Network Security Center R&D Center for New Generation
Networks, Grids and Portals
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PIONIER National ProgrammePIONIER National Programme
GRID-enabled Applications
Co
mm
un
icatio
nA
pp
lication
Geo
grap
hical
info
rmatio
nap
plicatio
ns
En
viron
men
tM
anag
emen
tA
pp
lication
Distan
ce L
earnin
gA
pp
lication
Intern
et A
ccessA
ided
L
earnin
gA
pp
lication
Co
mp
utatio
na
lS
cience
Ap
plicatio
n
Advanced Network Services (Middleware)
Optical Network
Advanced Research Specialized Infrastructure
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PIONIER NetworkPIONIER Network
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PIONIER ProjectsPIONIER Projects
PROGRESSAccess environment to computational services performed by
cluster of SUNs iTV
System for providing an audio-visual stream over Polish Optical Internet enabling the interactive television
LDAP Deployment of LDAP Protocol in the National Research
and Education Network POL-34/622 VLAB
High Performance Computing and Visualisation for Virtual Laboratory Applications
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
Duration: December 2001 – May 2003 Deployment: June 2003-December 2003 Project Partners
SUN Microsystems PolandPSNC IBCh PoznańCyfronet AMM, KrakówTechnical University Łódź
Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
Project is testbed oriented Three bioX applications will be enabled within
the grid-portal architectureTwo of them are already available
Distributed cluster of SF6800 is a pilot testbed installationDedicated channels through PIONIER network (1 Gb/s)
will come in the 3Q2003 Tools and services for grid processing and data
management in PROGRESS grid-portal framework
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PROGRESS ArchitectureArchitecture
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PROGRESS CommunicationCommunication
SGESGE
HTTP/HTTPSHTTP/HTTPS
DataManagement
GLOBUSGLOBUS
Po
rtal
GridBroker W
ebse
rvic
eFT
P
HTTP/HTTPS
Service Provider
Grid F
TP
Webservice
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
Pilot installation Poznan-Krakow3 SUN Fire 6800
• Poznań: SUN Fire Link
2 Data ServersFront-end for portal access
Distributed processing in distributed framework
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS TestbedPROGRESS Testbed
PROGRESSGRID
PROGRESSGRID
Kraków
PIONIERPoznań
2xSF6800
SF6800
SFV880
SFV880
SF280R Łódź2xSE420
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS testbedPROGRESS testbed
POZNAŃ KRAKÓWFrontend
Computing
Datamanagement
Data storage
Portal Server
SGE EE
HPC Cluster Tools
Globus
Aplication Server
Certification Server
Oracle
SRS
Database
SRS
Database
Aplication Server
Certification Server
Oracle
SGE EE
HPC Cluster Tools
Globus
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS testbedPROGRESS testbed
Fibre Channel
1Gb/s Ethernet
SF 6800
SF V880
SF 280R
SB 1000 SE T3/T3+
Management
FastEthernet
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – BioX ApplicationsPROGRESS – BioX Applications
DNA Assembly BranchBound1 DNA Assembly Heuristic2 DNA Assembly Heuristic3 Prediction of protein secondary structure - module A1 Prediction of protein secondary structure - module A2 Prediction of protein secondary structure - module B Prediction of protein secondary structure - module C Prediction of protein secondary structure - module D
Logical workflow applications:• LAD – learning: A1->B->C• LAD – testing: A2->D
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PROGRESS ArchitectureArchitecture
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS HPC WindowPROGRESS HPC Window
GRID user interfaces are independent of the information processing layer bioX computational portalMigrating Desktop application
The PROGRESS HPC Portal is the user interface for the PROGRESS grid access environment
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
4 – tier architecture for grid-portal environment
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS Service ProviderPROGRESS Service Provider
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
Content P
rovider
Webservice
Session B
ean
Entity B
eans
SOAP
SOAP/XML
ComputingPortal
GRID Service Provider
Content ProviderData presentationUser interaction
Service ProviderRealization of
services functionsServices data storage
and access
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PortalPROGRESS Portal
PROGRESS computational portal Accessing applications collected in the application factory Forming and running jobs Accessing data stored in the Data Management System Providing information services
The PROGRESS Portal is equipped with 5 portlets (content providers) interacting with the user on behalf of PROGRESS services. These portlets are: My jobs My data News Applications Management
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS Grid servicesPROGRESS Grid services
Job submission service creating, building, submitting, monitoring execution and analyzing results of
grid jobs (“My jobs” portlet) Application management service
adding and configuring applications in the GSP application factory (“Applications” portlet); “virtual application” management under development
Provider management service keeping up-to-date information on services available in the grid service
provider (“Management” portlet) Informational services
news service – reading short messages illustrated with web links (“News” portlet); multiple instances; other informational services under development – “Discussion”, “Links” portlets)
Data management uploading and downloading files, file system tree management (“My data”
portlet)
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Web services communicationWeb services communication
HPC PortalGrid
Service Provider
DataManagement System
GridResource Broker
saveJob()getApplications()saveTaskOfJob()saveStdOfTask()submitJob()getUserJobs()getJobStatus()
listUserDirectory()addUserFile()
getUserFileLocation()
submitJob() changeJobStatus()
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Authentication and access Authentication and access controlcontrol
Authentication: username+password, LDAP based user database
Authorization - 2 levels:portlet access control – performed by the portal
frameworkgrid services authorization – RAD based
authorization moduleSingle Sign-On – enabled by the identity
server
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Authentication, authorization Authentication, authorization and SSO in PROGRESSand SSO in PROGRESS
Po
rtal Grid service
provider
Identification
serverRAD
Logon
Authentication
Request
Method invocation
Token validation
Authorization
of resource access
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS Grid brokerPROGRESS Grid broker
Grid Broker in Progress:Job submission, monitoring and controllingDifferent scheduling and resource
management strategiesFlexible job description language (XRSL)Heterogeneous and service based
environment
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS Grid BrokerPROGRESS Grid Broker
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Grid brokerGrid broker
Resources
Resources & Resources & Services Services BrokerBroker
Globus
SGE
InformationSystem
(GIS)
ResourcesMonitoring
Portal+ request description XRSL
(XML/RSL)
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESSData Management SystemData Management System
Provides seamless access to data and information for grid computing
Uses metadata repository for describing stored data
Stores data on various media such as files, tapes and databases
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PROGRESS Data Management SystemData Management System
INTERNET
DBFile System
Data Broker
Data Storage
Mirror & Proxy
Data Storage Data Storage
MetadataManagement
SRS
UniTree
WS
GASSFTPGrid FTP(...)
Clients
PortalPortal
Grid brokerGrid broker
Migrating desktop
Migrating desktop
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS SecurityPROGRESS Security
Intrusion Detection System (IDS)Advanced security mechanisms that are destined to
detect, possibly in real time, unauthorized security attempts, security breaches and attacks.
One of the tasks realized in the PROGRESS project is VALKYRIE IDS for Solaris operating system.
VALKYRIE IDS:• is a host based system,
• passively monitors protected infrastructure,
• uses misuse detection approach for analysis,
• works continuously.
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
VALKYRIE IDSVALKYRIE IDS
Module for monitoring operating system events (kernel level module)
Expert system module for analyzing system events stream and for attack detection
GUI console for system operator
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS SecurityPROGRESS Security
Oracle
IPLANET
Solaris globus
grid engineSCM
Expert System Module
GUI
Portal protection
PCSS
Firewall System
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS Migrating DesktopPROGRESS Migrating Desktop
Alternative user interface to GRID resources;
Layout analogous to „windows based” operating systems GUI, like e.g. Windows, KDE, Gnome, etc. – can be more intuitive for some users;
Possibility of working with different grid projects (integrated also with CrossGRID project co-funded by EU);
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Migrating Desktop FunctionalityMigrating Desktop Functionality
Graphic User Interface (GUI) management; User profile management; File transfer management; Job configuration and submition; Job execution monitoring; Handling links to local files and applications; Handling links to remote files;
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
Migrating Desktop – main windowMigrating Desktop – main window
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
PROGRESS at Supercomputing 2002, Baltimore, USAPROGRESS at Supercomputing 2002, Baltimore, USA
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESSPortalPortal
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – job listPROGRESS – job list
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – job menuPROGRESS – job menu
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – job tasksPROGRESS – job tasks
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – task requirementsPROGRESS – task requirements
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – data managementPROGRESS – data management
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS – application PROGRESS – application factoryfactory
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS - newsPROGRESS - news
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESSPROGRESS
ConclusionsThe PROGRESS project has provided
components and services for flexible grid-portal environment, which might be deployed in other projects and environments
PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security
PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,
PROGRESS PROGRESS
Thank you !
http://progress.psnc.pl/http://progress.psnc.pl/portal