CERNAlberto Di Meglio

Darmstadt, 18-20 February 2009

Project Status UpdateETICS 2 All-Hands Meeting

INFSO-RI-223782Summary

Consortium managementEffort consumptionDeliverables statusCollaborationsOverall technical statusThe FutureGoals of this Meeting

•2ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Consortium Management

• The Consortium has been running smoothly so far, although the concerns about recruitment and effort are not yet over (more in the individual activity reports)

• All partners have regularly met in the PMB meeting each month as planned

• All Activity leaders have regularly met in the ETICS Technical Committee meetings.

• Consumed effort and budget are lower than expected due to the initial issues, but the last quarter was in line with expectations

• If any significant underspending is still present at the time of the review we need to present a recovery plan

•3ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Effort Tracking

Consumed PM Budgeted PM Consumption

Funded 89 119.8125 74 %

Unfunded 35 43.8750 80 %

Funded+Unfunded 124 163.6875 76 %

•4

Estimated effort consumption for the first 9 months:

• Effort and budget information are always provided Effort and budget information are always provided quite late. Please fill the timesheets by the due date!!! It quite late. Please fill the timesheets by the due date!!! It is VERY important to do this to allow NA1 to monitor is VERY important to do this to allow NA1 to monitor the project coststhe project costs

ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Budget tracking

•5ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

Q3 totals - EUR RTD OTHER COORD MGMT TOTAL

Declared Costs 55,907.83 218,186.15 65,746.78 50,902.56 390,743.32

Budget Forecast Costs 58,427.13 246,885.88 74,927.50 48,001.13 428,241.63

Consumption 96% 88% 88% 106% 91%

Q1+Q2+Q3 totals RTD OTHER COORD MGMT TOTAL

Actual Costs 171,968.99 498,142.67 151,161.07 119,719.51 940,992.24

Budget Forecast Costs 467,417.00

1,975,087.00 599,420.00 384,009.00 3,425,933.00

Consumption 37% 25% 25% 31% 27%

Table 5: Total project budget consumption since project start in € (forecast = 37.5%)

Table 4: Total project budget consumption in Q3 in €

INFSO-RI-223782Deliverables Status

• All deliverables up to PM9 have been submitted• All PM12 deliverables are now being worked on, but they have to

be ready for submission to the EC by March 15th!!!!• Despite the effort so far, we are consistently very late. This is an

aspect that has to be improved (I expect comments in this sense at the review)

•6ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Milestones TableCurrent and next quarter

•7

•

ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

Id WPNo

Deliverable / Milestone title Lead partner Natur

e (***)

OriginalDelivery date(*)

Revised delivery date(*)

Status(**)

MNA2.3 2Dissemination events organized (according to dissemination plan)

3 - ENG O M12 In progress

MNA2.4 2

Two projects are issued with a Grid-QCM certificate (gLite, UNICORE)

3 - ENG O M12 In progress

MSA2.2 4ETICS has integrated support for new identified services

2 - INFN O M12 Not started

MJRA1.2 5

Management tools with integrated virtualization technologies are available (prototype)

5 - UoW O M12 In progress

MJRA2.1 6

User interface and Test Execution Generator (prototype) delivered to SA1

4 – 4DSOFT O M12 Not started

•

INFSO-RI-223782Deliverable TableCurrent and next quarter

•8

•

ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

Id WPNo

Deliverable / Milestone title Lead partner Natur

e (***)

OriginalDelivery date(*)

Revised delivery date(*)

Status(**)

DNA1.3 1 First period progress reports 1 - CERN R M12 Not started

DNA2.4 2First year analysis of training and tuning activities 3-ENG R M12 Not started

DNA2.5 2Dissemination and Use of Knowledge Plan (Second Update)

3-ENG R M12 Not started

DNA2.6 2Long-term sustainability strategy and activity report (first release

3-ENG R M12 Not started

DSA1.4 3Execution plan for second 12 months of infrastructure operation

1 - CERN R M12 Not started

DSA2.4 4Infrastructure services integration – Implementation (Part 1)

2 – INFN RO M12 In progress

DJRA1.3 5Integration of Virtualization Technologies (prototype) 5 – UoW OP M12 Not started

DJRA2.3 6Test tool registration system (prototype) 4 – 4DSOFT OP M12 No started

DJRA2.4 6User interface and Test Execution Generator (prototype)

7 – SZTAKI OP M12 Not started

•

INFSO-RI-223782ETICS Usage

• There are currently 35 registered projects in ETICS, but only a few are really used, mainly gLite and D4Science, not counting ETICS itself. But new important projects have been added during ETICS 2 (UNICORE, StoRM) and we have recently attracted new important projects like ARC in the context of EGI/UMD

• This a weak point to be addressed. We need to:• Add more new projects REALLY using ETICS• Understand why existing projects are abandoned

• Is it because ETICS is too difficult to use or doesn’t do what it’s expected to do or isn’t needed?

• In particular we need to have example of commercial use of the system

•9ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Collaborations

• New potential collaborations foreseen in the coming months (more details in SA2 presentations)• EGEE• ESA• Unicore-based applications• ARC• UMD• See-Grid

• Are we exploring all opportunities for disseminating ETICS?• Participation to seminars, conferences• Training• Journal articles• What else?

•10ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Project Timeline

Mar 08 Sep 08 Mar 09 Sep 09 Mar 10

Kick-off

I Review

II Review

All-hands

meeting

All-hands

meeting

All-hands

meeting

All-hands

meeting

Two projects are issued with

a Grid-QCM certificate

(gLite, UNICORE)

Four projects are issued with a Grid-

QCM certificate

First new infrastructure applications

built and tested with ETICS

ETICS runs on different

infrastructures

ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009 •11

INFSO-RI-223782Issues/achievements

• Quality of code• The major problems reported by users in the past ETICS project

have been now solved and we are adding new features. However, user-friendliness and intuitiveness are still an issue (some work is being done, more in SA1 and SA2 presentations). We also need to start applying our methods on ETICS itself, add more unit tests, collect metrics and evaluate the A-QCM score of ETICS itself

• User support and Quality of Service• User support is well established by now. The support infrastructure

run by SA2 is as efficient as it can be, the support web site needs more material. Training is behind schedule, need to create the online training content and organize training events. We have a new web site, but several discussions have been ongoing over the layout, content and usability

• Industrial take-up• Although ideas have been discussed, there is nothing yet we can

show.

•12ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Issues/achievements

• Cross-site submission and parallel testing• These features are still at the prototype level. Projects like gLite

and 4DScience are picking up on these topics, but we need to be able to provide a stable implementation of these features soon

• Lack of maintenance of the Web Application• This problem has been largely solved by the reassignment of

Paolo Fabriani to this task. However, he is also often moved temporarily to other assignments within Engineering, which causes problems

• Integration of plugins in the client• This is always an issue. It always falls behind schedule. Effort in

now being reassigned within SA1 to speed up the integration of the plugins

•13ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February

2009

INFSO-RI-223782Issues/achievements

• New features Vs. usability• The ETICS plan foresees many new features (release

management, test workflow management, A-QCM reporting, support for more middleware implementations, etc)

• But, the main issue with users is the complexity of the user interfaces, the lack of privacy features, the complexity of the installation and maintenance procedures

• How can we simplify usage and at the same time keep our commitments? I’d like the activity managers to comment on these points and highlight what is being done

•14ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782EGI, the gLite Consortium and the Future

• ETICS cannot continue as an EC-funded project forever• It must become part of the general activities being developed in

Europe in the scientific research communities• EGI_DS, UMD, the gLite consortium and other related activities

projects always mention ETICS in some way and recently several discussions and some practical work has been done. This may provide a possible sustainability scenario

• At the same time alternative exploitation strategies have to be devised and explored (dedicated session today and PMB discussions later)

•15ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Goals for This Meeting

• The main goal is to bootstrap the review preparation work• The other main goal is to take the opportunity of being in the same

room and discuss the issues, but also (especially) solve problems together

• We will try to have a planning session Thursday afternoon. The current plan must be updated (although I must say that after the initial commitment to the plan agreed in Palermo, we have slipped more into the red)

• The questions I’d like to be addressed during this meeting (updated from the previous AH meeting) are the following

•16ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February

2009

INFSO-RI-223782Availability of testing features

• This is the key selling point of ETICS• Most of the new users are being attracted to ETICS by the

promise of this feature• Can we provide some initial capability in this sense without

having to wait until all tools become available at the end of the project

• Simple, straightforward working examples to keep the interest alive

•17ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February

2009

INFSO-RI-223782Extension to new infrastructures: requirements and planning

• Which infrastructures are we targeting now? And in 6/9/12 months?

• What technical requirements, issues have been found?• What organizational requirements, issues have been found?• Lessons learned? Can be easier next time?• What else?

•18ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

ANY

UPDATE?

INFSO-RI-223782ETICS Job Submission: architecture, design, implementation, policies

• What are the possible implementation strategies and what impact do they have on the infrastructures?

• What are the integration and deployment issues?• Is there any additional effort required from users? Can we

avoid it?• What are the pre-requisites from the system (virtualization?

security? virtual organizations? policy agreements?)• What else?

•19ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February

2009

ANY

UPDATE?

INFSO-RI-223782Distributed testing tools: status, issues, planning

• What are the tools integration challenges?• What are the requirements on existing parts of the system in

terms of technology and deployment?• Are we making sure the tools will SIMPLIFY usage and not

make it MORE COMPLEX?• One of most commons complaints is that doing things with

ETICS is more difficult than doing them manually. User-friendliness, intuitiveness, documentation, etc must not be overlooked

•20ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February

2009

ANY

UPDATE?

INFSO-RI-223782A-QCM implementation

• Are all required metrics collectors identified?• How is the A-QCM score calculated (is it a plugin in itself? Is

calculated asynchronously?)• What about trend analysis?• How is the report generator integrated with the metrics

disseminators?• What projects will first be run through A-QCM? And in the

next 6/9/12 months?• What else?

•21ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

ANY

UPDATE?

INFSO-RI-223782Dissemination and exploitation strategies

• How can we promote ETICS? Not just on a theoretical level, but practically (convince users to try it and stick to it)?

• Conferences are good of course, but sometimes too high level, what other practical channels can be explored?

• What about training? We can organize courses, but people have to want to be trained

• How can ETICS and its methods be further exploited?• In particular what are the sustainability strategies beyond

ETICS 2?

•22ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009

INFSO-RI-223782Review preparation schedule

3 April: Review2 April: Dressed rehearsal?? March: Second rehearsal18 March: All deliverables and project reports must be in the hands of

the EC and reviewers15 March: All deliverables and project reports must be sent out (CD-

ROM)10 March: All deliverables and reports must be ready for PMB approval2 March: activity quarterly report to project manager (Alberto); all (most)

budget and effort data to project admin (Catherine)20 February: deliverables second draft19 February: First rehearsal13 February: deliverables first draft

•23ETICS 2 All-Hands Meeting - Darmstadt, 18-20 February 2009