European Middleware Initiative (EMI)

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

SA1 – Maintenance and Support

Francesco Giacomini (INFN)

EMI First EC Review

Brussels, 22 June 2011

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Outline

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•SA1 Objectives and Tasks in Y1

•Key Performance Indicators

•Lessons learned

•Y2 Outlook

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

SA1 Objectives and Tasks

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Software Maintenance: Ensure the efficient andtransparent management of the maintenance processproviding software problems analysis and resolutions

•Release Management: Ensure customers receivecertified software releases of middleware services andcomponents according to agreed release policies andquality of service attributes

•Quality Control: Increase the quality levels of the EMIsoftware by contributing to the implementation of theQuality Control procedures defined by the project QAactivity

•User Support: Establish the EMI User Support functionand integrate it with the overall EGI, PRACE and VRCsuser support channels

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

SA1 in EMI

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Common picture to be included…

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

EMI Release and Software Timeline

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

01/05/2010

Start

EMI 1

EMI 2

EMI 3

Support & Maintenance

Supp. & Maint.

30/04/2011

30/04/2012

28/02/2013

Major releases

Major releases

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Software Maintenance

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Keep the stability of the software currently in production,introducing only the changes that are needed to keep theinfrastructure running

–Bug fixes or requested improvements

–No backwards-incompatible changes

•Waiting for EMI 1 the Software Maintenance plan was applied asmuch as possible to existing software distributions

–Following procedures inheritedfrom previous projects

•Constant flow of updateswith no discontinuity betweenprojects

•Security vulnerabilities addressedfollowing the recommendationsof the Risk Assessment Team ofthe EGI Security VulnerabilityGroup

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Release Management

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI 1 – Kebnekaise

Released on May 12th, 2011

•54 products from ARC, dCache, gLite, UNICORE

•Scientific Linux 5 (augmented with EPEL5), 64 bit, fullysupported platform

–Selected products for SL5, 32 bit, available

–Porting to SL6 starting soon

•333 binary packages

–86% of source packages

–Digitally signed

•192 external dependencies

–165 from SL5/EPEL5, 27 managed by EMI

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

EMI 1 Preparation

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Required a huge integration effort to put together ina coherent way all the existing software components

–Common tools (ETICS, Savannah)

–Common procedures

•Tools and procedures provided by SA2

–Common external dependencies, same versions

•Globus libraries by IGE, taken from EPEL

•Coordination of many people from differentexperiences

–Engineering Management Team (EMT)

–Weekly phone conferences + e-mail discussions

•EMI 0 and four EMI 1 Release Candidates, withincreasingly strict criteria, towards the final release

–Integration builds run multiple times a day

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

User Support

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Organization based on the EGEE experience, followingreviewers' recommendations

•SUs are automatically monitored through GGUS

•No discontinuity between projects

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Quality Control

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•The activity performed by the SoftwareMaintenance, Release Management and UserSupport tasks was reviewed by the QualityControl task

–Following policies and check-lists contained in theSoftware Quality Assurance Plan by SA2

–Feedback was returned to SA2 to improve the SQAPitself, about:

•Alignment between SA2-defined metrics and KPIs

•Tools to use to measure metrics and KPIs

•Introduction of thresholds for metrics

•Introduction of tolerance ranges for the checklists

•Coordination of the EMI 1 QC Verification

–Joint activity with JRA1 and SA2

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Security Assessment Plan

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Under the responsibility of the SA1 QC task

•Novelty wrt previous projects

•Plan available and being implementedstarting from security-related softwarecomponents

–Based on the “First principles vulnerabilityassessment” methodology

•Collaboration with the EGI SoftwareVulnerability Group and the University ofWisconsin

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Service Level Agreements

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•One SLA signed so far, with EGI, in April 2011

•It covers Software Development and Supportservices needed for EGI

–Provide clear description of roles and responsibilities

–Provide a measurable description of the offered services

•E.g. target response time for GGUS tickets, depending on theirpriority

•Covered services

–Software Releases

–Requirements Analysis

–Requirements and Software testing reports

–Web-based support

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Key Performance Indicators

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

User Support

•KSA1.1 – Number of incidents (i.e. tickets)

•KSA1.2 – Incident resolution time

Software Maintenance

•KSA1.3 – Number of problems (i.e. bugs)

•KSA1.4 – Number of urgent changes

•KSA1.5 – Change application time

Release Management

•KSA1.6 – Number of releases

•KSA1.7 – Number of release rollbacks

•Difficult to collect raw data in a uniform way for existing software

–Some KPIs were postponed to after EMI 1 release

from GGUS

from RfC trackers

from Release tracker

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

KSA1.1

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

KSA1.2

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

KSA1.3

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Issues, Mitigation, Lessons Learned

•Putting together software developed in verydifferent contexts is hard

–EMI 1 represents the starting point

•Putting together the people who developed theabove software is harder

–Build consensus among project members beforeapproving plans and policies

–It took a lot of time and patience

–Agreed plans and policies are now available fromSA2

•Application of Quality Assurance methods isnot straightforward

–Improve communication

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Issues, Mitigation, Lessons Learned /2

•Difficult/impossible to measure theperformance of heterogeneous procedures in auniform way

–No KPIs for existing software

–It is now easier, after the EMI 1 release

•Relationship with EGI Unified MiddlewareDistribution

–We find their procedures overly complex but we’lldo our best to comply with them

•Not much effort/experience available withinthe project for security assessments

–Internal training

–External collaborations

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Outlook

2011-06-22

SA1 - F. Giacomini - 1st EMI Review

•Contribute EMI software to EGI UMD

–According to the agreed procedures

•Support and maintain EMI 1

•Continue support and maintenance of pre-existing distributions

–With diminishing effort and according to the serviceend-of-life policy

•Establish support relationships with other DCIs(e.g. PRACE)

•Work towards EMI 2 - Matterhorn

EMI 1

Apr 2011

Apr 2012

Jun 2011

Feb 2012

Jan 2012

Nov 2011

Mar 2012

RC1

RC2

RC3

RC4

EMI 2

Development plans ready

ETICS infrastructure ready

Development plans ready

ETICS infrastructure ready

EMI INFSO-RI-261611

$C:\Dokumente und Einstellungen\nl\Eigene Dateien\Aufträge 2009-JSC\EMI-PPT-Template\streifen.png$

EMI INFSO-RI-261611

Thank you

EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611