1

2

PERFORMANCE SUB-COMMITTEE REPORT

3

PERFORMANCE SUB-COMMITTEE REPORT

I. Why Progress Tracking?

II. Proposed approach

III. Decision Points

IV. Backup

Agenda

4

BACKUP

Why focus on Progress Tracking?

Create links between RBM activities and impact on global malaria control

targets

Report on RBM 2008 targets

Actively monitor the Harmonized Work

Plan 2008

Explanation

• RBM partnership needs to report progress on the HWP 08 activities (~ USD 33M budget) – ROI for the donors

• HWP 2008 has 6 priorities, > 100 activities, covering 12 mechanisms, that extend from end of 07 until end of 08

• > 50% of these activities involve collaboration between mechanisms: mutual progress updates are important

• RBM partnership has defined high level targets for 2008

• Contribution from activities of HWP 2008 needs to be qualitatively assessed and reported in order to improve future plans and activities

• While RBM fills the vital resource gaps in the global malaria control, majority of the impact/ outcomes fall outside of RBM partnership’s control

• To gauge the appropriateness of its workplan budgets, however, the partnership needs to measure the overall progress made by countries through annual Landscape Report updates

5

At RBM, Progress Tracking Needs To Occur at Three Levels

• Progress reporting based on completion of

activities in the yearly Harmonized Work Plan

(HWP) 2008

HWP ‘08 Activities

HWP ‘08 Targets• Progress tracking against RBM HWP 2008 targets

RBM 2010 Targets • Progress report on global targets by aggregating

country level data tracked by the partnership

Level 1

Level 2

Level 3

Item Tracked Level of aggregation

BACKUP

6

At RBM, Progress Tracking Needs To Occur at Three Levels

HWP 2008 Activities

HWP 2008 Targets

RBM 2010 Targets

Level 1

Level 2

Level 3

Item TrackedIs RBM directly accountable? Why?

• Activities have been defined by RBM mechanisms

• Targets involve implementation and decisions beyond the RBM mechanisms. E.g., 12-20 countries to deploy MIS

• Targets involve implementation and decisions beyond the RBM mechanisms (e.g., in-country and global actors)

• Achievement of outcomes take long periods and need significant in-country effort

7

I. Why Progress Tracking?

II. Proposed approach

III. Decision Points

IV. Backup

Agenda

8

Summary of Progress Tracking for Three levels

ItemTracked,Example

Level 2 Level 3Level 1

Process

Involvement

Output

• RBM Sec managed monitoring process

• Activities maintained in a shared file

• Management dashboard with exception handling capability updated

• Monitored every 3 months

• Performance Sub comm. (PSC) and RBM Sec. managed

• Compiled based on interviews and qualitative assessments on progress

• Compiled every 6 months

• Performance Sub comm and RBM Sec. managed

• Compiled based on data from countries and global malaria scene

• Compiled once a year

• Led by: RBM Sec

• WGs, SRNs and the board to input into the process

• Led by: PSC, RBM Sec.

• Chairs and co-chairs of WGs, SRNs to participate in the process

• Led by: PSC, RBM Sec.

• Countries, donors and other constituencies of the partnership

• 3-monthly progress report by priority and mechanism

• Exception reporting, “red flags”

• Report for EC

• 6-monthly progress report by priority, target and mechanism

• Exception reporting

• Report for EC, Board

• Yearly Malaria Landscape Report

• Other?

Activities defined in the HWP 2008

1.4.1 Provide consultant support to 45 malaria endemic sub-Saharan African countries to complete needs assessment and gap analysis including partner and intervention mapping.

HWG Contracting out, Sep07 –Mar 08, USD4.5M

2008 Targets set by RBM partnership

2008 targets for Priority 1:

• 45 technically sound, operationally feasible ,country and partner owned SUFI business plans

• Support deployment of partnership coordinators in 10 countries

RBM 2010 Targets

By 2010, particularly in the lowest two economic quintiles

• 80% of people at risk from malaria are protected

• 80% of malaria patients are diagnosed and treated with effective anti-malarial medicines …

9

Measuring Progress at Level 1

EXAMPLE

What will be tracked: All priorities and All Mechanisms

Process for tracking

• Set up progress tracking tool/system

• Set up HWP activities in progress tracking system

• Launch progress tracking process with WGs and SRNs and set up expected dates for monitoring

• Set up progress tracking tool/ system

• Launch monitoring process end of every quarter

• Generate progress and exception reports by priority and mechanism

• Report to the EC and launch activities needed to make progress in HWP

• Consolidate yearly progress

• Compile lessons learnt in activity implementation, goal setting and monitoring process

• Report to the Performance sub committee and to the Board on HWP progress

End of Q1,Q2,

Q3, Q4 08Q4 07 Q4 08

Sample of output – Management Dashboard

Activities

Q1 2008 – Progress update on HWP 08

Budgets

Action items

Exceptions

Total # of Activities = 140

0%

20%

40%

60%

80%

100%

0%

20%

40%

60%

80%

100%

Ongoing

Complete

Yet to start

Tracked

Un-tracked

0%

20%

40%

60%

80%

100%

USD Million

Planned activities

Unplanned activities

Ratios (>1 shows an exception)

Budgets actual vs. planned

Budget needed vs. remaining for uncommenced activities

1.13 %

1.13 %

% of total budget used vs. % of Ongoing activities completed 10 % /

• XWG having unresolved resourcing issues

• XARN unable to create awareness around X events

• RBM Sec to convene a special EC call to resolve issues

• ..

% of total Budget used 52 %

Total ’08 PlannedQ1 Actual

Q1 Planned

33

17

15

Q1 Budget overspend

USD 2 M 52 %

10

Measuring Progress at Level 2

EXAMPLE

What will be tracked: 2008 Targets

Process for tracking

Sample of output (Based on Qualitative comments)

• Agree on targets at RBM Board 2007 meeting

• PSC and RBM Sec set up process for target 08 measurement

Jun ‘08End ‘07 Nov ‘08

• Launch mid-year Level2 measurement process

• Schedule interviews with all chairs

• Compile report to the EC and partnership on findings

• Launch actions

• Launch end of year Level2 measurement process

• Schedule interviews with all chairs

• Compile report to the partnership board on findings (Discuss during 08 board meeting)

Targets for 2008

• >60% of countries applying for funding in Round8

(GFATM) to be successful

• 45 Countries mobilize adequate funds for SUFI

• An affordable facility for Malaria in place

• 45 countries have access to affordable medicines

for malaria through the private sector

• At least 95% of countries currently getting funding should

continue to keep it

• At least 80% of countries with existing Global Fund assistance

should perform at "A" or “B1” ranking

• 45 technically sound, operationally feasible ,country and

partner owned SUFI business plans

• Support deployment of partnership coordinators in 10 countries

• Track progress and report to the EC and the partnership Board

• Partnership achieves > 80% implementation rate of planned

activities of the HWP

• 12-20 countries to deploy MIS

• Publish Malaria Landscape report and update 107

country profiles

5

2

3

4

1

6

Progress to date

11

Measuring Progress at Level 3

EXAMPLE

What will be tracked: RBM 2010 Targets Process for tracking

Sample of output

• PSC agrees with MERG and RBM Sec. on the parameters to measure

• List of measurement parameters agreed and compiled

Q1 08End ‘07 Q4 08

• Launch measurement process with donors, countries and other partnership constituencies

• Set up guidelines and processes

• Compile data

• Analyze and prepare landscape report

• Publish landscape report

INPUT

• Total resources committed

• Volume of ITN inflows

• Measurement of Global Fund disbursement (and rating)

• General government expenditure on health as a percentage of total

government expenditure

• Per capita government expenditure on health at international dollar rates

OUTCOME

• Density of physicians and nurses per 1000 people

• People served as a % of people in need for ACT, ITN, IRS, IPT

• % of U5 children with malaria fever receiving appropriate treatment within 24 hours

• % of households with at least one ITN

• % of U5 children sleeping under ITN

• % of pregnant women sleeping under ITN

• % of pregnant women on IPT according to national policy

• % of households in malarious areas protected by IRS

• % of U5 children with uncomplicated malaria correctly managed at health facilities

• % of health facilities with no stock-outs if nationally recommended anti-malarial

drugs continuously for 1 week during last 3 months

• % of malaria epidemics detected within 2 weeks of onset and properly controlled

IMPACT

• All-cause under 5 Mortality rate

• Anaemia prevalence in children under 5 years of age

• Parasite prevalence rates in community surveys

• Laboratory confirmed malaria cases seen in health facilities

• Laboratory confirmed malaria deaths seen in health facilities

• Malaria-attributed deaths in sentinel demographic surveillance sites

See RBM Malaria Landscape Report

12

I. Why Progress Tracking?

II. Proposed approach

III. Decision Points

IV. Backup

Agenda

13

DECISION POINTS

• Review the content of the performance measures and the means by which evaluative data will be captured

• Discuss and Adopt progress reporting framework for the 2008 Harmonized Work Plan

• Discuss and systematize annual evaluation process and recommendations for Performance Sub-Committee

• Provide guidance on alignment of progress reporting framework with the ongoing development of the Global Malaria Business Plan (between now and May 2008)

• Reaffirm its commitment to a results-oriented Partnership, and its own collective responsibilities emerging from its position as the governing body of the Partnership

14

I. Why Progress Tracking?

II. Proposed approach

III. Decision Points

IV. Backup

Agenda

15

BACKUP

Why focus on Progress Tracking?

Create links between RBM activities and impact on global malaria control

targets

Report on RBM 2008 targets

Actively monitor the Harmonized Work

Plan 2008

Explanation

• RBM partnership needs to report progress on the HWP 08 activities (~ USD 33M budget) – ROI for the donors

• HWP 2008 has 6 priorities, > 100 activities, covering 12 mechanisms, that extend from end of 07 until end of 08

• > 50% of these activities involve collaboration between mechanisms: mutual progress updates are important

• RBM partnership has defined high level targets for 2008

• Contribution from activities of HWP 2008 needs to be qualitatively assessed and reported in order to improve future plans and activities

• While RBM fills the vital resource gaps in the global malaria control, majority of the impact/ outcomes fall outside of RBM partnership’s control

• To gauge the appropriateness of its workplan budgets, however, the partnership needs to measure the overall progress made by countries through annual Landscape Report updates

16

At RBM, Progress Tracking Needs To Occur at Three Levels

• Progress reporting based on completion of

activities in the yearly Harmonized Work Plan

(HWP) 2008

HWP ‘08 Activities

HWP ‘08 Targets• Progress tracking against RBM HWP 2008 targets

RBM 2010 Targets • Progress report on global targets by aggregating

country level data tracked by the partnership

Level 1

Level 2

Level 3

Item Tracked Level of aggregation

BACKUP