1 |

The MHSDS and CYP Outcomes ReportingJuly 2018

2 |

• Poor Data Quality and Availability is one of the key areas that needs to be addressed in improving

CYPMH services:

‘Significant gaps in the availability of data mean it is difficult to get a clear picture of what services are

available to children and young people across the country.’ (CQC report October 2017)

• Is one of the key areas attributed by services as the cause of current underperformance

• Addressing this supports the key area of Accountability and Transparency in Future In Mind

• CCGs have recently submitted recovery plans to improve data quality in MHSDS

• It is not known nationally or regionally who is performing well and where improvement is

needed

• The one off collection from CCGs in December and local intelligence from regions indicated issues

with data quality and under reporting, but also genuine performance issues

What is the problem?

Presentation title

3 |

Mental Health Services Dataset

The Mental Health Services Dataset (MHSDS) is a person-level, output based, secondary uses data set

It delivers robust, comprehensive, nationally consistent and comparable person-based information for children, young people and adults who are in contact with Mental Health Services.

4 |

https://www.england.nhs.uk/publication/joint-technical-definitions-for-performance-and-activity-20171-8-201819/

5 |

Access Definition

𝐶𝑌𝑃 𝑎𝑡𝑡𝑒𝑛𝑑𝑖𝑛𝑔 𝑡ℎ𝑒𝑖𝑟 𝑠𝑒𝑐𝑜𝑛𝑑 𝑐𝑜𝑛𝑡𝑎𝑐𝑡 𝑖𝑛 𝑡ℎ𝑒 𝑐𝑢𝑟𝑟𝑒𝑛𝑡 𝑓𝑖𝑛𝑎𝑛𝑐𝑖𝑎𝑙 𝑦𝑒𝑎𝑟

𝐶𝐶𝐺 𝑃𝑟𝑒𝑣𝑎𝑙𝑒𝑛𝑐𝑒

• The measure counts new CYP attending their second contact this financial year

and

• CYP who have remained in the system since the previous year and attended a further two contacts

• This means that there is a large ‘spike’ in reported numbers in the first quarter of each financial year

• NHS England measure an estimated year-end position which accounts for this spike

• Minimum standard for FY18/19 is 32% cumulatively by the end of the year

• The standard will increase to 35% by FY2010/21

7 |

Prevalence

• Estimated prevalence of diagnosable mental health problems in CYP aged 5-16 at 9.6% (2004 survey)

• The percentage prevalence varies between CCGs according to age, sex and socio-economic

classification (social class)

• This is applied to CCG populations as at April 2014 (NHS Digital data)

• Updated prevalence information will be available late 2018

But

• The commitment remains 70,000 more CYP per year

• CCGs have already developed trajectories and submitted plans

• The revised prevalence might inform planning for 19/20 and 20/21 in some CCGs but will not affect the

overall national commitment

9 |

The total number of CYP in treatment:

What is being counted?

Age is <18 at first contact. The second contact can be after the 18th birthday.1

Although treatment may include indirect contacts it does not include email or SMS.2

An individual can be counted only once in a financial year.3

Treatment is defined as 2 contacts. The date of the second contact determines the reporting month.4

Individuals can be counted in multiple financial years if they have 2 contacts in each.5

20 |

• The metadata – the technical definition of how NHS Digital data is derived – is available at https://digital.nhs.uk/data-and-information/data-collections-and-data-sets/data-sets/mental-health-services-data-set/mental-health-services-monthly-statistics

• CYP access data is calculated across months and financial years in a complicated way

• As a result, an SQL script is included instead of the edited snippets used for other KPIs

• You cannot just copy and paste the SQL into a database but it does help you along the way

How can I get more details?

21 |

From October 2017 activity, new CYP starting treatment is published monthly as indicator MHS69*

• MHSDS reports are available from https://digital.nhs.uk/data-and-information/publications/statistical/mental-health-services-monthly-statistics

• From the February report onwards, provisional data is also available in the same file

• The file is called “MHSDS Monthly: Final mmm-yy Provisional mmm-yy Children and Young People Receiving Second Contact With Services CSV”

• As well as CCG and provider data, it is possible to see which providers are contributing to which CCGs

How can I access the data?

* This is also called MHS69a in some publications

22 |

Which file?

This one

Not this one

Contains a great deal of interesting

information about CYP services,

including DNA rates, self-referral

rates and the use of scores at

assessment but not the number

of CYP starting treatment

Definitely not these ones

Contains access and waiting

times information about Eating

Disorders and EIP services but

not the number of CYP starting

treatment

23 |

Other Data is Available

Presentation title

0

10

20

30

40

50

60

70

80

90

100

% DNA Rates

24 |

Other Data is Available

Presentation title

0

10

20

30

40

50

60

% Self Referrals

25 |

• The national CYP outcomes measure was confirmed by NHS England in a recent message to CCGs

• It is consistent with existing CYP IAPT outcomes measurement

• Reliable improvement (and reliable change) is the basis for measurement

• Full guidance will be published with initial data on 28th July – all information given here is provisional until that point

• ‘Data quality information’ will be published by NHS England for the first time on 28th July and each month thereafter

• Information will be published by provider only during the ‘data quality’ phase

• ‘Performance Information’ will be published by NHS England from April 2019

Outcomes

Presentation title

26 |

• More information and the ability to ask questions will be available at the NHS England data surgery:

Introduction to the Outcomes Metric

Children and Young People Mental Health Outcomes Webinar

Friday 20 July 2018

14:00-14:30pm

Web link to join the meeting: CLICK HERE

*This webinar can only accommodate 120 attendees so please dial in promptly if you want a place!

(Please note you need to click the blue link above to view the presentation materials – this webinar is not dial in only)

Dial in 0800 9171950

Attendee access code: 204 510 72

Outcomes Webinar

Presentation title

27 |

• As with the current access standard, measurement will be per referral

• Data quality items will include the number of referrals

• With two contacts

• With at least one score about the clinical cut-off (i.e. the denominator for measurement)

• With at least one paired assessment score

• That reliably improved

• That reliably deteriorated

• That made no reliable change

What Will be Available

Presentation title

28 |

Some Data is Available Now

Presentation title

0

5

10

15

20

25

30

35

40

45

% Assessment Scores Recorded at First Attendance

29 |

Before Upload

Input data Window Opens

MDS ExtractCreate

database

Upload to Open Exeter

Initial row count check

Validation reports

Pre-deadline extract

Optional re-upload

Window closes

Post-UploadPost-

Deadline Extract

Data Quality Notices

Published reports

How can I improve my MHSDS submissions?

1. Check the data – there are multiple opportunities to check what you are uploading

2. Sign off the data – data should not be submitted until operational and clinical leaders have given a meaningful sign-off

3. Use the data – ensure that MHSDS-produced figures are visible within your organisation

30 |

https://digital.nhs.uk/binaries/content/assets/legacy/pdf/q/9/mhsds_submission_windows_1718_1819_v2.pdf

31 |

Contact

Follow us on Twitter @MH_ISTNetwork

Michael Watson

Intensive Support Manager

Intensive Support Team (Mental Health)

M 07879 113 249

E M.Watson@nhs.net | W improvement.nhs.uk

Follow NHS Improvement on: Twitter | LinkedIn