Date post: | 06-Apr-2018 |
Category: |
Documents |
Upload: | kebo-anabrang |
View: | 221 times |
Download: | 0 times |
of 35
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
1/35
International Journal for Quality in Health Care 2004; Volume 16, Supplement 1:pp. i11i25 10.1093/intqhc/mzh032
Using clinical indicators in a qualityimprovement programme targetingcardiac care
ANNABEL HICKEY1, IAN SCOTT1, CHARLES DENARO2, NEIL STEWART1, CAMERON BENNETT2AND THERESE THEILE2
1Department of Internal Medicine, Princess Alexandra Hospital, Brisbane, 2Department of Internal Medicine, Royal Brisbane Hospital,Brisbane, Australia
Abstract
Rationale. The Brisbane Cardiac Consortium, a quality improvement collaborationof clinicians from three hospitals and Wvedivisions of general practice, developed and reported clinical indicators as mea
sures of the quality of care received by patientswith acute coronary syndromes or congestive heart failure.
Development of indicators. An expert panel derived indicators that measured gapsbetween evidence and practice. Datacollected from hospital records and general practice heart-check forms were usedto calculate process and outcome indicatorsfor each condition. Our indicators were reliable (kappa scores 0.71.0) and widelyaccepted by clinicians as having face validity.Independent review of indicator-failed, in-hospital cases revealed that, for 27of 28 process indicators, clinically legitimatereasons for withholding speciWc interventions were found in
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
2/35
Project rationale and conception
Improving quality of health care requires performance measurementand feedback. Various programmes targeting cardiaccare have combined the use of clinical indicators with otherquality improvement interventions in identifying and closing
the gaps between routine care and evidence-based best practice[14].
However, in the successful development and use of clinicalindicators, several dimensions need to be carefully considered:
(i) deWning the purpose of measurement; (ii) determiningtarget standards of care; (iii) formulating data collectionmethods; (iv) converting data into usable clinical indicators;and (v) maximizing the impact of indicator feedback. In thisreport we describe our experience in undertaking these stepswithin a multifaceted quality improvement programme targeting
in-hospital and post-hospital care of patients admittedwith acute coronary syndromes (ACS) or congestive heartfailure (CHF). An overview of our programme is provided inBox 1.Address reprint requests to A. Hickey, Clinical Services Evaluation Unit, Princess Alexandra Hospital, Ipswich Road,Woolloongabba, Brisbane, Queensland, Australia 4102. E-mail: [email protected]
International Journal for Quality in Health Care vol. 16 Supplement 1 i11
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
3/35
A. Hickey et al.Box 1 Overview of the Brisbane Cardiac ConsortiumThe Brisbane Cardiac Consortium (BCC) was one of four quality improvement consortia in Australia to receive 2 yearsfunding from the federal government under the Clinical Support Systems Program (CSSP) auspiced by the Royal Australian
College of Physicians. The program targeted the in-hospital and post-hospital care of patients admitted with acute coronarysyndromes (ACS) and congestive heart failure (CHF). The program ran from October1, 2000, to August 31, 2002, andinvolved three teaching hospitals [Royal Brisbane (800 beds), Princess Alexandra(700 beds) and Queen Elizabeth IIHospitals (260 beds)] and four Divisions of General Practice within metropolitanBrisbane.Program objectives were to optimize care using systematic processes of performance measurement and feedback combinedwith various quality improvement interventions. The latter included dissemination of locally developed clinical practice
guidelines and other forms of decision support, academic detailing of patients and clinicians by clinical pharmacists,provision of patient self-management resources, and close liaison between hospital and general practitioners andcommunity pharmacists regarding future patient management.Primary outcome measures were changes in clinical indicators between baseline (1/10/0017/4/01) and post-intervention(15/3/0230/8/02) periods as measured on all consecutive patients who met pre-speciWed case deWnitions.* Post-hospitalcare indicators were collected on a subset of patients who satisWed eligibilitycriteria** and gave informed consent to posthospitalfollow-up.The program saw participation of 2495 patients (1584 with ACS; 911 with CHF), 10
cardiologists, 17 general physicians, 20emergency physicians, 5 clinical pharmacists, 50 medical registrars, 200 residents, 150 nursing staff, and 1020 generalpractitioners.
*ACS: clinical diagnosis of ACS + elevation of cardiac enzyme markers (troponinor creatine kinase levels elevated to more than 1.5 and
2.0 times upper normal reference range respectively). CHF: clinical diagnosis and at least 3 key clinical signs (elevated jugular venouspressure, gallop rhythm, chest crackles to mid-zones bilaterally, pedal oedema,or pulmonary oedema or cardiomegaly on chest X-ray).**Absence of major co-morbidity (physical or psychological) which precluded ability to self-care, permanent resident in the greaterBrisbane area, community-living, and ability to speak English.Development and design of clinicalindicators
Defining the purpose of measurement
We wanted indicators that would guide and motivate internalquality improvement activities in hospital and general practice,and not be used merely for monitoring purposes byexternal agencies. To engage health care providers we wantedour indicators to be clinically relevant to speciWc processes of
care that demonstrated an accepted link with desired healthoutcomes [5]. We aimed to present aggregate indicator data atthe level of facility or, where sample size was large enough,
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
4/35
at a departmental or group general practice level. As the targetgroups were identiWable groups of clinicians, we considered itvital that the indicators were robustly accurate.
Determining standards and indicators usingmultidisciplinary teams
We speciWed the target standards of care in a set of clinicalpractice guideline recommendations derived from a systematicreview of the research evidence [68]. These guidelines weredeveloped over a period of 5 months, using formal group consensusmethods, by multidisciplinary panels of general physicians(n = 5), cardiologists (n = 5), general practitioners (GPs;n = 12), clinical pharmacists (n = 2), and advanced physiciantrainees (n = 3). These panels contained expertise in clinicalcontent and measurement, and represented the interests ofpotential users of the indicators [9]. The development work
was coordinated by the programme manager in liaison with the
eight-member Clinical Guideline Working Group.
The same multidisciplinary team derived sets of clinicalindicators from guideline recommendations and a review ofindicators published by other groups [10,11]. Indicatorsrelated to both process (what care was given to whom) andoutcome (what was the end result of care), were designed tobe as explicit and objective as possible, and were developedby group consensus.
Methods
Data collection
Data used to calculate in-hospital care indicators wereabstracted by trained nurses from hospital medical recordsretrieved shortly after discharge. Post-hospital care data werecollected using a 1-page heart-check form completed duringGP consultations at 3, 6, and 12 months post-discharge. Examplesof data forms used are provided in supplementary data.We restricted data elements for each indicator to those thatwere objectively veriWable and easily retrieved from medicalrecords or GP case notes.
Conversion of data into useful clinical indicators
Improving care processes known to have a direct link withhealth outcomes was our prime objective. To this end, processindicators predominated over outcome indicators, particularly
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
i12
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
5/35
Cardiac clinical indicators
as large, risk-adjusted samples are required to detect signiWcantchanges in outcome indicators (such as in-hospital deathor 30-day readmission) given their relatively low event rates(in our experience 70% of all dataWelds, with 95% completion for medication use.
Validity. We validated in-hospital process indicators byindependently reviewing charts of all seemingly eligiblepatients who failed to receive speciWc interventions in the Wrst
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
6/35
and last 6-month periods for those indicators that showed afailure rate of >20% (see below). The only indicator forwhich clinically legitimate reasons were detected for withholdingcare in >5% of indicator-failed cases was prescriptionof warfarin in patients with CHF. In 64 of 113 (56%) patientsdeemed eligible for warfarin but who did not receive thisdrug, review disclosed relative contra-indications such as
frailty or risk of falls in 43 (67%) of cases.
Impact. To inXuence clinician behaviour, we chose indicatorsthat had the capacity to signal the existence of important evidence-practice gaps and that were potentially amenable tochange [16,17]. We presented indicator values in easy to interpretgraphical and tabular formats, which depicted changes inindicator rates over time ( Figures 1 and 2) and which included areference standard (or target) of 100% of highly eligible patientsreceiving the stated intervention. In addition, we employed variousstrategies (see below) to enhance the ability of indicatorfeedback to stimulate clinician attempts to improve care [18,19].
Maximization of clinical indicator impact
Feedback of in-hospital care indicators occurred at 6-monthlyintervals, while feedback of post-discharge (general practice)indicators occurred over two rounds separated by 18 months,as follow-up data were collected more slowly and the patientsample was only one-third that of the in-hospital sample.
Dissemination
We disseminated results via hospital unit meetings, hospital anddivisions of general practice newsletters, drug and therapeutics
bulletins, grand round presentations, educational meetings,and in-service training sessions. We ensured doctors, nurses,and clinical pharmacists at all levels were exposed to indicatorfeedback [20].
Feedback partnered with education and discussion
Clinical audit and periodic feedback, in isolation, engenderonly moderate levels of change [21]. Lack of skills, knowledge,and leadership are some of the known barriers to practiceimprovement [22]. Consequently, we coupled indicator feedbackin hospitals with small group discussions about guidelinerecommendations and the signiWcance of the indicator Wndings.Practice improvement was promoted through citing casestudies of successful innovation elsewhere, and the formationof interdisciplinary groups that took responsibility forimproving speciWc care processes [23].
Customized indicator analyses
Encouraged by the work of others [17], and receiving localrequests, we provided more personalized reports to individualhospital consultants about performance within his or herunit if patient samples were large enough to give statisticallymeaningful trends. These reports compared that consultants
performance with peers from all three hospitals andincluded patient demographics to reconcile any differencesin case mix.
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
7/35
Feedback from providers and modificationsto the original plan
Clinician responses to reported indicators in the Wrst feedbackround centred, not surprisingly, on data quality and face validity,
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
i13
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
8/35
A. Hickey et al.Table 1 Process indicators for in-hospital careIndicator Eligibility criteria
................................................................................
.........................................................................
Inclusions Exclusions
................................................................................
................................................................................
........................................................
Acute coronary syndromes
Presentation
ECG: proportion of patientsreceiving ECG within10 minutes of hospitalremoval
Thrombolysis: proportionof highly eligible patientsreceiving thrombolysis
Time to lysis: proportionof highly eligible patientsreceiving thrombolysiswithin 60 and 30 minutes
of hospital arrival
In-hospital courseCardiac counselling:proportion of highly eligiblepatients receiving in-hospitalcardiac counselling
Assessment of serum lipids:proportion of patientsundergoing testing of serumlipids
Discharge status1 -blocker: proportion ofhighly eligible patientsprescribed -blocker
Anti-platelet agents:proportion of highlyeligible patients prescribedanti-platelet agents (aspirinor clopidogrel)
ACE inhibitors: proportion
of highly eligible patientsprescribed ACE inhibitors
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
9/35
Lipid-lowering agents:proportion of highlyeligible patients prescribedlipid-lowering agents
All patients
Patients with ST segmentelevation or new left bundlebranch block
All highly eligible patientsreceiving thrombolysis
All patients
All patients
All patients
All patients
Past history or in-hospitalonset of congestive heartfailure, LV ejection fraction4.0 mmol/l
Nil
Recent trauma or surgery, cardiopulmonaryresuscitation, prior cerebrovascular accident ortransient ischaemic attack, uncontrolled hypertension(>180/100 mmHg), coagulopathy, active gastrointestinalbleeding, late (>12 hours) presentation, patientrefusal, uncertain diagnosis, or scheduled for primaryangioplasty
Nil
Nil
Nil
Asthma, severe chronic obstructive pulmonarydisease (FEV1
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
10/35
adverse drug reaction
Adverse drug reaction
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
continued
i14
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
11/35
Cardiac clinical indicators
Table 1 continued
Indicator Eligibility criteria
................................................................................
.....................................................................
Inclusions Exclusions
................................................................................
................................................................................
........................................................
Cardiac rehabilitation:
proportion of highlyeligible patients referredto outpatient cardiacrehabilitation programme
Coronary angiography:proportion of highly eligiblepatients undergoing earlycoronary angiography (duringindex admission or scheduledwithin 30 days of discharge)
Non-invasive risk stratiWcation:proportion of highly eligiblepatients undergoing noninvasiverisk assessment(during index admission orwithin 30 days of discharge)
Congestive heart failure
At presentationRecording underlying causes:proportion of patients forwhom underlying causes forheart failure were recorded inhospital notes
Recording acute precipitants:proportion of patients forwhom acute precipitantswere recorded in hospital notes
Fluid regimens: proportionof patients for whom aXuid management regimenwas explicitly recorded in
hospital notes
Daily weigh: proportion
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
12/35
of patients undergoingdaily weighing in assessingeffectiveness of diuresis
DVT prophylaxis: proportionof patients receiving DVTprophylaxis
Dietitian review: proportionof patients receiving dietitianreview re: salt and Xuid intake
Testing of thyroid function:proportion of patientsundergoing thyroid functiontesting
All patients
Recurrent angina orreinfarction, or NSTEMIinfarction or inducibleischaemia on non-invasivetesting
All patients
All patients
All patients
All patients
All patients
All patients
All patients
Atrial Wbrillation as newarrhythmia
Primary or rescue angioplasty, age >75 years, currentsmoker, severe COPD, stroke with hemiplegic deWcit,renal disease (serum creatinine =0.2 mmol/l), advancedliver disease, advanced cancer, alcohol/drug dependence,living in residential care
Coronary angiography (performed or scheduled) or otherexclusions as listed under coronary angiography
Nil
Nil
Nil
Nil
Concurrent warfarin therapy
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
13/35
Nil
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
continued
i15
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
14/35
A. Hickey et al.Table 1 continuedIndicator Eligibility criteria
................................................................................
.......................................................................
Inclusions Exclusions
................................................................................
................................................................................
........................................................
Assessment left ventricularfunction: proportion ofpatients who have undergone
left ventricular imaging eitherduring index admission orwithin previous 12 months
Clinical pharmacist review:proportion of patientsreceiving review by clinicalpharmacist
Discharge status1ACE inhibitors: proportionof highly eligible patientsprescribed ACE inhibitor at
discharge
ACE inhibitor dose:proportion of highlyeligible patients prescribedACE inhibitors at dischargewho receive target dose
-blockers: proportion ofhighly eligible patientsprescribed -blockers atdischarge
Warfarin: proportion of highlyeligible patients prescribedwarfarin at discharge
Deleterious agents: proportionof patients who did not receivedeleterious agents (class Iantiarrhythmic agents,verapamil, diltiazem, NSAIDs,tricyclic antidepressants)
Clinic follow-up: proportionof patients scheduled foroutpatient clinic review within
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
15/35
4 weeks of discharge
All patients
All patients
LV ejection fraction 0.3 mmol/l, systolic blood pressure
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
16/35
racy and justiWcation of the method of indicator calculation. indicator-failed patients. Only four clinicians accepted this offerThe rigorous research approach to measurement can appear at and none asked for the reported indicators to be revised.odds with the more pragmatic process of measurement for In the second round we emphasized indicators for whichimprovement [24]. Clinicians experiencing difWculty in accepting improvement in
care would result in the greatest gains in
i16
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
17/35
Cardiac clinical indicatorsTable 2 Process indicators for post-discharge care measured at 3, 6, and 12 months following hospital discharge
Indicator Description
................................................................................
................................................................................
........................................................
Acute coronary syndromes
Anti-platelet agent Proportion of patients receiving anti-platelet therapy-blockers Proportion of patients receiving -blockersACE inhibitor Proportion of patients receiving ACE inhibitorLipid-lowering agents Proportion of patients receiving lipid-lowering therapyControl of serum lipids Proportion of patients achieving serum cholesterol
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
18/35
and statisticiansDevelop database logic checks to alert when incorrectdata are being entered, e.g. discharge date that is before anadmission date
Pilot test the indicators and data collection methods andreWne them over a set period (in our case, 3 months) and
update data entry manual accordingly
Monitor data reliability with frequent interim analyses andregular meetings of data collectors to ensure consistency ofdata item interpretation and measurement
Undertake re-abstraction audits of randomly selectedhospital charts in assessing level of agreement amongabstracters (inter-rater reliability)
patient outcome. We offered potential solutions based on literaturereviews and action research conducted elsewhere. We
collaborated with various groups in providing more customizeddata that better informed their attempts to improve care.
This support-giving approach was further consolidated inthe third round of feedback, by which time data quality was
no longer an issue. Various multidisciplinary groups were nowacting across professional boundaries to improve speciWcaspects of care [23]. At this time, we surveyed a representativesample (n = 150) of hospital clinicians about the usefulnessand impact of indicator feedback. Although the response ratewas low (25%), >70% of respondents found feedback usefuland wished to continue receiving it, while 52% reported that
it had resulted in changes to practice.
During the course of our implementation, we modiWed theproject design as a result of clinician feedback and internalre-appraisal.
Brevity and clarity. Our Wrst post-discharge care feedbacknewsletter to GPs met with almost universal dismissal onthe grounds that it contained too much uninterpretable datathat could not be assimilated by busy practitioners.Consequently we restricted ourselves to simple tables andboxed key messages (see Figure 3), which elicited positiveresponses.
Liberalization of eligibility criteria. With certain pharmacologicalindicators (e.g. warfarin, ACE inhibitors) we found that byusing restricted indications and inclusive contra-indications,very few patients demonstrated eligibility for treatment, andthus the indicator was rendered useless. In such cases we created,by consensus, a new version of the indicator with moreliberal eligibility criteria that still accorded with evidence-based clinical decision-making.
Balancing effort of validation with the need for timely feedback. Wefound that repeated minor corrections of the raw data aimed
at maximizing validity of the calculated indicator did notmake any signiWcant difference to the reported indicatorvalue, and simply delayed its timely release which, in turn,
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
19/35
reduced its impact on clinicians. We reconWrmed Hannansdictum: do not wait for better dataperfect should not bethe enemy of good [25].
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
i17
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
20/35
100806040Series 1Series 2
Series 3Series 4200
A. Hickey et al.Discharge status
% of eligible patients receiving treatment
B-B A-A ACE-I LLA Heparin
Figure 1 Graphical feedback of consecutive series of values of process indicators for in-hospital care of patients with acutecoronary syndromes. Series 1: patients discharged 17 October 2000 to 16 April 2001 (note: no data on heparin use werecollected for patients in this series). Series 2: patients discharged 17 April 2001 to 20 September 2001. Series 3: patientsdischarged 21 September 2001 to 18 February 2002. Series 4: patients discharged19 February 2002 to 31 August 2002. A-A,patients receiving anti-platelet agents; ACE-I, patients receiving angiotensin-converting enzyme inhibitors; B-B, patients receiving-blocker; LLA, patients receiving lipid-lowering agents; Heparin, patients receiving heparin infusion.
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
Avoiding frequent minor changes in indicator deWnition [26]. Whiledata sets should allow for changes in indicator deWnitions toreXect evidence-based changes in practice, minor changesserved only to confuse clinicians wanting to make comparisonsacross feedback periods. We ceased making differentversions of the same indicators after the Wrst round for reasonsother than those mandated by the publication of resultsof important, new clinical trials.
Discontinuation of indicator reports based on small samples. We originallyenvisaged a 3-month rather than a 6-month cycle for in-hospital feedback. While we desired timely indicator feedback,the shorter cycle span led to smaller patient samples which, forsome indicators with low event rates, introduced excess randomerror [27]. While statistical process control methods [28,29] couldhave been used to correct for such error, we were concerned thatadding such analyses to our feedback formats would have jeopardizedtheir interpretability to the majority of clinicians.
Discontinuation of formal feedback sessions. By the third roundof feedback, hospital clinicians did not desire feedback to beaccompanied by formal discussion sessions, suggesting that
external facilitation becomes redundant once the culture ofimprovement has been established.
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
21/35
Results
Preliminary results
Baseline process indicators suggested suboptimal performancein several areas [30,31], with subsequent improvement in most
indicators and signiWcant change in 17 of 40 (Tables 47). It isimpossible to gauge the extent to which these improvementsin care can be attributed solely to clinical indicator feedbackamong several concurrent quality improvement interventions.However, focus group discussions and results of the previouslymentioned questionnaire survey suggested that indicatorfeedback had stimulated changes in practice.
Lessons learned and future plans
Our experience yielded several lessons that are guiding futureplans. Firstly, keep the number of data elements to a minimum.
Our dataset for in-hospital care comprised 171 variablesfor ACS and 204 for CHF, many relating to patient demographicsand clinical characteristics, which we reasoned wererelevant to determining process-of-care eligibility or conductingrisk-adjusted outcome comparisons. In retrospect, a largefraction of these data (and the effort involved in collectingthem) added little to the validity of reported indicators and wasnot required for case-mix adjustment in the presence of casedeWnitions and standardized patient ascertainment. In a furtherextension of our work, data elements have been reducedto 50 for ACS and 45 for CHF [32]. Secondly, more economicalmethods of data collection and entry are worth exploring. Inthe absence of universal electronic medical records, proformas
that are read by text recognition software are being trialed[33], which affords more rapid importation of data into databasesand reduction in transcription errors.
i18
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
22/35
Cardiac clinical indicators
by guest on October 8, 2011intqhc.oxfordjournals.orgDownloaded fromFigure 2 Tabular feedback of clinical indicators for in-hospital care of acute coronary syndromes.
i19
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
23/35
A. Hickey et al.by guest on October 8, 2011intqhc.oxfordjournals.orgDownloaded fromFigure 3 Feedback forms relating to post-discharge (general practice) care.i20
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
24/35
Cardiac clinical indicators
by guest on October 8, 2011intqhc.oxfordjournals.orgDownloaded fromFigure 3 continued
i21
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
25/35
A. Hickey et al.Table 4 Changes in process and outcome indicators for in-hospital care for acutecoronary syndromesIndicator Baseline (n = 428) Final remeasurement period(1/10/0017/4/01) (n = 436) (15/2/0230/8/02)
................................................................................
................................................................................
........................................................
PresentationElectrocardiograph within 10 minutes of presentation1Lysis administrationLysis in 60 minutesLysis in 30 minutes
In-hospital course
Lipid levels checkedNon-invasive risk stratiWcation testsCoronary angiographyIn-hospital cardiac counselling1
Discharge status-blockerAnti-platelet agentsACE inhibitors1Lipid-lowering agents1Referral to outpatient cardiac rehabilitation1
Outcomes
In-hospital mortalityRe-admission (same cause) in 30 daysMedian length of hospital stay (days)1
ACE, angiotensin-converting enzyme.1SigniWcant change (P = 0.05).
Thirdly, in terms of sustainability, our costings suggest thatmeasurement and feedback systems used ~50% (or $500 000)of the programme budget, which was expended on 2500 patients
(i.e. approximately $200 per patient). Trends in the datasuggest that costs are more than likely to be offset by improvementsin health outcomes such as the observed 1-day reductionin median length of hospital stay for patients with ACS. Theminimization of datasets and the use of previously mentionedscanning technology will signiWcantly reduce this infrastructurecost.In the Queensland state public hospital system, our revisedmethods for measuring and reporting clinical indicator dataare being continued in the three consortium hospitals andextended to 14 other large hospitals under the auspices of theCardiac Collaborative of the Queensland Health Collaborativefor Healthcare Improvement [32]. Our indicator experienceis also assisting the Cardiac Society of Australia and
New Zealand (CSANZ) [34] and the National Institute of ClinicalStudies (NICS) [35] to develop national indicator sets forACS and CHF, respectively, and to inform the quality
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
26/35
improvement strategies that these organizations may want tosponsor in the future.
As a result of our programme, Wve divisions of generalpractice representing all GPs in metropolitan Brisbane havebecome involved in clinical audit and feedback. However, thelong-term continuation of this activity in its current form is
proving to be a challenge due to the expense and labourinvolved. Less than ideal response rates limit the sample size,
145/238 (61%)49/49 (100%)35/39 (71%)17/49 (35%)
311/428 (73%)17/57 (30%)41/45 (91%)168/351 (48%)
212/251 (84%)301/318 (95%)105/143 (73%)165/202 (82%)24/351 (8%)
28/379 (7.4%)26/351 (7.4%)
7.0
170/244 (70%)
39/39 (100%)28/39 (72%)16/39 (41%)
336/436 (77%)17/55 (31%)43/46 (93%)212/371 (57%)
202/239 (85%)321/334 (96%)113/139 (81%)197/223 (88%)64/371 (17%)
23/394 (5.8%)17/371 (4.6%)
6.0
requiring longer feedback cycles in order to accrue meaningfuldata.
Performance measurement and feedback are an integralpart of quality improvement initiatives. We attempted to
develop a sustainable system of indicator collection andreporting as part of a programme targeting care of two commoncardiac conditions associated with signiWcant mortality
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
27/35
and morbidity. Taking a patient-centred focus, we providedfeedback for indicators targeting both hospital and communityproviders. At an organizational level, our methodology isbeing extended to multiple public hospitals throughout ourstate, while the smaller, less resourced divisions of generalpractice are building on their experience to develop lowercost systems for ongoing clinical audit.
Acknowledgements
We are appreciative of the extensive support given byQueensland Health, and the cooperation of the members ofthe clinical indicator expert panels and others involved in indicatoranalysis, in particular: Dr Kathleen Armstrong, Dr JohnAtherton, Dr John Bennett, Mr Neil Cottrell, Dr ChristineFawcett, Dr Judy Flores, Dr Andrew Galbraith, Dr PaulGarrahy, Ms Ann Hadwyn, Professor Tom Marwick, Dr AlisonMudge, Dr Mark Morris, Dr Bronwyn Pierce, Ms DanielaSanders, and Ms Justine Thiele. The authors gratefully acknowledge
the funding support of the Australian Commonwealth
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
i22
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
28/35
Cardiac clinical indicators
Table 5 Changes in process and outcome indicators for in-hospital care for congestive heart failure
Indicator
Baseline (n = 220) Re-measurement period (n = 235)(1/10/0017/4/01) (15/2/0230/8/02)
................................................................................
................................................................................
........................................................
In-hospital courseRecording underlying causes 188/220 (85%) 215/235 (91%)Recording precipitating factors1 160/220 (75%) 211/235 (90%)Limiting Xuids1 89/220 (40%) 128/235 (54%)
Weighing daily1 121/220 (55%) 148/235 (63%)DVT prophylaxis1 31/104 (30%) 94/128 (73%)Dietician review 38/220 (17%) 44/235 (19%)Thyroid function test1 16/31 (52%) 41/52 (79%)Echo cardiograph 135/220 (61%) 164/235 (70%)Clinical pharmacist review1 105/191 (55%) 142/219 (65%)
Discharge statusACE inhibitors 58/71 (82%) 61/71 (86%)ACE inhibitor target dose 82/136 (60%) 108/164 (66%)-blocker1 47/135 (35%) 88/152 (58%)Warfarin 22/50 (44%) 27/63 (41%)Deleterious agents (avoidance of) 180/191 (94%) 214/219 (98%)
Physician clinic follow-up1 87/191 (46%) 130/219 (59%)
OutcomesIn-hospital mortality1 21/212 (9.9%) 11/230 (4.8%)Re-admission (same cause) in 30 days 10/199 (5.0%) 13/224 (5.8%)Median length of hospital stay (days) 7.0 7.0
ACE, angiotensin-converting enzyme; DVT, deep venous thrombosis.1SigniWcant change (P = 0.05).
Table 6 Changes in process indicators for post-hospital care (acute coronary syndromes)
Indicator 3 month follow-up6 month follow-up
..................................................................................................................................................................
Baseline (n = 95) Remeasurement (n = 89) Baseline (n = 93) Remeasurement (n = 104)
................................................................................
................................................................................
........................................................
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
29/35
Anti-platelet agent 81% 90% 83% 87%-blocker 65% 74% 61% 70%ACE inhibitor 59% 57% 61% 63%Lipid-lowering agents 81% 81% 81% 83%Control of serum lipids 50% 44% 60% 68%Smoking cessation 17% 50%1 15% 39%1
ACE, angiotensin-converting enzyme.1SigniWcant change (P = 0.05).
Table 7 Changes in process indicators for post-hospital care (congestive heart failure)
Indicator 3 month follow-up6 month follow-up
................................................................................
.. .............................................................................
.....
Baseline (n = 47) Remeasurement (n = 38) Baseline (n = 45) Remeasurement (n = 54)
................................................................................
................................................................................
........................................................
ACE inhibitor 72% 87% 69% 69%ACE inhibitor dose 55% 66% 63% 70%
-blocker 38% 66%1 38% 48%Control of blood pressure 63% 74% 45% 68%1Weight monitoring 69% 100%1 57% 69%Exercise prescription 40% 58%1 44% 63%1
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
1SigniWcant change (P = 0.05).
i23
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
30/35
A. Hickey et al.Department of Health and Ageing who made this programmepossible through the Clinical Support Systems Program(a joint initiative with the Royal Australasian College ofPhysicians).
References
1. DeLong JF, Allman RM, Sherrill RG, Schliesz N. A congestiveheart failure project with measured improvements in care. EvalHealth Prof 1998; 21: 472486.2. Mehta R, Montoye CK, Gallogly M et al. Improving quality incare of acute myocardial infarction: the Guidelines Applied toPractice (GAP) initiative in south-east Michigan. J Am Med Assoc2002; 287: 12691276.3. Marciniak TA, Ellerbeck EF, Radford MJ et al. Improving qualityof care for medicare patients with acute myocardial infarction:results from the Cooperative Cardiovascular Project. J Am
Med Assoc 1998; 279: 13511357.4. Axtell
SS, Ludgwig E, Lope-Candales P. Interventions toimprove adherence to ACC/AHA recommended adjunctivemedications for the management of patients with an acute myocardialinfarction. Clin Cardiol 2001; 24: 114118.5. Rubin H, Pronovost P, Diette GB. From a process of care to ameasure: the development and testing of a quality indicator. Int JQual Health Care 2001; 13: 489496.6. Braunwald E, Antman E, Beasley J et al. ACC/AHA 2002 guidelineupdate for the management of patients with unstable anginaand non-ST-segment elevation myocardial infarction: summaryarticle. A report of the American College of Cardiology/American
Heart Association Task Force on Practice Guidelines (Committeeon the Management of Patients with Unstable Angina). Circulation2002; 106: 18931900.7. Aroney C, Boyden A, Jelinek M, for the Unstable Angina WorkingGroup. Management of Unstable Angina Guidelines2000.Med J Aust 2000; 173 (suppl.): S65S88.8. National Heart Foundation of Australia and Cardiac Society ofAustralia and New Zealand Chronic Heart Failure Clinical PracticeGuidelines Writing Panel. Guidelines for management of patientswith chronic heart failure in Australia. Med J Aust 2001; 174:459466.9. Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR. The relationbetween systematic reviews and practice guidelines. AnnIntern Med 1997; 127: 210216.10.Quality of Care and Outcomes Research in CVD and StrokeWorking Groups. Measuring and improving quality of care. Areport from the AHA/ACC First ScientiWc Forum on Assessmentof Healthcare Quality in Cardiovascular Disease andStroke. Circulation 2000; 101: 14831493.11. Krumholz HM, Baker DW, Ashton CM et al. Evaluating qualityof care for patients with heart failure. Circulation 2000; 101:e122 http://circ.ahajournals.org/cgi/content/full/101/12/e122Accessed 3 March 2003.12. Mant J. Process versus outcome indicators in the assessment
of quality of health care. Int J Qual Health Care 2001; 13:475480.13. Hofer TP, Bernstein SJ, Hayward RA, DeMoner S. Validating
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
31/35
quality indicators for hospital care. Jt Comm J Qual Improv 1997;23: 455467.14.Brook RH, McGlynn EA, Cleary PD. Measuring quality of care.N Engl J Med 1996; 335: 960970.15.Huff ED. Comprehensive reliability assessment and comparison
of quality indicators and their components. J Clin Epidemiol1997; 50: 13951404.16.Fitzgerald ME, Molinari GF, Bausell RB. The empoweringpotential of quality improvement data. Eval Health Prof 1998; 21:419428.17. Mani O, Mehta RH, Tsai T et al. Assessing performance reportsto individual providers in the care of acute coronary syndromes.Jt Comm J Qual Improv 2002; 28: 220232.18. RainwaterJA, Romano PS, Antonius DM. The CaliforniaHospital Outcomes Project: how useful is Californias report card
for quality improvement? Jt Comm J Qual Improv 1998; 24: 3139.19.
Goddard M, Davies HT, Dawson D, Mannion R, McInnes F.Clinical performance measurement: part 2avoiding the pitfalls.J R Soc Med 2002; 95: 549551.20. Jeacocke D, Heller R, Smith J, Anthony D, Williams JS, DugdaleA. Combining quantitative and qualitative research to engagestakeholders in developing indicators in general practice. AustHealth Rev 2002; 25: 1218.21.Thomson OBrien MA, Oxman AD, Davis DA et al. Audit andfeedback: effects on professional practice and health care outcomes(Cochrane Review). In: The Cochrane Library, Issue 4.
Oxford: Update Software, 2002.22.Berwick DM, James B, Coye MJ. Connection between qualitymeasurement and improvement. Med Care 2003; 41: I-30I-38.23. Lurie JD, Merrens EJ, Lee J, Splaine ME. An approach to hospitalquality improvement. Med Clin North Am 2002; 86: 825845.24.Solberg LI, Mosser G, McDonald S. The three faces of performancemeasurement: improvement, accountability, and research.Jt Comm J Qual Improv 1997; 23: 135147.25.Hannan EL. Measuring hospital outcomes: dont make perfectthe enemy of good! J Health Serv Res Policy 1998; 3: 6769.26.Ohm B, Brown J. Quality improvement pitfalls: how to overcomethem. J Healthc Qual 1997; 19: 1620.27.Zaslavsky AM. Statistical issues in reporting quality data: smallsamples and casemix variation. Int J Qual Health Care 2001; 13:481488.28.Maleyeff J, Kaminsky FC, Jubinville A, Fenn CA. A guide tousing performance measurement systems for continuousimprovement. J Healthc Qual 2001; 23: 3337.29. Gibberd R. Pathmeswaran A, Burtenshaw K. Using clinical indicators
to identify areas for quality improvement. J Qual Clin Practice2000; 20: 136144.30.
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
32/35
Scott IA, Denaro CP, Flores JL, Bennett C, Hickey A, MudgeAP. Quality of care of patients hospitalised with acute coronarysyndromes. Intern Med J 2002; 32: 502511.31.Scott IA, Denaro CP, Bennett C et al. Quality of care of patientshospitalised with congestive heart failure. Intern Med J 2003; 33:140151.
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
i24
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
33/35
Cardiac clinical indicators
32.Queensland Health Collaborative for Healthcare ImprovementCardiac Collaborative, Brisbane, Australia. http://www.qheps.health.qld.gov.au/chi/home.htm Accessed 11 December 2002.
33.Thoma G. Automating the production of bibliographic recordsfor medline. An R&D report of the Communications EngineeringBranch Lister Hill National Center for Biomedical Communications,National Library of Medicine. Bethesda, MD:National Library of Medicine. http://archive.nlm.nih.gov/pubs/thoma/mars2001.php Accessed September 2001.34.Cardiac Society of Australia and New Zealand/National HeartFoundation of Australia Acute Coronary Syndrome WorkingGroup, Sydney, Australia. http://www.csanz.edu.au Accessed11 December 2002.
35. National Institute of Clinical Studies Heart Failure Data ExpertGroup, Melbourne, Australia. http://www.nicsl.com.au Accessed11 March 2003.Accepted for publication 21 November 2003
i25
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
34/35
Downloaded from intqhc.oxfordjournals.org by guest on October 8, 2011
8/3/2019 Int J Qual Health Care 2004 Hickey i11 25
35/35