The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Work in progress on the Australian and NewZealand Intensive Care (ANZICS) Database
Patty Solomon1 John L. Moran2
1School of Mathematical SciencesThe University of Adelaide
2Department of Intensive Care MedicineThe Queen Elizabeth Hospital
Adelaide, South Australia
MRC Biostatistics Unit, Cambridge12 November 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Dr John L. Moran
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
An outline of my talk today
1 The ANZICS adult patient database (APD)
2 ANZICS mortality and LOS outcomes 1993–2003
3 Quantitative indices reflecting provider ‘process-of-care’
4 Concluding comments
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Overview
The ANZICS Adult Patient Database is the largest (bi-national)intensive care database in the world.
Currently contains > 700, 000 intensive care submissions collectedfrom 138 intensive care units (ICUs) in Australia and New Zealandsince 1987.
Evolved from humble beginnings in recognition of the integralimportance of high-quality databases to the practice,management, research and audit of clinical services.1
Major advantage of a national database: ability to capture largeamounts of data across a broad spectrum of diagnoses andinterventions → especially important in critical care medicine.
Intensive care is expensive: consumes an estimated AUS$500m toAUS$1b per annum.
1Black, Lancet 1999
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
A nice position paper describing the ANZICS APD
Development and implementation of a high-quality clinicaldatabase: the Australian and New Zealand Intensive CareSociety Adult Patient Database
Peter J. Stowa, Graeme K. Hartb,c, Tracey Higlettc,*, Carol Georgea,Robert Herkesd, David McWilliamd, Rinaldo Bellomoe
for the ANZICS Database Management Committee
aANZICS Adult Patient Database (APD), Melbourne, Victoria 3053, AustraliabANZICS Database Management Committee, Melbourne, Victoria 3053, AustraliacANZICS Research Centre for Critical Care Resources (ARCCCR), Melbourne, Victoria 3053, AustraliadIntensive Care Unit, Royal Prince Alfred Hospital, Sydney, NSW 2050, AustraliaeIntensive Care Research, Austin Hospital, Melbourne, Victoria 3084, Australia
AbstractObjective: To describe the development of a binational intensive care database.Setting: One hundred thirty-eight intensive care units (ICUs) in Australia and New Zealand.Methods: A structure was developed to enable ICUs to submit data for central and local analysis.
Reports were developed to allow comparison with similar ICU types and against publishedmortality prediction models. The database was evaluated according to (a) the criteria of the Directoryof Clinical Databases (DoCDat) and (b) a proposed framework for data quality assurance in me-dical registries.
Results: Between January 1987 and December 2003, 444147 data sets were collected from 121(72.5%) of 167 Australian and 10 (37.0%) of 27 New Zealand ICUs. Data sets from more than 60000ICU admissions were submitted in 2003. Overall hospital mortality was 14.5%. The mean quality
level achieved according to DoCDat criteria was high as was performance against a proposedframework for data quality. The provision of no-cost software has been vitally important to the successof the database.
Conclusion: A high-quality ICU database has successfully been implemented in Australia and NewZealand and is now used as a routine quality assurance and peer review tool. Similar developmentsmay be both possible and desirable in other countries.D 2006 Elsevier Inc. All rights reserved.
0883-9441/$ – see front matter D 2006 Elsevier Inc. All rights reserved.
doi:10.1016/j.jcrc.2005.11.010
* Corresponding author. ANZICS Research Centre for Critical Care Resources, Level 3, 10 Ievers Terrace, Carlton, Victoria 3053, Australia.
Keywords:Intensive Care;Critical Care;Admission;
Epidemiology;Mortality;Severity of Illness;
Australia;New Zealand
Journal of Critical Care (2006) 21, 133–141
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Stow et al:
origins of ANZICS APD up to December 2003444, 147 case records
collect raw physiology data
121/167 Australian and 10/27 New Zealand ICUs
data submissions from contributing ICUs are voluntary.
Database evaluated according to criteria of the Directory ofClinical Audit Databases (DoCDAT) and the Arts et al framework.2
Overall: ANZICS APD is a high-quality database representative ofthe Australian population; it does have some weaknesses:
completeness of recruitment < 80%some queries about reliability of coding (lack of intra-raterand inter-rater reliability testing).
2J Am Med Inform Assoc 2002
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Hospital level and locality
In Australia and New Zealand, critical care services may beprovided in
tertiary, metropolitan, rural or private hospitals;
distances between centres are often large, and there may begeographical or other barriers to the transfer of patientsbetween different levels of care.
Private and public funding models may result in differences inclinical practice.
In Australia, 50% of hospital care is private.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Hospital level and locality
In Australia and New Zealand, critical care services may beprovided in
tertiary, metropolitan, rural or private hospitals;
distances between centres are often large, and there may begeographical or other barriers to the transfer of patientsbetween different levels of care.
Private and public funding models may result in differences inclinical practice.
In Australia, 50% of hospital care is private.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Hospital level and locality
In Australia and New Zealand, critical care services may beprovided in
tertiary, metropolitan, rural or private hospitals;
distances between centres are often large, and there may begeographical or other barriers to the transfer of patientsbetween different levels of care.
Private and public funding models may result in differences inclinical practice.
In Australia, 50% of hospital care is private.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Hospital level and locality
In Australia and New Zealand, critical care services may beprovided in
tertiary, metropolitan, rural or private hospitals;
distances between centres are often large, and there may begeographical or other barriers to the transfer of patientsbetween different levels of care.
Private and public funding models may result in differences inclinical practice.
In Australia, 50% of hospital care is private.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Hospital level and locality
In Australia and New Zealand, critical care services may beprovided in
tertiary, metropolitan, rural or private hospitals;
distances between centres are often large, and there may begeographical or other barriers to the transfer of patientsbetween different levels of care.
Private and public funding models may result in differences inclinical practice.
In Australia, 50% of hospital care is private.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
National Oceans Office, Australian Bureau of Statistics
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Mortality and association with mechanical ventilationMoran et al, Critical Care Medicine 35 2007
3.34, p ! .0001), suggested a worseoutcome for emergency surgery, thiswas modified by interactions with ICUprimary organ system dysfunction, inthis case, gastrointestinal and yearlyadmission number. Generalized time-decreases in mortality occurred forthese patient-surgical and diagnosticcategories, as seen in Figures 4 and 5.There was an impact of yearly admis-sion number. Admission of "711 pa-tients per year was associated with afavorable OR of 0.84(95% CI 0.76 –0.92). No temporal trend or interactionwith mechanical ventilation orAPACHE III score was evident (p ! .13,p ! .96, and p ! .71, respectively).The OR of rural and metropolitan ICUswas advantageous compared with ter-tiary ICUs (Appendix 3, Fig. 6). Thesemain effects were modified by statisti-cally significant interactions withAPACHE III score and with both theeffect of admitting "711 patients peryear and calendar year, although theclinical importance, in terms of the ORestimate, was variable.An overall adverse effect for ventilatedmales compared with females was evi-dent, the OR for the combination of ven-tilation, gender, and ventilation # gen-der being 1.74 (95% CI 1.57–1.93; p !.0001). There was no evident interaction
with age or with APACHE III score (p !.39 and p ! .26, respectively).
As a sensitivity analysis, the full modelwas re-estimated with omission of the587 site-month-units with $10% miss-ing hospital outcome. Parameter esti-mates were materially unchanged, andthe model was adequately specified (ROCarea ! 0.88; Windmeijer’s goodness-of-fittest ! 0.33, and H-L C ! 24.6, p ! .002).
Random Effects Model
The random effects model demon-strated a significant variance componentcompared with the conventional pooledlogistic regression model, although theintraclass correlation coefficient wasmodest at .019 (95% CI 0.015–0.023, p !.0001). The ROC curve area was 0.89, thisbeing statistically different at (p ! .09)from the final model, and the H-L C was19.4 (p ! .01). Comparing the parameterestimates between the two models (Ap-pendix 1, Table 4, columns 7–10), re-vealed the following:
Little substantive change was found in thepatient-specific variable ORs or p values.The impact of ventilation was main-tained.For ICU site-specific and geographicalvariables, a lessening of statistical sig-
nificance as parameter estimatesmoved toward the null (OR, % 1) wasfound. Of note, the variable yearly siteadmissions "711 retained clinical andstatistical significance.
ICU Length-of-Stay Model
For ICU length of stay modeled as afunction of various covariates, the deter-mination and validation data sets had R2
of .18; final coefficients and predictedlength of stay were therefore producedfrom a full data set (R2 ! .18). Residualswere normally distributed, and there wasno evidence of heteroscedasticity.
Parameter and effect estimates, thelatter as percentage change (41), are seenin Appendix 1, Table 4, columns 11–15.Time-change of overall predicted lengthof stay is seen in Figure 1, bottom left,demonstrating a mild sigmoid convexity.Patient variable effect changes (Appendix1, Table 4, patient variables, % change)were relatively small; however, over theAPACHE III tertiles, substantial changesin length of stay occurred for both ICUsurvivors and those who died, as seen inFigure 2, right. Main-effect changes asso-ciated with ICU admission primary organsystem dysfunction ranged from &27%to 8% compared with cardiovascular or-gan system dysfunction. Large length-of-stay increments were associated with me-chanical ventilation, compared with noventilation, and its specific interactionwith trauma and respiratory organ sys-tem dysfunction. The effect of hospital/ICU level and geographical locality onlength of stay was again variable.
As noted in the display of time-changeof raw ICU length of stay (Fig. 2), a qual-itative interaction was suggested betweenoutcome and ventilation status, stratifiedby APACHE III tertiles. Accordingly,death in ICU and the two appropriateinteractions were incorporated into thefinal model, with no material increase incolinearity (VIF ! 4.3, CN ! 24.2). Allthree parameters were associated withlarge effects, in concordance with the rawmortality effects, with a decrease oflength of stay in non-ICU survivors acrossincrements in APACHE III score.
DISCUSSION
The current study addressed a numberof factors determining mortality outcomeand length of stay: patient and demo-graphic/geographic factors, time trends,and their interactions, although they re-
Figure 3. Adjusted mortality (connected line, point estimate; shaded area, 95% confidence intervals)at hospital discharge (y-axis) plotted against calendar year (x-axis) for overall mortality (left) andventilation status (right). Connected triangle symbol line, point estimate; shaded area, 95% confi-dence intervals.
balt4/zrz-ccm/zrz-ccm/zrz01207/zrz8109-07z xppws S!1 10/17/07 9:33 Art: 186693
6 Crit Care Med 2007 Vol. 35, No. 12
F4-5
F6
n = 223, 129, overall mortality 16.1%, mean LOS 3.6 days. Hospitalmortality decreased 4% over 11 years.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
SMRs for individual ICUs
Considerable uncertainty has been apportioned to estimatesof mortality as reflected in the Standardised Mortality Ratio(SMR).3
Full ‘explanatory’ models are preferable to the limited purviewof ‘algorithmic’ (APACHE, SAPS, MPM) models
Acute Physiology and Chronic Health Evaluation.
3Moran & Solomon Mortality and other event rates: what do they tell us aboutperformance? Crit Care & Resus 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
SMRs for individual ICUs
Considerable uncertainty has been apportioned to estimatesof mortality as reflected in the Standardised Mortality Ratio(SMR).3
Full ‘explanatory’ models are preferable to the limited purviewof ‘algorithmic’ (APACHE, SAPS, MPM) models
Acute Physiology and Chronic Health Evaluation.
3Moran & Solomon Mortality and other event rates: what do they tell us aboutperformance? Crit Care & Resus 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
SMRs for individual ICUs
Considerable uncertainty has been apportioned to estimatesof mortality as reflected in the Standardised Mortality Ratio(SMR).3
Full ‘explanatory’ models are preferable to the limited purviewof ‘algorithmic’ (APACHE, SAPS, MPM) models
Acute Physiology and Chronic Health Evaluation.
3Moran & Solomon Mortality and other event rates: what do they tell us aboutperformance? Crit Care & Resus 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
SMRs for individual ICUs
Considerable uncertainty has been apportioned to estimatesof mortality as reflected in the Standardised Mortality Ratio(SMR).3
Full ‘explanatory’ models are preferable to the limited purviewof ‘algorithmic’ (APACHE, SAPS, MPM) models
Acute Physiology and Chronic Health Evaluation.
3Moran & Solomon Mortality and other event rates: what do they tell us aboutperformance? Crit Care & Resus 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Bootstrapped CIs of ranks (1993 − 1997)
1 98
50
63
53
48
17
56
95
58
55
38
76
80
27
92
40
33
9
51
60
44
2
18
3
64
65
71
62
94
35
88
89
20
96
47
78
52
86
79
39
97
29
31
10
59
42
12
72
6
74
13
66
87
75
19
23
21
24
8
41
46
77
43
1
54
14
26
84
93
11
36
7
4
28
91
68
98
30
5
73
16
83
37
15
69
67
34
45
61
32
22
57
82
90
85
81
25
49
70
95% CIs of ICU SMR ranksS
ites
25 49 73Ranks
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Rank SMR order for FE and RE models 1993 − 2003
!
91
74
80
92
13
46
20
65
44
86
88
63
45
85
98
3
83
48
67
50
93
6
31
22
72
36
40
10
33
41
7
51
37
91
74
80
92
46
20
65
44
86
88
63
45
81
85
98
3
83
48
67
50
31
22
72
36
40
69
10
26
33
41
7
51
37
123456789101112131415161718192021222324252627282930313233
SM
R r
ank
: ra
nd
om
eff
ects
123456789
101112131415161718192021222324252627282930313233
SM
R r
ank
: fi
xed
eff
ects
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 2 2.1 2.2
SMR: 95% CI; green, fixed effects; orange, random effects
Site id: FE, blue; RE, black
Site numbers by descending SMR rank according to fixed or random effects
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Rank SMR order for FE and RE models
!
68
75
2
62
19
76
66
87
89
21
56
60
81
43
70
79
55
64
30
69
17
18
27
1
73
26
61
16
11
4
34
49
12
68
75
62
13
19
76
66
87
21
56
60
43
70
79
55
64
93
6
30
71
17
18
27
1
73
61
16
11
4
47
34
49
12
343536373839404142434445464748495051525354555657585960616263646566
SM
R r
ank
: ra
nd
om
eff
ects
343536373839404142434445464748495051525354555657585960616263646566
SM
R r
ank
: fi
xed
eff
ects
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 2 2.1 2.2
SMR: 95% CI; green, fixed effects; orange, random effects
Site id: FE, blue; RE, black
Site numbers by descending SMR rank according to fixed or random effects
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Rank SMR order for FE and RE models
!
59
84
58
14
96
95
97
99
90
78
57
35
24
82
5
15
54
25
32
52
94
42
23
71
29
38
53
28
8
77
39
9
47
59
84
58
14
96
95
2
97
99
90
78
89
57
35
24
82
5
15
54
25
32
52
94
42
23
29
38
53
28
8
77
39
9
66676869707172737475767778798081828384858687888990919293949596979899
SM
R r
ank
: ra
nd
om
eff
ects
66676869707172737475767778798081828384858687888990919293949596979899
SM
R r
ank
: fi
xed
eff
ects
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 2 2.1 2.2
SMR: 95% CI; green, fixed effects; orange, random effects
Site id: FE, blue; RE, black
Site numbers by descending SMR rank according to fixed or random effects
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The outcomes paradigm
Is now a dominant influence within medicine, and critical care isno exception.4
In the USA
Cleveland Health Quality Choice
initially greeted with some enthusiasm
but upon its demise, described as either martyr or failure.
In the UK
the performance of the paediatric cardiac surgical service atthe Royal Bristol infirmary.
In Australia
ANZICS data-base initiative
the inquiry into the Bundaberg Base Hospital, Queensland.5
4Davies & Crombie 1997; Sibbald et al 2001; Ridley 20025Scott & Ward, MJA 2006
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
APACHE II and ‘provider’ comparisons
APACHE II6 and exploration of risk adjusted mortality in a cohortof 13 ICUs
established the notion of ‘institutional’ or ‘provider’comparisons within critical care, and
introduced SMRs to the critical care literature.
From wherein has ensued a discordant debate regarding therelationship between the SMR and ICU performance or quality:
SMR and its variability is problematic
“mortality is unlikely to be a sufficient statistic for quality"(Spiegelhalter 1999)
scoring systems at best describe ‘elements’ of performance.7
6Knaus, Draper et al Ann Intern Med 19867Linde-Zwirble & Angus 1998; Lilford et al 2004
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process I
Coincident with the Knaus et al paper, Dubois and co-workersreported a study ‘Adjusted hospital death rates: a potential screenfor quality of care’8
looked at quality of care components
at the sampled case-record level
using both structured explicit and implicit review.
Although clinicians’ subjective assessment criteria
identified differences between high and low mortality rateoutliers
*not* confirmed for any condition where explicit structuredprocess criteria were used.
8American Journal of Public Health 1987
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process I
Coincident with the Knaus et al paper, Dubois and co-workersreported a study ‘Adjusted hospital death rates: a potential screenfor quality of care’8
looked at quality of care components
at the sampled case-record level
using both structured explicit and implicit review.
Although clinicians’ subjective assessment criteria
identified differences between high and low mortality rateoutliers
*not* confirmed for any condition where explicit structuredprocess criteria were used.
8American Journal of Public Health 1987
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process I
Coincident with the Knaus et al paper, Dubois and co-workersreported a study ‘Adjusted hospital death rates: a potential screenfor quality of care’8
looked at quality of care components
at the sampled case-record level
using both structured explicit and implicit review.
Although clinicians’ subjective assessment criteria
identified differences between high and low mortality rateoutliers
*not* confirmed for any condition where explicit structuredprocess criteria were used.
8American Journal of Public Health 1987
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process I
Coincident with the Knaus et al paper, Dubois and co-workersreported a study ‘Adjusted hospital death rates: a potential screenfor quality of care’8
looked at quality of care components
at the sampled case-record level
using both structured explicit and implicit review.
Although clinicians’ subjective assessment criteria
identified differences between high and low mortality rateoutliers
*not* confirmed for any condition where explicit structuredprocess criteria were used.
8American Journal of Public Health 1987
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process I
Coincident with the Knaus et al paper, Dubois and co-workersreported a study ‘Adjusted hospital death rates: a potential screenfor quality of care’8
looked at quality of care components
at the sampled case-record level
using both structured explicit and implicit review.
Although clinicians’ subjective assessment criteria
identified differences between high and low mortality rateoutliers
*not* confirmed for any condition where explicit structuredprocess criteria were used.
8American Journal of Public Health 1987
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Process II
Subsequent efforts to locate a relationship between mortality and‘quality of care’ have been grounded in chart review and havebeen largely unsuccessful:
in a surgical environment (Gibbs et al 2001)
in a general medical setting (Best et al 1994, Thomas et al1993, Park et al 1990)
‘Prevalent care processes’
have not established a strong relationship.
Pitches et al on mortality and quality of care: Do hospitals withhigher risk-adjusted mortality rates provide poorer quality care? 9
the “notion that hospitals with higher risk-adjusted mortalityrates have poorer quality care is neither consistent norreliable".
9BMC HSR 2007
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Increase the sensitivity of process measures?
This argument has been advanced because of thelarge sample sizes required to demonstrate small to modestchanges in (mortality) outcome.
However, the felicity with which process may be measured isno guarantee that “measuring . . . process and reportingperformance will improve outcomes".10
There is a also certain circularity in these arguments . . .
reliance on outcome measures is criticised from thestandpoint of process-of-care
which finds its ultimate assessment in terms of its effect onprecisely those outcomes which have been ‘rejected’ in thefirst place.
So what is to be done?
10Allison Med Care 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Our strategy: patient efficiency
There would be advantage in establishing a quantitative indexwhich would subsume the diversity of process-of-care.
Would enable provider ranking and formalised comparison withboth indices of, and ranks based upon, mortality outcomes.
Idea: measure the patient’s ability to maximise ‘output’
in particular, length of stay
for a given set of physiological inputs, e.g, individual patientcomponent variables in APACHE II.
Conceptual foundation: from econometrics
productive efficiency.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency
The objective of producers can be as simple as seeking to avoidwaste
by obtaining maximum outputs from given inputs
or, by minimizing input use in the production of givenoutputs11.
The notion of productive efficiency corresponds to what we calltechnical efficiency.
M.J. Farrell (JRSS A 1957) was the first to measure productiveefficiency empirically using linear programming techniques.
He showed how to decompose cost efficiency into its technicaland allocative components, and
provided an application to US agriculture.
11Kumbhaker & Knox Lovell Stochastic Frontier Analysis CUP 2000
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The influence of Farrell’s work
Data envelope analysis (DEA)
In an innovative study of patients with severe head trauma
Nathanson et al12 used DEA to calculate individual patient‘efficiency’ scores based upon the ability to maximise cerebralperfusion pressure (output)
for a given set of physiological inputs: temperature, MAP,serum osmolality, arterial PaCO2;patients with high efficiency scores had improved functionaloutcomes on ICU discharge.
Of greater significance for us:
Stochastic frontier analysis (SFA).
12Health Care Management Science 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Production frontier models
A stochastic production frontier model:
yi = f (xi;β) exp(vi)T Ei i = 1, . . . , I producers
yi is the scalar output of producer i, xi is a vector of inputs usedby producer i, and β is a vector of ‘technology’ parameters to beestimated;
T Ei = yi
f (xi;β) exp(vi)
yi achieves its maximum feasible value iff T Ei = 1T Ei < 1 measures the shortfall of observed output from themaximum feasible output in an environment characterised byexp(vi), which can vary across producers.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Technical efficiency for ANZICS patients
Stochastic production frontier model (log-linear f ):13
log yi = β0 +k∑
j=1
βj log xij + vi − ui
where T Ei = exp(−ui)
yi is ICU/ hospital length of stay
xijs are acute physiology score and chronic health evaluationvariables
vi ∼ N(0, σ 2v), i = 1, . . . , 215515 (can vary across locality/level)
ui > 0, here assumed exponentially distributedand allowed to be a function of appropriate individualexplanatory variables.Patient efficiency scaled [0, 1].
13StataTM module f rontier
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Patient efficiency for tertiary hospitals by locality
Patients alive at discharge
!
0
1
2
3
4
5
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary NSW
0
2
4
6
8
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary ACT
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary SA
0
2
4
6
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary VIC
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary NZ
0
2
4
6
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary QLD
0
1
2
3
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Tertiary TAS
Kernel density estimate Normal density
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Patient efficiency for private hospitals by locality
!
0
2
4
6
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Private NSW
0
2
4
6
8
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Private SA
0
1
2
3
4
5
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Private VIC
0
2
4
6
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Private QLD
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Private TAS
Kernel density estimate Normal density
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Patient efficiency for rural hospitals by locality
!
0
.5
1
1.5
2
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Rural NT
0
1
2
3
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Rural NSW
0
1
2
3
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Rural VIC
0
1
2
3
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Rural NZ
0
1
2
3
Den
sity
0 .2 .4 .6 .8 1Technical efficiency
Rural QLD
0
.5
1
1.5
2
2.5
Den
sity
0 .2 .4 .6 .8Technical efficiency
Rural TAS
Kernel density estimate Normal density
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Patient efficiency by hospital locality/level/size
!
0.2.4.6.81
Tec
h_ef
fic
Year admit < 711
Locali
tyN
T
levelhospRural
0
.2
.4
.6
.8
1
Tec
h_
effi
c
Year admit < 711
Lo
cal
ity
NS
WL
ocali
tyA
CT
Locali
tyS
A
0
.2
.4
.6
.8
1
Tec
h_
effi
c
Year admit < 711 Year admit > 711
Locali
tyV
IC
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711
Locali
tyN
Z
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711
Locali
tyQ
LD
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711
Locali
tyT
AS
Year admit < 711
levelhospMetropolitan
Year admit < 711 Year admit > 711
Year admit < 711
Year admit < 711
Year admit < 711
Year admit < 711
Year admit < 711 Year admit > 711
Year admit < 711
levelhospTertiary
Year admit < 711 Year admit > 711
Year admit < 711 Year admit > 711
Year admit < 711 Year admit > 711
Year admit < 711 Year admit > 711
Year admit < 711
Year admit < 711 Year admit > 711
Year admit < 711
levelhospPrivate
0
.2
.4
.6
.8
1
Tec
h_
effi
c
Year admit < 711
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711
0
.2
.4
.6
.8
1
Tec
h_
effi
c
Year admit < 711
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711 Year admit > 711
0
.2
.4
.6
.8
1
Tec
h_ef
fic
Year admit < 711
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS 1993–2003 (N=35)!!
!
Rural NT Year admit < 711Rural NSW Year admit < 711Rural VIC Year admit < 711Rural VIC Year admit > 711Rural NZ Year admit < 711
Rural QLD Year admit < 711Rural TAS Year admit < 711
Metropolitan NT Year admit < 711Metropolitan NSW Year admit < 711
Metropolitan NSW Year admit > 711Metropolitan ACT Year admit < 711
Metropolitan SA Year admit > 711Metropolitan VIC Year admit < 711Metropolitan NZ Year admit < 711
Metropolitan QLD Year admit < 711Metropolitan QLD Year admit > 711Metropolitan TAS Year admit < 711
Tertiary NSW Year admit < 711Tertiary NSW Year admit > 711Tertiary ACT Year admit < 711Tertiary ACT Year admit > 711
Tertiary SA Year admit < 711Tertiary SA Year admit > 711
Tertiary VIC Year admit < 711Tertiary VIC Year admit > 711Tertiary NZ Year admit < 711
Tertiary QLD Year admit < 711Tertiary QLD Year admit > 711Tertiary TAS Year admit < 711Private NSW Year admit < 711
Private SA Year admit < 711Private VIC Year admit < 711
Private QLD Year admit < 711Private QLD Year admit > 711Private TAS Year admit < 711
0 .1 .2 .3 .4 .5 .6 .7 .8 .9 1 1.1 1.21.25
Pred.prob (green) T.effic (blue) S.mort ratio (magenta); 95%BCa CI
!
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS 1993–2003: biplot of median TE and SMR!!
!
!
TE
SMR
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
1920
21
22
23
24
25
26
27
28
29
3031
32
33
34
35
-2
-1
0
1
2
3
Dim
ensi
on
2
-2 -1 0 1 2 3Dimension 1
Variables Observations
Biplot
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
TE of SA tertiary hospitals: real correlates withhospital policy
!"#$%&'$())*+*(,+-$./(0,1$(23*/03(24$5(657089*+0:$:6+03*6,$;$-(07:-$0</*22*6,$,=/>(7
!"#$%&'#()*++*,-+'.'/00 !"#$%&'#()*++*,-+'1'/00
234'5",5$#67*8#%'%,8#%*9& :;$#% <"9$,6,%*9#- ="$9*#$& >$*?#9" :;$#% <"9$,6,%*9#- ="$9*#$& >$*?#9"
@,$97"$-'="$$*9,$& !"#$# !"%$&
@"A'B,;97'C#%"+ !"#'( !"#)* !"%'& !"%(+ !"%'*
D;+9$#%*#-'3#6*9#%'="$$*9,$& !"#&' !"%+)
B,;97'D;+9$#%*# !"%!& !"%()
E*89,$*# !"(&$ !"#%* !"%!% !"%(#
@"A'F"#%#-( !"#)* !"%'* !"%'+
G;""-+%#-( !"#++ !"#++ !"#+% !"%'$ !"#)( !"%+$
=#+)#-*# !"(%& !"#*' !"#+&
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Conditional length of stay (CLOS)
Idea: time course of ‘hazard of patient ICU/hospital discharge’reflects the (time course of) process-of-care.
Silber and co-workers 1999 − 200414 defined CLOS as the length ofstay after a stay is prolonged:
the prolongation day estimated by Hollander-Proschanstatistics: ‘new worse than used’.
The longer the patient has been in hospital, the worse theprospects of discharge:
associated with complications and/or co-morbid medicalconditionsmeasure of provider ability to manage complicated cases.
“By studying CLOS, one can determine when the rate ofhospital discharge begins to diminish - without the need todirectly observe complications . . . CLOS aids in the analysis ofa hospital’s management of complicated patients ..."
14Silber, Rosenbaum et al HSR 1999; 2003
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
CLOS of ANZICS APD patients 1993-2003
Unit of analysispatients within providers: for Australia, individualICUs/hospitals by hospital level (rural, metropolitan, tertiary,private) and geographical locality (ı.e., by state)
Survivorswe define LOS of non-survivors as >> maximum LOS of alivedischargesn = 181, 100, no censoringobtain hazard of hospital (or ICU) discharge via kernel densitysmoothing.
Non-survivorsn = 34, 415: LOS of survivors defined >> maximum LOS ofdeaths.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS hazard of discharge by location
!
0
.02
.04
.06
.08
.1
.12
Haz
ard
of
ho
spit
al d
isch
arg
e
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NT NSW ACT SA
VIC NZ QLD TAS
Hazard of alive hospital discharge: covariate adjusted
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS hazard of discharge alive by hospital level
!
0
.02
.04
.06
.08
.1
.12
Haz
ard
of
ho
spit
al d
isch
arg
e
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NT NSW VIC
NZ QLD TAS
Hazard of alive rural hospital discharge
0
.02
.04
.06
.08
.1
.12
Haz
ard
of
ho
spit
al d
isch
arg
e
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NT NSW ACT VIC
NZ QLD TAS
Hazard of alive metropolitan hospital discharge
0
.02
.04
.06
.08
.1
.12
Haza
rd o
f h
osp
ital
dis
char
ge
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NSW ACT SA VIC
NZ QLD TAS
Hazard of alive tertiary hospital discharge
0
.02
.04
.06
.08
.1
.12
Haza
rd o
f h
osp
ital
dis
char
ge
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NSW SA VIC
QLD TAS
Hazard of alive private hospital discharge
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS hazard of death by hospital level
!
0
.005
.01
.015
.02
Haz
ard o
f h
osp
ital
dea
th
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NT NSW VIC
NZ QLD TAS
Hazard of rural hospital death
0
.005
.01
.015
.02
Haz
ard o
f h
osp
ital
dea
th
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NT NSW ACT VIC
NZ QLD TAS
Hazard of metropolitan hospital death
0
.005
.01
.015
.02
Haz
ard o
f hosp
ital
dea
th
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NSW ACT SA VIC
NZ QLD TAS
Hazard of tertiary hospital death
0
.005
.01
.015
.02
Haz
ard o
f hosp
ital
dea
th
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Time to discharge: days
NSW SA VIC
QLD TAS
Hazard of private hospital death
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Pharmacokinetic measures to summarize hazardcurves
Aim: find parametric distribution or similar to fit the smoothedhazard profiles
the associated parameter estimates will serve as indices ofperformance of various descriptor units.
Use simple survival measures:
time to peak hazard, TMAX
area under curve, AUC
peak hazard, CMAX
‘elimination rate’, KE.
Justification: a (random effects) first-order compartment modelprovides a reasonable fit to the data.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Pharmacokinetic measures to summarize hazardcurves
Aim: find parametric distribution or similar to fit the smoothedhazard profiles
the associated parameter estimates will serve as indices ofperformance of various descriptor units.
Use simple survival measures:
time to peak hazard, TMAX
area under curve, AUC
peak hazard, CMAX
‘elimination rate’, KE.
Justification: a (random effects) first-order compartment modelprovides a reasonable fit to the data.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Pharmacokinetic measures to summarize hazardcurves
Aim: find parametric distribution or similar to fit the smoothedhazard profiles
the associated parameter estimates will serve as indices ofperformance of various descriptor units.
Use simple survival measures:
time to peak hazard, TMAX
area under curve, AUC
peak hazard, CMAX
‘elimination rate’, KE.
Justification: a (random effects) first-order compartment modelprovides a reasonable fit to the data.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Pharmacokinetic measures to summarize hazardcurves
Aim: find parametric distribution or similar to fit the smoothedhazard profiles
the associated parameter estimates will serve as indices ofperformance of various descriptor units.
Use simple survival measures:
time to peak hazard, TMAX
area under curve, AUC
peak hazard, CMAX
‘elimination rate’, KE.
Justification: a (random effects) first-order compartment modelprovides a reasonable fit to the data.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Pharmacokinetic measures to summarize hazardcurves
Aim: find parametric distribution or similar to fit the smoothedhazard profiles
the associated parameter estimates will serve as indices ofperformance of various descriptor units.
Use simple survival measures:
time to peak hazard, TMAX
area under curve, AUC
peak hazard, CMAX
‘elimination rate’, KE.
Justification: a (random effects) first-order compartment modelprovides a reasonable fit to the data.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS survivors: SSfol
!"#$%&'()(*+*(,("-'(%&. /012(*+*(#3
0.0
0.02
0.04
0.06
0.08
0.10
0.12
0 5 10 15 20 25 30
16 20
0 5 10 15 20 25 30
14 18
0 5 10 15 20 25 30
11
13 10 17 7
0.0
0.02
0.04
0.06
0.08
0.10
0.128
0.0
0.02
0.04
0.06
0.08
0.10
0.1215 12 4 5 9
2
0 5 10 15 20 25 30
6 19
0 5 10 15 20 25 30
3
0.0
0.02
0.04
0.06
0.08
0.10
0.121
time
hazard
fixed hosplevel.locality
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
ANZICS survivors: mortality, TE and CLOS by hospitallocality/level/size
!"!
!
!
TE
MPSMR
AUCCMAX
TMAX
1
2
34
5
6
7
8
9
10
11
12
13
14
15
16
17
1819
20
21
22
23
2425
26
27
28
29
3031
32
3334
35
-3
-2
-1
0
1
2
3
Dim
ensi
on
2
-3 -2 -1 0 1 2 3Dimension 1
Variables Observations
Biplot
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
TE of deaths for metropolitan hospitals by locality
!
0
2
4
6
Den
sity
.2 .4 .6 .8 1Technical efficiency: died
Metropolitan NT
0
1
2
3
4
5
Den
sity
0 .2 .4 .6 .8Technical efficiency: died
Metropolitan NSW
0
2
4
6
Den
sity
.4 .5 .6 .7 .8Technical efficiency: died
Metropolitan SA
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8Technical efficiency: died
Metropolitan VIC
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8Technical efficiency: died
Metropolitan NZ
0
1
2
3
4
Den
sity
0 .2 .4 .6 .8Technical efficiency: died
Metropolitan QLD
0
1
2
3
Den
sity
0 .2 .4 .6 .8Technical efficiency: died
Metropolitan TAS
Kernel density estimate Normal density
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Survivors and non-survivors: mortality, TE and CLOSby hospital locality/level/size
TETEd
MP SMRAUCCMAX
TMAX
AUCd
CMAXd
TMAXd
1
23
4
5
6
7
8
9
10
12
13
14
15
1617
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
-3-2
-10
12
3
Dim
en
sio
n 2
-3 -2 -1 0 1 2 3
Dimension 1
Variables Observations
BiPlot: survivors & non-survivors
!
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
Now adding KE by hospital locality/level/size
!
TETEd
MP SMR
AUCCMAX
TMAX
KEAUCd
CMAXd
TMAXd
KEd
1
2 356
7
8
9
10
12
13
14
1517
18
19
20
21
22
23
24
25
26
2728
29
30
31
3233
3435
-3-2
-10
12
3D
imen
sion
2
-3 -2 -1 0 1 2 3Dimension 1
Variables Observations
BiPlot: survivors & non-survivors
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.
The ANZICS adult patient database (APD) ANZICS mortality and LOS outcomes 1993–2003 Quantitative indices reflecting provider ‘process-of-care’ Concluding comments
The future?
The ‘third revolution’ in medical care15 dates back to FlorenceNightingale in the mid-19th century in the UK and Ernest Codmanin the early 1900s in the US16.
Disquiet has been generated by the past and current publishing ofmortality outcome data.
The establishment of quantitative indices of patientprocess-of-care may be a valuable complement to mortalityoutcome, both at the administrative and clinical level.
Our focus
critically-ill patients within the ICU
recognise patient groups in cardiac surgery, acute myocardialinfarction, stroke, pneumonia and acute renal failure, wheresimilar outcome endeavours have been established.
15Relman Assessment and Accountability NEJM 198816Spiegelhalter 1999; Iezzoni 1996.