+ All Categories
Home > Documents > Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a...

Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a...

Date post: 27-Nov-2016
Category:
Upload: donna
View: 215 times
Download: 0 times
Share this document with a friend
8
Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population Wayne C. Levy, MD, a Keith D. Aaronson, MD, b Todd F. Dardas, MD, a,b Paula Williams, BS, c Jennifer Haythe, MD, c and Donna Mancini, MD c From the a Division of Cardiology, University of Washington, Seattle, Washington; b Division of Cardiology, University of Michigan, Ann Arbor, Michigan; and c Division of Cardiology, Columbia Presbyterian Medical Center, New York, New York. BACKGROUND: In this study we investigated whether the addition of peak oxygen consumption (VO 2 ) improves the predictive accuracy of the Seattle Heart Failure Model (SHFM). The SHFM is a validated multivariate risk model that uses NYHA classification to assess functional capacity rather than peak oxygen consumption (VO 2 ). METHODS: Outpatients (n 1,240) evaluated for transplant at three centers had their SHFM score calculated and peak VO 2 measured. The outcomes assessed were death/LVAD/urgent transplant with censoring at the time of elective transplant. RESULTS: Over the course of 4.0 (mean) years of observation, there were 571 events. Both the SHFM score ( 2 227) and peak VO 2 ( 2 88, both p 0.0001) were highly predictive of outcomes. The SHFM and peak VO 2 were modestly correlated (r 0.39, p 0.0001). In a multivariate Cox model, peak VO 2 added to the SHFM with a hazard ratio of 0.949 (p 0.0001) for each 1-ml/kg/min increase. Peak VO 2 improved both the net reclassification improvement and integrated discrimination index (both p 0.0002). Peak VO 2 provided additive prognostic information within each SHFM score (p 0.05). The 1-year areas under the receiver-operating characteristic curve were obtained for peak VO 2 (0.645, 95% CI 0.606 to 0.684), SHFM (0.758, 95% CI 0.721 to 0.795) and SHFM with peak VO 2 (0.766, 95% CI 0.731 to 0.802). The SHFM-predicted vs actual survival free of LVAD/UNOS Status 1 transplant at 1 year (86% vs 83%) and 4 years (63% vs 63%) were similar. CONCLUSIONS: The multivariate SHFM is a powerful predictor of death/LVAD/urgent transplant. Peak VO 2 adds prognostic information across the spectrum of the SHFM, but changes in decision regarding transplant listing occur mainly in moderate-risk patients. J Heart Lung Transplant 2012;31:817–24 © 2012 International Society for Heart and Lung Transplantation. All rights reserved. KEYWORDS: heart failure; prognosis; peak oxygen consumption; Seattle Heart Failure Model; transplantation; left ventricular assist device Heart failure carries a risk of death varying from 5% to 75% per year. 1 Peak oxygen consumption (VO 2 ) is a powerful prognostic predictor that is widely used for selection of patients for cardiac transplantation. 2,3 However, the use of heart failure medications such as -blockers has been shown to impact the prognostic significance of peak VO 2 with a much lower risk of death for a given level of peak VO 2 . 4–8 The Seattle Heart Failure Model (SHFM) is a 20-variable model that uses New York Heart Association (NYHA) classification as a surrogate for peak VO 2 . 1 It provides a 1- to 5-year estimate of survival and average life expectancy and has been widely validated. 9 –12 However, the SHFM has not been widely validated in a transplant referral population, as 98% of the events in the derivation and validation data- bases were death. 9,10 This analysis addresses three questions: Is the SHFM useful in predicting outcomes in a transplant referral popu- lation? Does the addition of peak VO 2 add to the prognostic significance of the SHFM? Can the SFHM aid in selection Reprint requests: Wayne C. Levy, MD, Division of Cardiology, Uni- versity of Washington, Box 356422, 1959 NE Pacific Street, Seattle, WA 98195. Telephone: 206-221-4507. Fax: 206-221-6835. E-mail address: [email protected] http://www.jhltonline.org 1053-2498/$ -see front matter © 2012 International Society for Heart and Lung Transplantation. All rights reserved. http://dx.doi.org/10.1016/j.healun.2012.04.006
Transcript
Page 1: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

http://www.jhltonline.org

Prognostic impact of the addition of peak oxygenconsumption to the Seattle Heart Failure Model in atransplant referral population

Wayne C. Levy, MD,a Keith D. Aaronson, MD,b Todd F. Dardas, MD,a,b

Paula Williams, BS,c Jennifer Haythe, MD,c and Donna Mancini, MDc

From the aDivision of Cardiology, University of Washington, Seattle, Washington; bDivision of Cardiology, University of Michigan,

Ann Arbor, Michigan; and cDivision of Cardiology, Columbia Presbyterian Medical Center, New York, New York.

BACKGROUND: In this study we investigated whether the addition of peak oxygen consumption (VO2)improves the predictive accuracy of the Seattle Heart Failure Model (SHFM). The SHFM is a validatedmultivariate risk model that uses NYHA classification to assess functional capacity rather than peakoxygen consumption (VO2).METHODS: Outpatients (n � 1,240) evaluated for transplant at three centers had their SHFM scorecalculated and peak VO2 measured. The outcomes assessed were death/LVAD/urgent transplant withcensoring at the time of elective transplant.RESULTS: Over the course of 4.0 (mean) years of observation, there were 571 events. Both the SHFMscore (�2 � 227) and peak VO2 (�2 � 88, both p � 0.0001) were highly predictive of outcomes. TheSHFM and peak VO2 were modestly correlated (r � 0.39, p � 0.0001). In a multivariate Cox model,peak VO2 added to the SHFM with a hazard ratio of 0.949 (p � 0.0001) for each 1-ml/kg/min increase.Peak VO2 improved both the net reclassification improvement and integrated discrimination index(both p � 0.0002). Peak VO2 provided additive prognostic information within each SHFM score (p �0.05). The 1-year areas under the receiver-operating characteristic curve were obtained for peak VO2

(0.645, 95% CI 0.606 to 0.684), SHFM (0.758, 95% CI 0.721 to 0.795) and SHFM with peak VO2

(0.766, 95% CI 0.731 to 0.802). The SHFM-predicted vs actual survival free of LVAD/UNOS Status1 transplant at 1 year (86% vs 83%) and 4 years (63% vs 63%) were similar.CONCLUSIONS: The multivariate SHFM is a powerful predictor of death/LVAD/urgent transplant.Peak VO2 adds prognostic information across the spectrum of the SHFM, but changes in decisionregarding transplant listing occur mainly in moderate-risk patients.J Heart Lung Transplant 2012;31:817–24© 2012 International Society for Heart and Lung Transplantation. All rights reserved.

KEYWORDS:heart failure;prognosis;peak oxygenconsumption;Seattle Heart FailureModel;transplantation;left ventricular assistdevice

Heart failure carries a risk of death varying from �5% to75% per year.1 Peak oxygen consumption (VO2) is a powerfulprognostic predictor that is widely used for selection of patientsfor cardiac transplantation.2,3 However, the use of heart failuremedications such as �-blockers has been shown to impact theprognostic significance of peak VO2 with a much lower risk ofdeath for a given level of peak VO2.4–8

Reprint requests: Wayne C. Levy, MD, Division of Cardiology, Uni-versity of Washington, Box 356422, 1959 NE Pacific Street, Seattle, WA98195. Telephone: 206-221-4507. Fax: 206-221-6835.

E-mail address: [email protected]

1053-2498/$ -see front matter © 2012 International Society for Heart and Lunghttp://dx.doi.org/10.1016/j.healun.2012.04.006

The Seattle Heart Failure Model (SHFM) is a 20-variablemodel that uses New York Heart Association (NYHA)classification as a surrogate for peak VO2.1 It provides a 1-to 5-year estimate of survival and average life expectancyand has been widely validated.9–12 However, the SHFM hasnot been widely validated in a transplant referral population,as 98% of the events in the derivation and validation data-bases were death.9,10

This analysis addresses three questions: Is the SHFMuseful in predicting outcomes in a transplant referral popu-lation? Does the addition of peak VO2 add to the prognostic

significance of the SHFM? Can the SFHM aid in selection

Transplantation. All rights reserved.

Page 2: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

818 The Journal of Heart and Lung Transplantation, Vol 31, No 8, August 2012

of ambulatory high-risk patients for destination left ventric-ular assist devices (LVADs)?

Methods

A total of 1,240 ambulatory outpatients with heart failure had peakVO2 measured during maximal cardiopulmonary exercise testing per-formed for clinical reasons, most for evaluation for cardiac transplan-tation, and had variables available for calculation of the SHFM score.Patients were evaluated at three different transplant centers: ColumbiaPresbyterian Medical Center (n � 647, era 1990 to 2006); Universityof Michigan (n � 498, era 1993 to 2001); and University of Wash-ington (n � 91, era 1999 to 2001). The SHFM score and estimatedsurvival were calculated as previously described.1 Survival was eval-uated at each institution using chart review, telephone and socialsecurity death index. Research use of the clinically obtained data wasapproved by the review board at each institution.

The primary outcome was survival free from death, LVAD orurgent transplant (United Network for Organ Sharing [UNOS]

Table 1 Baseline Characteristics

Valuesa

Age (years) 53 � 11Gender (% male) 67%NYHA class 2.4Ejection fraction 24 � 11%Ischemic etiology 44%Systolic blood pressure (mm Hg) 107 � 18Heart rate (beats/min) 76 � 16Peak oxygen consumption (ml/kg/min) 14.9 � 5.1Medications/devices

Angiotensin-converting enzyme inhibitor 78%Angiotensin-receptor blocker 15%�-blocker 60%Aldosterone blocker 33%Allopurinol 5%Statin 36%Furosemide equivalent dose (mg/kg/day) 1.5 � 1.7Implantable cardioverter-defibrillator 28%CRT 2%

Laboratory valuesSerum sodium (mEq/liter) 137 � 4Hemoglobin (g/dl) 13.3 � 1.8Percent lymphocytes 24 � 10%Uric acid (mg/dl) 8.3 � 2.6Total cholesterol (mg/dl) 180 � 51

OutcomesDeath 340 (27%)Left ventricular assist device 59 (5%)UNOS Status 1A or 1B transplant 170 (14%)UNOS Status 2 transplant 93 (8%)Alive 578 (47%)

Seattle Heart Failure Model Score 0.84 � 1.06Estimated 1-year SHFM survival 86 � 15%Observed 1-year survival free of

death/LVAD/urgent transplant (mean �SEM)

83 � 1%

CRT, cardiac resynchronization therapy.

aData presented as mean � SE, percent, mean or mean (percent).

Status 1A or 1B). Survival time for patients who were transplantedas UNOS Status 2 was censored on the date of the transplant. First,a Cox proportional hazards model was used to estimate the hazardratio for the primary outcome for SHFM and peak VO2 alone andin combination. The peak VO2 values were stratified for presen-tation purposes using �10 ml/kg/min, 10 to �14 ml/kg/min and�14 ml/kg/min. The SHFM score was rounded to the nearestinteger between 0 and 3. The hazard ratio for peak VO2 was alsocalculated within a given SHFM score.

To determine the predictive power for adding peak VO2 to theSHFM, we used four methods: (1) change in Cox proportional model�2 with the addition of peak VO2 to the SHFM; (2) change in 1-yearreceiver operating characteristic area under the curve (ROC AUC)was obtained; (3) incremental value of the SHFM and peak VO2 inpredicting outcomes was determined using net reclassification im-provement (NRI); and (4) integrated discrimination improvement(IDI) was calculated.13 NRI is the difference in the number of patientsmoving up or down clinical risk groups, stratified according towhether they develop the outcomes during follow-up. Here, clinicallymeaningful risk annual event cut-points of �5%, �5% to 10%, �10to 20%, �20% to 40% and �40% risk were defined. IDI quantifiesthe improvement in predictive models by comparing the averagedifferences in predicted probabilities at 1 year between those whoexperienced the outcome versus those who did not have an event.Because a binary outcome is required for risk reclassification analy-ses, subjects censored before 1 year were excluded from NRI and IDIanalyses (n � 1,075). A nomogram was developed for the annualevent rates over 2 years with peak VO2 alone and in conjunction withthe SHFM stratified by SHFM scores of 0 to 3. Statistical analyseswere performed using STATVIEW (version 5; SAS, Inc., Cary, NC),SPSS (version 16; SPSS, Inc., Chicago, IL) and STATA (version11.2; Statcorp, College Station, TX).

All investigators had full access to the data and take fullresponsibility for the integrity of the findings.

Results

Study population

The population reflected a transplant referral populationwith a preponderance of middle-aged men, low ejection

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9 10

Sur

viva

l

Years

Death

Death/LVAD/UTx

Figure 1 The 10-year event-free survival for the whole cohort,with events defined as either death alone or the combination ofdeath, left ventricular assist device and urgent transplantation.

fraction and high prevalence of standard heart failure med-

Page 3: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

819Levy et al. SHFM and PVO2

ication use (see Table 1). Many of these patients wereevaluated prior to the known benefits of �-blockers, aldo-sterone blockers and device use in heart failure. The 1,240patients were followed for an average of 4.0 (interquartilerange 1.0 to 6.7) years. During this time there were 569outcome events (46% of patients). There were 340 deaths,59 LVAD implantations and 170 urgent transplants. Cen-soring occurred when patients were alive at the end offollow-up (n � 578) and for elective transplants (n � 93).The 1-, 2- and 5-year survival (censoring for LVAD ortransplant) was 91%, 84% and 69%, respectively. The 1-, 2-and 5-year survival free from LVAD/urgent transplant forthis cohort was 83%, 73% and 53%, respectively (Figure 1).

Peak VO2 and freedom from death, LVAD andurgent transplant

Peak oxygen consumption (VO2) was 14.9 � 5.1 ml/kg/min. Peak VO2 was a significant univariate risk marker with

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9 10

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

>14

>10-14

≤10

Logrank Chi sqaure 65, p<0.0001

Peak VO2

>14 - n=61910-14 - n=425≤10 - n=196

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9 10

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

SHFM 0

SHFM 1

SHFM 2

SHFM 3

Logrank Chi sqaure 243, p<0.0001

SHFM 0 - n=485SHFM 1 - n=430SHFM 2 - n=240SFHM 3 - n=85

A

B

Figure 2 Kaplan–Meier estimate of event-free survival fromdeath/LVAD/urgent transplant when: (a) stratified by peak VO2

�10 ml/kg/min, �10 to 14 ml/kg/min and �14 ml/kg/min and thenumber of patients in each peak VO2 group (b) stratified by SHFMscore of 0 to 3. The number of patients in each SHFM group isshown above.

a hazard ratio 0.915 ml/kg/min (95% CI 0.899 to 0.933,

�2 � 88, p � 0.0001) for the principal outcome. The 1-yearsurvival free of LVAD/urgent transplant was 72% for apeak VO2 �10 ml/kg/min, 80% for a peak VO2 10 to 14ml/kg/min and 88% for peak VO2 �14 ml/kg/min. Thecorresponding 5-year survival free from LVAD/urgenttransplant was 39%, 45% and 63%. Kaplan–Meier curvesfor groupings of peak VO2 �10 ml/kg/min, �10 to 14ml/kg/min and �14 ml/kg/min are shown in Figure 2a. The1-year ROC AUC for peak VO2 was 0.645 (95% CI 0.606to 0.684).

SHFM and freedom from death, LVAD and urgenttransplants

The mean SHFM score was 0.84 � 1.06. SHFM-estimated1-year survival was 86 � 15% for all patients. SHFM scorewas a powerful predictor of survival free from LVAD/urgent transplant with a hazard ratio was 1.80 for each unitchange in the score (95% CI 1.66 to 1.94, �2 � 227, p �0.0001). The 1-year survival free of LVAD/urgent trans-plant was 95% for a value of 0% and 49% for a score of 3or a 10-fold increase in risk. Figure 2b shows the Kaplan–

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Sen

sitiv

ity

1-Specificity

Peak VO2

SHFM

SHFM & Peak VO2

A

B

Figure 3 (a) SHFM score plotted vs peak VO2. (b) One-yearROC as follows: peak VO2 (0.645, 95% CI 0.606 to 0.684); SHFM(0.758, 95% CI 0.721 to 0.795); and SHFM with peak VO (0.766,

2

95% CI 0.731 to 0.802).

Page 4: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

2

820 The Journal of Heart and Lung Transplantation, Vol 31, No 8, August 2012

Meier survival curve with rounding values of the SHFMscore to the nearest integer between 0 and 3. The 1-yearROC AUC for SHFM was 0.758 (95% CI 0.721 to 0.795).

Association of peak VO2 and SHFM

The peak VO2 and the SHFM score had a significant inverseassociation (r � 0.39, p � 0.0001; Figure 3a). For SHFMscore 0, the mean peak VO2 was 17.1 � 5.7 ml/kg/min. For

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

>14

>10-14

≤10

Logrank Chi Square 23.4, p<0.0001

SHFM 0 - 96% 1 Yr Survival>14 - n=32410-14 - n=123≤10 - n=38

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

>14

>10-14

≤10

Logrank Chi Square 0.3, p=0.

SHHFM 2 - 76% 1 Yr Survival

>14 - n=7610-14 - n=108≤10 - n=56

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

SHFS 0

SHFS 1

SHFS 2

SHFS 3

ChiSquare 49, p<0.0001

Peak VO2 ≤10 ml/kg/min

SHFM 0 - 38SHFM 1 - 75SHFM 2 - 56SHFM 3 - 27

A

E

C

Figure 4 (A-D) The additional prognostic information adding peml/kg/min is shown for SHFM scores of 0, 1, 2 and 3, respectiveclinical impact of peak VO2 was in lower risk patients (i.e., SHFrisk, even if peak VO2 was �14 ml/kg/min. (E) Patients with peashown in.

each unit increase in SHFM score, the peak VO2 decreased

by �2 ml/kg/min. The average peak VO2 for an SHFMscore of 3 was 12.4 � 3.9 ml/kg/min.

Joint effect of SHFM and peak VO2 on outcomes

The addition of peak VO2 to the SHFM increased the Coxmodel �2 from 227 to 242 (p � 0.0001; Figure 4a–d).Addition of peak VO2 to the SHFM increased the 1-yearROC AUC from 0.758 (95% CI 0.721 to 0.795) to 0.766

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9 10Years

>14

>10-14

≤10

Logrank Chi Square 8.1, p=0.017

SHFM 1 - 90% 1 Yr Survival

>14 - n=19010-14 - n=165≤10 - n=75

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 1 2 3 4 5 6 7 8 9 10

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

Years

>14

>10-14

≤10

Logrank Chi Square 3.2,p=0.20

SHFM 3 - 44% 1 Yr Survival>14 - n=2910-14 - n=29≤10 - n=27

2 by categories of �10 ml/kg/min, �10 to 14 ml/kg/min and �14g with SHFM-estimated mortality for SHFM score. The greatestes 0 and 1). The patients with SHFM scores of 2 or 3 were highof �10 ml/kg/min can be further risk stratified by the SHFM as

10

Sur

viva

l Fre

e of

LV

AD

/Urg

ent T

rans

plan

t

10

87

10

D

B

ak VOly, alonM scork VO

(95% CI 0.731 to 0.802; Figure 3b), although the change in

Page 5: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

821Levy et al. SHFM and PVO2

the AUC was not significant (p � 0.16). The hazard ratio forpeak VO2 when added to the SHFM was 0.949 ml/kg/minand similar within all SHFM scores (Table 2). The interac-tion between SHFM score and peak VO2 was non-signifi-cant, suggesting that peak VO2 had similar prognostic sig-nificance across the range of SHFM scores. A nomogramfor a peak VO2 of 5 to 25 ml/kg/min alone and in combi-nation with the SHFM is shown in Figure 5.

Given the relative insensitivity in detecting clinicallysignificant risk differences using AUC methods, we alsoinvestigated reclassification using NRI and IDI. We as-sessed whether adding peak VO2 to the SHFM score im-proved classification of patients with and without an event(Table 4). We used clinically meaningful annual event cut-points of �5%, �5% to 10%, �10% to 20%, �20% to 40%and �40% risk. After classifying patients into risk groupsusing the SHFM, the addition of peak VO2 reclassified13.6% of patients into more appropriate risk groups (p �

Table 3

SHFM with peak VO2

�5% �10% �20% �40% �40% Total

Subjects who experience death, LVAD, or urgent transplant�5% 26 9 0 0 0 35�10% 7 118 35 0 0 160�20% 0 20 204 23 0 247�40% 0 0 14 91 7 112�40% 0 0 0 3 12 15Total 33 147 253 117 19 569Subjects who do not experience death, LVAD, or urgent

transplant�5% 80 10 0 0 0 90�10% 57 162 31 0 0 250�20% 0 29 111 10 0 150�40% 0 0 7 9 0 16�40% 0 0 0 0 0 0Total 137 201 149 19 0 506

NRI: 0.136 (95% CI 0.077 to 0.195), p � 0.0001; NRI (events):0.053 (95% CI 0.154 to 0.090), p � 0.006; NRI (non-events):�0.083 (95% CI �0.130, �0.037), p � 0.0005. IDI: 0.59%, (95% CI0.0028, 0.0090), p � 0.0002; IDI (events): 0.33% (95% CI 0.0009 to0.0056), p � 0.006; IDI (non-events): �0.26% (95% CI �0.0046 to�0.0007), p � 0.009.

Table 2 Effect in a Cox Proportional Hazards Model of Adding2 or 3

Hazard ratio

SHFM 1.80 (1.66–1.94)Add peak VO2 0.949 (0.931–0.967)

Round SHFM score Mean peak VO2

0 (n � 485) 17.11 (n � 430) 14.02 or 3 (n � 325) 12.7

0.0001). The IDI, or difference in the average predictedprobabilities between the two models (SHFM alone vsSHFM and peak VO2) in differentiating patient risk, wasalso significant at 0.59% (p � 0.0002). The change in theCox proportional model �2, NRI and IDI all suggest asignificant, yet modest, improvement in risk classificationwith the addition of peak VO2 to the SHFM.

VO2 to SHFM Overall and Stratified by SHFM Scores of 0, 1 and

�2 p-value

227 �0.0001242 �0.0001

Hazard ratio (95% CI) p-value

0.928 (0.896–0.962) �0.00010.946 (0.916–0.977) 0.00080.964 (0.934–0.994) 0.02

0%

5%

10%

15%

20%

25%

30%

5 10 15 20 25

Ann

ual R

ate

of D

eath

/LV

AD

/Urg

ent T

rans

plan

t

Peak VO2 (ml/kg/min)

Hazard Ratio Peak VO2 (ml/kg/min) 0.915Chi square 88, p<0.0001

0%

10%

20%

30%

40%

50%

60%

5 10 15 20 25

Ann

ual R

ate

of D

eath

/LV

AD

/Urg

ent T

rans

plan

t

Peak VO2 (ml/kg/min)

SHFM 0

SHFM 1

SHFM2

SHFM 3

Hazard Ratio Peak VO20.949, p<0.0001

A

B

Figure 5 A nomogram derived from the Cox model for theannual rate of death/LVAD/urgent transplant over 2 years by peakVO2 (a) as a continuous variable with the observed annual eventrate by peak VO2 quartiles (dots) and (b) in combination with theSHFM score along with observed event rates by the SHFM scoreand peak VO categories of �10 ml/kg/min, �10 to 14 ml/kg/min

Peak

2

and �14 ml/kg/min (dots).

Page 6: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

822 The Journal of Heart and Lung Transplantation, Vol 31, No 8, August 2012

Calibration of SHFM and peak VO2

The observed survival free of LVAD/urgent transplant wasslightly lower than predicted at 1 year (83% vs 86%), butwas the same at 4 years (63% vs 63%; Figure 6). Although�-blocker and angiotensin-receptor blocker (ARB) use washigher in patients evaluated in the 2000s vs 1990s (75% vs49% and 18% vs 12%, both p � 0.005), the era of patientevaluation was not predictive of outcomes when adjustedfor the SHFM (1990s vs 2000s, p � 0.32), likely becausethe SHFM includes current heart failure medications anddevices.

The calibration of the SHFM was evaluated by compar-ing the predicted vs the observed 1- and 4-year event ratesfor SHFM score values of 0 to 3. Most observed values werewithin �5% of the estimated rate. Table 4 shows the ob-served 1-year Kaplan–Meier survival free of LVAD/urgenttransplant by peak VO2 groups and SHFM score. Patientswith an SHFM score of 0 were at relatively low risk even ifthe peak VO2 was �10 ml/kg/min (Table 4). Patients withan SHFM score of 2 or 3 are high risk, even if peak VO2 isrelatively preserved (i.e., �14 ml/kg/min). The addition ofpeak VO2 would most effectively aid in risk stratificationfor LVAD/transplant in patients with an intermediate riskwith a SHFM score of 1 (�90% estimated survival). Within

Table 4 Observed Kaplan–Meier 1-Year Survival Free of LVAD/Score and Peak VO2 (ml/kg/min)

Overall

SHF95(n

Peak VO2 �14 ml/kg/min 88 � 1% 96(n � 619) (n

Peak VO2 �10–14 ml/kg/min 80 � 2% 95(n � 425) (n

Peak VO2 �10 ml/kg/min 72 � 3% 94(n � 196) (n

Survival data expressed as mean � SE.

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

SH

FM

Pre

dict

ed S

urvi

val

Observed Survival free of LVAD/Urgent Transplant

1 Year

4 Years

Predicted Observed1 Yr 86% 83%4 Yr 63% 63%

Figure 6 The predicted vs observed survival free of LVAD/urgent transplant for SHFM scores of 0 to 3 at 1 and 4 years. Theactual event rate at 1 year was �3% higher than that predicted by

the model, although there was no difference at 4 years.

this group of patients, patients with peak VO2 �10 ml/kg/min, 10 to 14 ml/kg/min and �14 ml/kg/min had an ob-served 1-year survival free of LVAD/urgent transplant of75%, 80% and 90%, respectively.

As all patients were ambulatory outpatients, they wouldhave been listed as UNOS Status 2, although many even-tually progressed to UNOS Status 1 at the time of transplant.Using the SHFM, the 1-year SHFM-estimated survival ofpatients who ultimately proceeded to death/LVAD/urgenttransplant was 80 � 18% vs 92 � 8% (p � 0.0001) forthose alive at the end of follow-up. The average time to anevent was 2.7 years. The 1-year SHFM survival estimateswere similar for patients who died (82 � 17%) or receivedan LVAD (80 � 20%) or an urgent transplant (77 � 19%).The patients who received an UNOS Status 2 transplantwere lower risk at baseline (87 � 9%), but higher risk thanthose who remained alive at the end of follow-up (92 � 8%,p � 0.0001 for both comparisons). The type of event overa 4-year period varied accorording to the baseline SHFMscore. For the low-risk group (SHFM score 0), the majorityof events were death, with equal numbers of UNOS Status1 and 2 transplants. In the highest risk group (SHFM score3), death and urgent transplant were predominant, followedby LVADs and rare elective transplants. Intermediate scoreshad roughly equal numbers of urgent transplants, LVADsand deaths (Figure 7).

Discussion

In this analysis of a transplant referral population, both peakVO2 and the SHFM were strong and complementary pre-dictors of survival free from LVAD/urgent transplant, asconfirmed by reclassification using the NRI and the IDI.However, as demonstrated previously in a comparison ofpeak VO2 with another predictive model (i.e., the HeartFailure Survival Score [HFSS]), the use of a predictivemodel such as the SHFM provides better discrimination ofhigh-risk candidates than a single variable. One recent anal-ysis failed to show that peak VO2 added to a model with theindividual components of the SHFM and HFSS, althoughthe HFSS score did add prognostic value to the SHFM.14

Transplant and Number of Patients for Categories of SHFM

)

SHFM 184 � 2%(n � 430)

SHFM 270 � 3%(n � 240)

SHFM 349 � 5%(n � 85)

90 � 2% 67 � 5% 48 � 9%) (n � 190) (n � 76) (n � 29)

80 � 3% 72 � 4% 55 � 9%) (n � 165) (n � 108) (n � 29)

75 � 5% 70 � 6% 44 � 10%(n � 75) (n � 56) (n � 27)

Urgent

M 0� 1%� 485

� 1%� 324� 2%� 123� 4%� 38)

Utilization of the SHFM may facilitate earlier identification

Page 7: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

823Levy et al. SHFM and PVO2

of patients at increased risk and appropriate referral foradvanced heart failure therapy including LVADs and trans-plant. It is also possible that a model like the SHFM couldmore effectively allocate transplants in an ambulatoryUNOS Status 2 population by allowing high-risk ambula-tory patients to have a higher priority for an available organ.

The SHFM was derived and validated in populations inwhich 98% of the events were death. Thus, in reality, theSHFM estimate is the risk of death rather than the combineddeath/LVAD/urgent transplant rate. As the number of pa-tients who receive an LVAD or urgent transplant increases,the combined event rate will increase in a given population.As described in other samples, the combined LVAD/urgenttransplant event rate in transplant-eligible patients is �15%to 20% higher than the death rate (i.e., a 10% mortalitywould have a �12% combined event rate).9,10

The decision to list ambulatory patients for cardiac trans-plantation remains a difficult clinical decision. With ad-vances in medical therapy, survival for ambulatory patientswith heart failure, LVADs, and post transplant all continueto improve. This requires continual reassessment of thecriteria needed to advance to the next stage of therapy. Thecurrent 1- and 5-year survival of UNOS Status 2 transplantrecipients is 92% and 76%, respectively.15

Most patients listed as UNOS Status 2 candidates prog-ress to a UNOS Status 1/LVAD listing prior to transplant,given the scarcity of donor organs. This is reflected in thefinding that only 29% of patients were listed as UNOSStatus 2 at the time of transplant. Patients who underwentUNOS Status 2 transplant had a 1-year SHFM survivalestimate of 87% and 5-year survival of 54%. Because allUNOS Status 2 patients are treated equally, being priori-tized only by the waiting time, it is unlikely that high-riskambulatory outpatients (SHFM score 2 or 3) will survive toreceive an elective transplant without progression to UNOSStatus 1 or LVAD (Figure 7).

As LVADs become more common in ambulatory non–inotrope-dependent Stage D heart failure patients, it be-comes very important to use risk stratification models like

0%

5%

10%

15%

20%

25%

30%

35%

40%

0%

5%

10%

15%

20%

25%

30%

35%

40%A

nnua

l Eve

nt R

ate

over

4 y

ears

Death

LVAD

Urgent Transplant

Elective Transplant

SHFM 0 SHFM 1 SHFM 2 SHFM 3

Each EventLogrank p<0.0001

Figure 7 Annual event rate over 4 years for a baseline SHFMscore rounded to the nearest integer of 0 to 3.

the SHFM to assist in appropriate patient selection. The

National Heart, Lung, and Blood Institute (NHLBI)-spon-sored REVIVE-IT study for early vs usual timing forLVADs in ambulatory NYHA Status 3 or 4 patients willrequire a SHFM-estimated 1-year mortality �16.5% fortrial entry.16 In patients with a peak VO2 of �10 ml/kg/min,the SHFM identified a wide range of observed survival freeof LVAD and urgent transplant with an observed survival at1 year varying from 94% to 44% and at 5 years from 70%to 7% for SHFM scores of 0 and 3 (Figure 4e). The 5-yearobserved survival in patients with a peak VO2 of �10ml/kg/min for the SHFM 0 group (�70%) was similar to the5-year survival for a UNOS Status 2 transplant (�76%),suggesting that, considering mortality alone, aggressiveend-stage therapies like transplant and LVAD may be safelydeferred in patients with a low-risk SFHM score, regardlessof their peak VO2.15 We acknowledge, however, that thisanalysis does not address the important quality of life con-siderations that may appropriately influence treatment deci-sions in patients with severely reduced exercise capacity.

Given that the 1-year survival with LVAD as a bridge toa transplant (�68% to �91%)15,17 exceeds the 1-year sur-vival with medical therapy in the SHFM score 3 strata(�50%), it would seem reasonable to proceed to a LVAD asa bridge to transplantation or destination therapy in thisambulatory outpatient population unless a transplant can beobtained quickly. There are strengths and limitations to thisanalysis. The strengths include the utilization of three dif-ferent centers that routinely measure peak VO2 with long-term follow-up. The SHFM was not used for risk stratifi-cation during the observation period. It is uncertain hownewer therapies that were not as widely utilized in the 1990smight influence these results (�-blockers, aldosteroneblockers, implantable cardioverter-defibrillators [ICDs] andbiventricular pacing). A recent analysis using a variant ofthe SHFM applied prospectively to the Sudden CardiacDeath Heart Failure Trial suggested that high-risk ambula-tory patients with an annual mortality of �25% had nomortality benefit from use of an ICD for primary preven-tion.11 We did not measure exercise ventilatory efficiency,which has been shown to be a powerful predictor.18 It isquite likely that the addition of B-type natriuretic peptide(BNP) level would have modestly improved prediction.1,12

It is very possible that patients with a preserved peak VO2

(�14 ml/kg/min) and SHFM estimated 1-year mortality of�25% may be better served with optimization of heartfailure medications and devices, such as an ICD with/with-out a biventricular pacemaker, to prevent sudden death, andto defer transplant until peak VO2 is decreased. We do nothave information on modes of death or when patients werelisted for transplant.

It is also very possible that variables within the SHFMwould have different hazard ratios if peak VO2 were in-cluded with derivation of the model. To accurately estimatethe alteration in hazard ratios, it is likely that the data setwould need to be substantially larger than the current co-horts to ensure that the newly derived � coefficients would

remain similar in a validation cohort.
Page 8: Prognostic impact of the addition of peak oxygen consumption to the Seattle Heart Failure Model in a transplant referral population

824 The Journal of Heart and Lung Transplantation, Vol 31, No 8, August 2012

In conclusion, the Seattle Heart Failure Model is awidely validated model that worked very well in risk-strat-ifying patients referred for consideration of transplant in thisvalidation cohort. The SHFM may facilitate appropriate useof guideline-based heart failure therapy and appropriatereferral of patients for advanced heart failure therapy, suchas destination LVADs and cardiac transplantation. The ad-dition of peak VO2 improved the risk stratification, espe-cially for those patients at moderate risk (i.e., �10% annualmortality). The model may also have utility in the allocationof hearts for transplantation, especially with regard to am-bulatory outpatients. Table 3.

Disclosure statementThe authors have no conflicts of interest to disclose. The Univer-sity of Washington Center for Commercialization holds the copy-right to the Seattle Heart Failure Model. W.C.L. has receivedresearch funding for the SHFM from HeartWare, General Electric,CardioMems and Thoratec and licensing revenue from Epocrates.D.M. is a consultant to the Celladon Corporation. T.F.D. receivededucational support from Thoratec. K.D.A. and W.C.L. receivedfunding from the NHLBI for REVIVE-IT.

References

1. Levy WC, Mozaffarian D, Linker DT, et al. The Seattle Heart FailureModel: prediction of survival in heart failure. Circulation 2006;113:1424-33.

2. Mancini DM, Eisen H, Kussmaul W, et al. Value of peak exerciseoxygen consumption for optimal timing of cardiac transplantation inambulatory patients with heart failure. Circulation 1991;83:778-86.

3. Aaronson KD, Schwartz JS, Chen TM, et al. Development and prospec-tive validation of a clinical index to predict survival in ambulatory patientsreferred for cardiac transplant evaluation. Circulation 1997;95:2660-7.

4. Lund LH, Aaronson KD, Mancini DM. Predicting survival in ambu-latory patients with severe heart failure on beta-blocker therapy. Am J

Cardiol 2003;92:1350-4.

5. Lund LH, Aaronson KD, Mancini DM. Validation of peak exerciseoxygen consumption and the Heart Failure Survival Score for serial riskstratification in advanced heart failure. Am J Cardiol 2005;95:734-41.

6. Peterson LR, Schechtman KB, Ewald GA, et al. The effect of beta-adrenergic blockers on the prognostic value of peak exercise oxygenuptake in patients with heart failure. J Heart Lung Transplant 2003;22:70-7.

7. Zugck C, Haunstetter A, Kruger C, et al. Impact of beta-blockertreatment on the prognostic value of currently used risk predictorsin congestive heart failure. J Am Coll Cardiol 2002;39:1615-22.

8. O’Neill JO, Young JB, Pothier CE, et al. Peak oxygen consumption asa predictor of death in patients with heart failure receiving beta-blockers. Circulation 2005;111:2313-8.

9. Allen LA, Yager JE, Funk MJ, et al. Discordance between patient-predicted and model-predicted life expectancy among ambulatory pa-tients with heart failure. JAMA 2008;299:2533-42.

10. Kalogeropoulos AP, Georgiopoulou VV, Giamouzis G, et al. Utility ofthe Seattle Heart Failure Model in patients with advanced heart failure.J Am Coll Cardiol 2009;53:334-42.

11. Levy WC, Lee KL, Hellkamp AS, et al. Maximizing survival benefitwith primary prevention implantable cardioverter-defibrillator therapyin a heart failure population. Circulation 2009;120:835-42.

12. May HT, Horne BD, Levy WC, et al. Validation of the Seattle HeartFailure Model in a community-based heart failure population andenhancement by adding B-type natriuretic peptide. Am J Cardiol2007;100:697-700.

13. Pencina MJ, D’Agostino RB, D’Agostino RB Jr, et al. Evaluating theadded predictive ability of a new marker: from area under the ROCcurve to reclassification and beyond. Stat Med 2008;27:157-72.

14. Goda A, Lund LH, Mancini D. The Heart Failure Survival Scoreoutperforms the peak oxygen consumption for heart transplantationselection in the era of device therapy. J Heart Lung Transplant 2011;30:315-25.

15. Lietz K, Miller LW. Improved survival of patients with end-stage heartfailure listed for heart transplantation: analysis of organ procurementand transplantation network/U.S. United Network of Organ Sharingdata, 1990 to 2005. J Am Coll Cardiol 2007;50:1282-90.

16. Baldwin JT, Mann DL. NHLBI’s program for VAD therapy for mod-erately advanced heart failure: the REVIVE-IT pilot trial. J Card Fail2010;16:855-8.

17. Slaughter MS, Rogers JG, Milano CA, et al. Advanced heart failuretreated with continuous-flow left ventricular assist device. N EnglJ Med 2009;361:2241-51.

18. Arena R, Myers J, Guazzi M. The clinical and research applications ofaerobic capacity and ventilatory efficiency in heart failure: an evi-

dence-based review. Heart Fail Rev 2008;13:245-69.

Recommended