Date post: | 31-Dec-2015 |
Category: |
Documents |
Upload: | estella-joseph |
View: | 216 times |
Download: | 1 times |
Population Health Forecasting – Exploring utilization of simulation modeling
in Health Impact AssessmentJeroen van Meijgaard – UCLA School of Public Health
April 14, 2011
HEALTH FORECASTING AT UCLA
Target audience• Local Health Departments• Foundations• Legislators and legislative analysts• Advocacy groups
Health Forecasting is• a sister project of Health Impact Assessment, both based at the UCLA School of Public Health• a collaborative effort between UCLA, Los Angeles County Department of Public Health, California Department of Public Health• conceived and principally led by Dr Fielding• supported by a mix of foundation and federal grants, supporting a small staff of 2-4 researchers
Funding from• The California Endowment • The Robert Johnson Foundation• UniHealth Foundation (local Los Angeles foundation supporting hospitals)• National Institutes of Health
THE RELATION BETWEEN HEALTH IMPACT ASSESSMENT AND HEALTH FORECASTING AT UCLA
Health Forecasting
HIA
Long Term (10+ Years)
Examine impact of a particular policy or program
on exposures and subsequent health outcomes
in static population
Examine impact of exposures on outcomes in dynamic population (over time)
Short-Medium Term (2-5 Years)
Policy and Program Alternatives
Population Health Outcomes
Behaviors and Exposures
COMBINING SCOPE OF HIA AND HEALTH FORECASTING REMAINS A CHALLENGE
Narrowly targeted programs
Relevant geographic challenges, e.g. Built Environment
Interactions between individuals and environment
Need for specifically defined exposures/risks
Large/Regional Populations
Broadly applicable policies
May assume uniformity across regions
Exposures may be averaged
Small/Local Populations
Uniformly Applicable Model
Ad hoc/ Tailored HIA
ENABLING DECISION MAKERS TO MAKE MORE INFORMED DECISIONS USING HEALTH FORECASTING
What is the incidence or prevalence of disease X in different counties in California, and how is this expected to change in the next 10 years?
How much of the differences in disease incidence rates and other key health outcomes across ethnic and geographic segments can be attributed to known factors?
How will mortality rates in the state of California (or any county) change over time?
10 years from now, what will be the effect of a public health intervention Y on the health outcomes for different ethnic and racial groups in Ventura County and Los Angeles County?
The model aims to allow decision makers in health related fields to answers questions at various levels of detail – primarily addressing chronic disease conditions
DEVELOPING THE MODEL AND DISSEMINATING THE RESULTS
First we determined feasibility and built a prototype model; disseminating the results has required the development of additional tools
Web-based interface to provide public health practitioners and advocates intuitive access to results from the Health Forecasting model
Synthesis of evidence-based research into a comprehensive Health Forecasting Model
Disseminate information (e.g. briefs) and educate and train stakeholders through workshops, presentations and mailings
INTUITIVE INTERFACE – ENABLING STAKEHOLDERS TO USE MODEL RESULTS FOR LOCAL POPULATIONS
The full model will be maintained at UCLA by project team – users can request scenarios to be simulated.
The website is a primary means of wide distribution of tools, results, and analyses
• Baseline forecasts
• Technical documentation
• Simplified version of the model that can be used by local health officers, their staffs and other stakeholders.
A user friendly interface that uses static model output to enable users to perform analysis on a local communities or counties. Users may input community specific demographic information, and the interface provides tables and graphics based on modeling results.
APPLICATIONS OF THE FORECASTING MODEL
• Evaluate research questions about the association between sets of variables that can not be observed directly through surveys, e.g. estimates of life time expenditures associated with levels of physical activity and weight,
• Inform debate on important policy issues in public health through issue briefs,
• Support community advocacy to strengthen local communities and efforts to improve population health – intuitive access via web-based interface (www.health-forecasting.org), and
• Provide analysis on the long term impact of proposed policies and programs.
Comprehensive modelling to assess
health impacts of proposed policies
The impact of U.S. smoking trends on cause specific mortality
EVALUATE LONG TERM IMPACT OF POLICIES ON MORTALITY, BY CAUSE OF DEATH
• Model lifecourse of individuals in U.S. population with cohort specific initiation and cessation rates• Alternative trends are used to estimate to total mortality benefit• End point is comprised of each of the 20 leading causes of death in the United States, plus the residual to comprise all cause mortality
A. Use comprehensive lifecourse model with competing causes to assess benefits
• Smoking prevalence has reduced significantly; and is still declining• How to evaluate current and future benefits of reductions already attained• What additional gains can be made• How is the mix of causes of death expected to change• How important is it to assess this in a comprehensive framework?
Q. What is the impact on smoking reductions in the U.S. on cause of death mortality
COMPONENTS OF THE SIMULATION MODEL
Smoking initiation and cessation
Cohort specific rates by age, gender and period
Smoking Prevalence
Keep track of time since last smoked
Mortality Outcomes
Leading causes of death
Independent competing process
• Initiation assumptions based on surveys at young age; assume limited initiation at later age
• Cessation assumptions based on tracking surveys and sequential cohort surveys
• Relative risks are calculated for smokers and former smokers based on time since last smoked
• Different causes of death are assumed to be independent for now
• Tracking of smoking prevalence follows naturally from lifecourse model and is determined by initiation, cessation and excess mortality
LESS THAN 50% OF GAINS IN MORTALITY REDUCTION FROM CHANGES IN SMOKING INITIATION AND CESSATION HAS BEEN REALIZED
2004 Rates
Smoking Prevalence: Female – 18.9%; Male – 23.1%
Life Expectancy: Female – 80.2; Male – 75.1
If initiation and cessation rates had stayed at 1950s levels through 2004:
Smoking Prevalence: Female – 32.9%; Male – 47.9%
Life Expectancy: Female – 79.6 (-0.6); Male 73.9 (-1.2)
If current initiation and cessation rates continue to prevail for new cohort:
Smoking Prevalence: Female – 14.4%; Male – 16.4%
Life Expectancy: Female – 81.1 (+0.9); Male – 76.4 (+1.3)
Reflects 10-15% of total gain in LE since 1960
RESULTS – CAUSES OF DEATH FOR COHORTS WITH VARIOUS INITIATION AND CESSATION RATES
1950s Rates (c.3) Current Rates (c.2) No Smoking (c.1)
Female Male Female Male Female Male
Current Smokers (Adults 18+, Age Adjusted)
32.9% 47.9% 14.4% 16.4% 0.0% 0.0%
Former Smokers (Adults 18+, Age Adjusted)
20.2% 30.3% 19.2% 21.2% 0.0% 0.0%
Life Expectancy 79.6 73.9 81.1 76.4 82.3 78.0
Age-Adjusted Mortality (2004 population)
725 1080 646 896 579 805
Distribution of Deaths by Cause
Ischemic Heart Diseases 18.9% 21.0% 19.5% 21.9% 20.5% 22.8%
Other Heart Diseases (no CHD) 7.9% 6.6% 8.9% 7.5% 9.9% 8.0%
Cancer of Trachea, Bronchus and Lung
6.1% 8.7% 3.5% 4.7% 1.8% 2.6%
Cerebrovascular Diseases 7.8% 5.1% 8.2% 6.3% 8.7% 7.0%
Chronic Lower Respiratory Diseases
6.2% 6.2% 4.3% 3.9% 1.7% 2.4%
Diabetes Mellitus 2.9% 2.7% 3.1% 3.2% 3.4% 3.5%
DISCUSSION
Lifetime simulation model can be used to estimate impacts over long time horizons •Changes in initiation and cessation of smoking have already yielded substantial gains in life expectancy and will continue to extend life for new cohorts relative to older cohorts provided rates stay the same
•Simulation models are flexible in analyzing various cohorts and time horizons, and thus showing when and to whom benefits accrue.
Modelling competing causes suggests shifts in burden of disease•Multiple causes of death in a single framework provides an opportunity to better estimate burden of disease and associated expenditures
•Limiting outcomes to one or a few causes of death may overstate benefits of changes in health behaviours even if risks of death are independent as non-modelled causes of death may be associated with behaviour (study in progress)
Evaluating policies with uncertain impact estimates
Using sensitivity analysis to evaluate to potential impact of retail food environment changes on
health and economic outcomes
EVALUATE POTENTIAL IMPACT OF ACCESS TO HEALTHIER FOOD
• Model upstream determinants linked to health outcomes and economic outcomes• Use multivariate sensitivity analysis to evaluate potential range of benefits
A. Conduct sensitivity analysis with existing information
• Recent literature suggests type of food stores in neighborhoods impact eating patterns and obesity in local populations• Controlling for selection and confounders remains a challenge• Few available studies to estimate impact, with relatively large standard errors, leaves potential benefit in question• Controlled studies are expensive; however investment in such studies may yield valuable information to better evaluate proposed policies
Q. Impact of policy/program to improve access to health food in U.S. neighborhoods uncertain
SIMULATION MODEL
Retail Food Environment
Supermarkets vs Convenience Stores
Health Behavior
Obesity Prevalence
Health /Economic Outcomes
MortalityMedical Expenditures
Life Expectancy
$$
• # of supermarkets• # of convenience
stores• Effect size of store
type on obesity prevalence
• Mortality associated with obesity, controlled for confounders
• Medical expenditures caused by obesity related conditions
• Relation between obesity prevalence and BMI distribution
• Tracking of obesity over the lifecourse
SOURCE DATA FOR IMPACT OF RETAIL FOOD ENVIRONMENT ON OBESITY (Morland et al, 2006)
Parameter
Point Estimate Sensitivity Parameter
PRStore Store = =
Supermarket +
Convenience
Store
1.31 0.030 0.015 0.015 0
Convenience
Store1.54 0.015 0.030 0.015 0
Supermarket 1.00 0.015 0 0.030 0
None 1.33 0 0 0 0.030
SENSITIVITY
• Reference scenarios: Use prevalence of convenience stores and supermarkets by census tracts• Supermarket scenario: Assume that supermarkets would be available where currently no supermarket is available; this would create areas with both a supermarket and a convenience store• Convenience Store scenario: Assume that convenience stores could be transformed to offer supermarket type services.
Scenarios
• Although users of the health forecasting model have rarely requested sensitivity analyses of the results, in this specific case it is useful because there is much uncertainty on a number of variables • Uncertainty on the parameters may be incorporated by multivariate sampling on the parameters domain; here sensitivity is incorporated for impact estimates, relative risks for mortality and association with expenditures.
Sensitivity
Reference
Scenario*
Supermarkets
Scenario
Convenience Store
Scenario
Obesity Prevalence 24.2% -3.1% -2.3%
95% CI 24.2% – 24.3% -6.9% – +1.1% -5.4% – +1.0%
Annual Expenditures ($, 2004) 4,387 -33 -28
95% CI (A) 4,386 – 4,394 -76 – +17 -65 – +12
95% CI (B) 4,379 – 4,401 -80 – +17 -72 – +13
Life Expectancy from age 18 61.11 +0.07 +0.05
95% CI (A) 61.05 – 61.13 -0.07 – +0.18 -0.08 – +0.16
95% CI (B) 61.03 – 61.19 -0.06 – +0.19 -0.07 – +0.17
Cumulative Expenditures ($000) 310.6 -1.9 -1.5
95% CI (A) 310.5 – 310.7 -3.9 – +0.4 -3.2 – +0.3
95% CI (B) 309.9 – 311.6 -4.4 – +0.4 -3.7 – +0.3
RESULTS SUMMARY
DISCUSSION
• Impacts on outcomes of interests were not considered statistically significant, making it difficult to push for policy/program changes
• Yet, the potential of impact may be large: at the 95th percentile the return to a single new supermarket was estimated at $1.3 million annually (reduced medical expenditures and value of gained life)
• This uncertainty coupled with potential warrants investments in additional studies
Multivariate sensitivity analysis is an important component, not only to assess confidence, but also potential
Model can be extended to incorporate policy alternatives
• In this analysis policy alternatives were incorporated in the simulation model by allowing users to identify the prevalence of different food environments
• Extensions could include more complex dynamics of food purchasing behavior and changes in the retail food environment
Source: CA-BRFS 1984-2000
MAPPING OF THE CHANGE IN OBESITY PREVALENCE INTO A BMI DISTRIBUTIONAL SHIFT
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
15 20 25 30 35 40 45
Body Mass Index
f(.) Supermarket
OnlyConvenienceStore Only
EXAMPLE – MODELLING THE IMPACT OF OBESITY ON MEDICAL EXPENDITURES
Overweight and Obesity in California
Model Implementation
• Individual BMI levels are determined by gender, ethnicity, age, previous BMI and Physical Activity
• BMI impacts mortality though a relative risk function derived from the literature. RR of BMI on mortality decreases as age increases and are gender specific
• BMI trends in the model with three scenarios
1. Decline to 1984 levels by 20252. Stable at 2005 levels3. Continued increase through 2025
Observations
• BMI levels have increased steadily since the early 1980s
• Increases are seen among all groups but are most pronounced among younger people and Latinos
• Individual BMI levels are highly correlated over time
• BMI and Physical Activity are negatively correlated
EXAMPLE – MODELLING THE IMPACT OF OBESITY ON MEDICAL EXPENDITURES (CONTINUED)
Medical Expenditures associated with Obesity and Physical Activity
• Direct Personal Medical Expenditures associated with Obesity and Physical Activity are estimated using NHIS data linked with data from the Medical Expenditure Panel Survey 1998-2005
• Medical expenditures are significantly higher for Obese people (BMI>30) among the under 65 population, and significantly higher for Overweight and Obese people (BMI>25) among the over 65 population.
• Medical expenditures are significantly lower for people over 65 with recommended levels of Physical Activity (>16 METhrs/wk)
• The simulation model allows researchers to analyze expenditures as BMI and PA levels change for each individual from year to year, thus enabling analysis of lifetime medical expenditures