+ All Categories
Home > Documents > Gaining Insight with Bayesian Inference

Gaining Insight with Bayesian Inference

Date post: 08-Apr-2022
Category:
Upload: others
View: 5 times
Download: 0 times
Share this document with a friend
36
Gaining Insight with Bayesian Inference EVAN SANGALINE (MICHIGAN STATE UNIVERSITY) MADAI COLLABORATION (HTTP://MADAI.US) JUNE 09, 2015 Cyber Enabled Discovery and Innovation
Transcript
Page 1: Gaining Insight with Bayesian Inference

Gaining Insight with Bayesian InferenceEVAN SANGALINE (MICHIGAN STATE UNIVERSITY)

MADAI COLLABORATION (HT TP://MADAI .US)

JUNE 09, 2015Cyber Enabled Discovery and Innovation

Page 2: Gaining Insight with Bayesian Inference

Part Ior “Determining the EOS and Viscosity”

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 2

Page 3: Gaining Insight with Bayesian Inference

I won’t talk about…

The basic premise of Bayesian inference

Dimensional reduction of experimental measurements Principal Component Decomposition

The details of our model

Model emulation Gaussian Process Interpolation

Validation

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 3

Page 4: Gaining Insight with Bayesian Inference

Because you’ve probably already heard it

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 4

Page 5: Gaining Insight with Bayesian Inference

Constraining the Shear Viscosity

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 5

Prior Posterior

Page 6: Gaining Insight with Bayesian Inference

Constraining the Equation of State

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 6

Prior Posterior

Page 7: Gaining Insight with Bayesian Inference

Constraining the Equation of State

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 7

Excellent agreement with lattice

Posterior

Page 8: Gaining Insight with Bayesian Inference

Bayesian approach is great for…

What does the data tell us about ____________?

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 8

Page 9: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 9

What about…

Page 10: Gaining Insight with Bayesian Inference

Part IIor “Gaining Insight”

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 10

Page 11: Gaining Insight with Bayesian Inference

Very intuitive

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 11

Page 12: Gaining Insight with Bayesian Inference

How do we restore that intuition?

Visualization in more than 3 dimensions e.g. projections, scatter-plot matrices, factorization, parallel coordinates,

dimensional reduction/manifold learning

Modifying the observable values and rerunning the MCMC lots of knobs expensive

Sensitivity analysis

Others e.g. canonical correlation analysis

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 12

Page 13: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 13

StiffInitially rising

SoftInitially falling

Page 14: Gaining Insight with Bayesian Inference

Scatter-Plot Matrices

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 14

∂ 𝜂 𝑠∂𝑙𝑛𝑇

𝜂

𝑠 0

STAR v2

ALICE v2

not useful useful

Page 15: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 15

RHIC Data Only

Well constrained viscosity at TC

Little constraint on the temperature dependence

Page 16: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 16

RHIC Data Only LHC Data Only

Poorly constrained viscosity at TC

Tighter constraint on the temperature dependence

Page 17: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 17

RHIC Data Only LHC Data Only Combined Data

Both are well constrained

Preferred viscosity

at TC is 2.26

4𝜋± 0.07

Page 18: Gaining Insight with Bayesian Inference

Can we estimate how the results would change for different experimental data?

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 18

Page 19: Gaining Insight with Bayesian Inference

Log-Likelihood Derivatives

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 19

Normally store LL, parameters, and observables for each sample

Can store additional informationHow the likelihood depends on the experimental measurements/uncertainties

∂𝐿𝐿

∂𝑧

Page 20: Gaining Insight with Bayesian Inference

Log-Likelihood Derivatives

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 20

∂𝐿𝐿

∂𝑦𝑜𝑏𝑠,𝑖= Σ−1 𝑦 − 𝑦𝑜𝑏𝑠 𝑖

∂𝐿𝐿

∂𝜎𝑦𝑜𝑏𝑠,𝑖

≅1

2𝑦 − 𝑦𝑜𝑏𝑠

𝑇Σ−1ΔΣ−1 𝑦 − 𝑦𝑜𝑏𝑠

Δ𝑗,𝑘 =

2𝜎𝑦𝑜𝑏𝑠,𝑗

𝜎𝑦𝑜𝑏𝑠,𝑗𝜌𝑦𝑜𝑏𝑠,𝑗,𝑦𝑜𝑏𝑠,𝑘

𝜎𝑦𝑜𝑏𝑠,𝑘𝜌𝑦𝑜𝑏𝑠,𝑗,𝑦𝑜𝑏𝑠,𝑘

0

if

ifif

if

𝑖 = 𝑗 ∧ 𝑖 = 𝑘

𝑖 ≠ 𝑗 ∧ 𝑖 = 𝑘𝑖 = 𝑗 ∧ 𝑖 ≠ 𝑘

𝑖 ≠ 𝑗 ∧ 𝑖 ≠ 𝑘

With respect to experimental measurements

With respect to experimental errors

Σ =combined model and measurement uncertainty covariance matrix

Page 21: Gaining Insight with Bayesian Inference

Linearized Log-Likelihood Trace Reweighting

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 21

𝑓 𝑥, 𝑦 → 𝑓 𝑥, 𝑦 + δ𝑧 𝑓 𝑥, 𝑦∂𝐿𝐿

∂𝑧− 𝑓 𝑥, 𝑦

∂𝐿𝐿

∂𝑧

𝑧 → 𝑧 + 𝛿𝑧Consider a small change in either an experimental measurement or it’s uncertainty

We can approximate the likelihood weighted expectation of any function f of observables and parameters as

using the existing MCMC trace from the unperturbed case

Page 22: Gaining Insight with Bayesian Inference

Relationship Between Shear Viscosity and v2

Extracted shear viscosity at TC can be approximated by 𝜂 𝑠 0 ≅ 0.183 − 𝛿𝑣25.95

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 22

STAR 20-30% fluctuation corrected <v2>pT <(η/s)0> given v2

0.07 0.25

0.0814 (actual value) 0.18

0.9 0.13

Implicitly, all parameter distributions are changing as we vary v2

This is very different from varying 𝜂 𝑠

Page 23: Gaining Insight with Bayesian Inference

An Important Question…

How should we allocate experimental resources to address physics goals?

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 23

Page 24: Gaining Insight with Bayesian Inference

Resolving Power: 𝜎𝑜𝑏𝑠

𝜎𝑝𝑎𝑟

𝜕𝜎𝑝𝑎𝑟

𝜕𝜎𝑜𝑏𝑠

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 24

∂ 𝜂 𝑠∂𝑙𝑛𝑇

𝜂

𝑠 0

useful

extremely useful

Page 25: Gaining Insight with Bayesian Inference

Resolving Power

𝜎𝑣2

𝜎 𝜂𝑠 0

𝜕𝜎 𝜂𝑠 0

𝜕𝜎𝑣2

=0.033

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 25

◦ 𝜎𝑁𝜋

𝜎 𝜂𝑠 0

𝜕𝜎 𝜂𝑠 0

𝜕𝜎𝑁𝜋

=0.095

Of 20-30% central ALIVE v2

Of 20-30% central ALICE pion yield

Much less than 1, the assumption if only varying 𝜼 𝒔

~3x moresignificant

(surprising?)

Intuition tends to overestimate statistical significance

Page 26: Gaining Insight with Bayesian Inference

Identifying Model Weaknesses

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 26

𝜎𝑜𝑏𝑠

𝜕𝐿𝐿

𝜕𝑜𝑏𝑠

Contradiction?

Page 27: Gaining Insight with Bayesian Inference

Final Thoughts

Bayesian methodology has proven fruitful

Three ways forward: New experimental data or analyses

More accurate models and emulators

Analysis of models and resulting posterior distributions

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 27

Page 28: Gaining Insight with Bayesian Inference

Backup slides

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 28

Page 29: Gaining Insight with Bayesian Inference

Parameterized Collision Model

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 29

Smooth Glauber Initial Conditions 10 parameters – (5 for 200 GeV, 5 for 2.76 TeV)

energy normalization balance of wounded nucleon vs saturation picture saturation scale initial flow stress energy tensor asymmetry

Boost Invariant Israel-Stewart Hydro 2 Equation of State Parameters 2 Shear Viscosity Parameters more on these later…

Hadronic Cascade begins at TC=165 MeV

Analysis Using the same cuts/methods as the experiments

Page 30: Gaining Insight with Bayesian Inference

Collection of Observations 16 Spectra Observables<pT> for (π, k, p̄) X (0-5% centrality, 20-30% centrality) X (200 GeV PHENIX, 2.76 TeV ALICE)

π yields for (0-5% centrality, 20-30% centrality) X (200 GeV PHENIX, 2.76 TeV ALICE)

12 HBT Observablesπ (Rlong, Rout, Rside) X (0-5% centrality, 20-30% centrality) X (200 GeV PHENIX, 2.76 TeV ALICE)

2 Flow Observables20-30% centrality v2{2} for (200 GeV STAR, 2.76 TeV ALICE)Corrected for fluctuating initial conditions

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 30

20-30%

20-30% centrality minimized effect of fluctuating initial conditions

Non-smooth initial conditions in progress

Page 31: Gaining Insight with Bayesian Inference

Model Emulation

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 31

Parameter space is explored using Latin Hypercube Sampling.

~1000 model evaluations

Model is too computationally expensive for direct Markov chain Monte Carlo.

Normalize the data.

𝑦 → 𝑦 ≡𝑦 − 𝑦

𝜎𝑦

Perform principal component analysis by projecting y onto the eigenvectors of

𝑦 𝑦𝑇

ignoring those with negligible eigenvalues.

We need something faster…

Page 32: Gaining Insight with Bayesian Inference

Gaussian Process Interpolation

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 32

Assume a prior over Gaussian processes to enforce smoothness.

Find posterior over functions based on consistency with training points.

Page 33: Gaining Insight with Bayesian Inference

PHENIX 𝝅+ Yield (0-5% centrality)

Cross Validation and Consistency Check

Additional model runs are used to validate the emulation.

Emulation errors are negligible compared to the 5% model uncertainties.

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 33

The resulting posterior distributions are all consistent with the experimental measurements.

Page 34: Gaining Insight with Bayesian Inference

Shear viscosity parameterization

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 34

𝜂

𝑠=

𝜂

𝑠 0+

∂ 𝜂 𝑠∂𝑙𝑛𝑇

𝑙𝑛𝑇

𝑇𝐶

Viscosity at freeze-out (∈ [0,0.5])

Temperature dependency of viscosity (∈ [0,3.0])

Encompasses many possibilities…

Page 35: Gaining Insight with Bayesian Inference

Speed of Sound Parameterization

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 35

𝑐𝑠2 = 𝑐𝑠,ℎ𝑎𝑑

2 +1

3− 𝑐𝑠,ℎ𝑎𝑑

2 𝑥2 + 𝑋0𝑥

𝑥2 + 𝑋0𝑥 + 𝑋′𝑥 휀 = 𝑙𝑛

휀ℎ𝑎𝑑

𝑋0 𝑟𝑎𝑡𝑖𝑜 =𝑋0

2𝑋′ 3𝑐𝑠,ℎ𝑎𝑑

> −1

with

• Constrained to matched hadronic speed of sound at T=165 MeV• Goes to 1/3 at large energy densities• Positive definite:

Page 36: Gaining Insight with Bayesian Inference

2015/06/09 EVAN SANGALINE - GAINING INSIGHT WITH BAYESIAN INFERENCE - RHIC/AGS AUM 2015 36

RHIC Data Only LHC Data Only Combined Data


Recommended