+ All Categories
Home > Documents > Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP...

Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP...

Date post: 26-Dec-2015
Category:
Upload: lindsey-thomas
View: 235 times
Download: 6 times
Share this document with a friend
27
Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms
Transcript
Page 1: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Chapter 1: Introduction to Predictive Modeling

1.1 Applications

1.2 Generalization

1.3 JMP Predictive Modeling Platforms

Page 2: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Chapter 1: Introduction to Predictive Modeling

1.1 Applications1.1 Applications

1.2 Generalization

1.3 JMP Predictive Modeling Platforms

Page 3: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Objectives Describe common applications of predictive modeling

in business, science, and engineering. Describe typical data that is available for predictive

modeling. Define commonly used terms used in predictive

modeling.

3

Page 4: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Predictive Modeling Applications

4

Database marketing

Financial risk management

Fraud detection

Process monitoring

Pattern detection

Healthcare Informatics

Page 5: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

The Data

5

Experimental Opportunistic

Purpose Research Operational

Value Scientific Commercial

Generation Actively controlled Passively observed

Size Small Massive

Hygiene Clean Dirty

State Static Dynamic

Page 6: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

inputs target

Predictive Modeling Data

6

Training Data

Training data case: categorical or numeric input and target measurements

Page 7: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Types of Targets Supervised Classification

– Event/no event (binary target)– Class label (multiclass problem)

Regression– Continuous outcome

7

Page 8: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Continuous Targets Healthcare Outcomes

– Target = hospital length of stay, hospital cost Liquidity Management

– Target = amount of money at an ATM machine or in a branch vault

Process Volatility– Target = moving range of yields

Sales– Target = dollar value of sales

8

Page 9: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Measurement LevelsThree types in JMP Continuous Ordinal Nominal

JMP automatically performs specific types of analyses based on the measurement level of the target. For example, linear regression versus logistic regression.

In some platforms, ordinal and nominal variables inputs are handled differently.

9

Page 10: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Chapter 1: Introduction to Predictive Modeling

1.1 Applications

1.2 Generalization1.2 Generalization

1.3 JMP Predictive Modeling Platforms

Page 11: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Objectives Define generalization. Define honest assessment. Describe how honest assessment can be done in JMP.

11

Page 12: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

The Scope of Generalization Model Selection and Comparison

– Which model gives the best prediction? Decision/Allocation Rule

– What actions should be taken on new cases? Deployment

– How can the predictions be applied to new cases?

12

Page 13: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Model Complexity

13 ...

Page 14: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Model Complexity

14

Not complex enough

...

Page 15: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Model Complexity

15

Too complex

Not complex enough

Page 16: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Honest Assessment: Data Splitting

16

Page 17: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Data Partitioning

17

Training Data

inputs target

...

Page 18: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Data Partitioning

18

Training Data Validation Data

inputs target inputs target

...

Page 19: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Data Partitioning

19

Training Data Validation Data

Partition available data intotraining and validation sets.

inputs target inputs target

Page 20: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

5

4

3

2

1

Predictive Model Sequence

20

Create a sequence of models with increasing complexity.

ModelComplexity

Training Data Validation Data

inputs target inputs target

Page 21: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Model Performance Assessment

21

ValidationAssessment

Rate model performance using validation data.

Training Data Validation Data

inputs target inputs target

5

4

3

2

1

ModelComplexity

Page 22: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

3

Model Selection

22

ModelComplexity

ValidationAssessment

Select the simplest model with the highest validation assessment.

Training Data Validation Data

inputs target inputs target

Page 23: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Chapter 1: Introduction to Predictive Modeling

1.1 Applications

1.2 Generalization

1.3 JMP Predictive Modeling Platforms1.3 JMP Predictive Modeling Platforms

Page 24: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Objectives Show the platforms that will used in the class.

24

Page 25: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Accessing the Neural or Partition Platforms

25

Page 26: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Partition Platform Dialog

26

Page 27: Chapter 1: Introduction to Predictive Modeling 1.1 Applications 1.2 Generalization 1.3 JMP Predictive Modeling Platforms.

Neural Platform Dialog

27


Recommended