Learning Management Learning Management System System

RecommendationsRecommendationsCIO- David Watson CIO- David Watson

CFO- Ryan KreinbringCFO- Ryan KreinbringCNO- Susan BesheerCNO- Susan BesheerDON- Elizabeth Acord DON- Elizabeth Acord

HR Director- Connie EgererHR Director- Connie EgererDirector of Compliance- Connie EgererDirector of Compliance- Connie Egerer

Decision-Making ProcessDecision-Making Process

RFP Sent Out

5 responses received

Subjective analytical tool utilized for individual rankings

Individual Rankings compiled

Delphi method used to reach consensus

Group brought together to discuss top two vendors based on rankings

Final Vendor

Selected

CIO RankingCIO Ranking

Filters

Relative Importance

(scale 1-200) Ranking Scale (1-100) Certpoint HealthStream Oracle eLEAPSolo

Learning

Filters1 Product Functionality 200 Number (higher = best) 70 90 10 80 1002 Price 50 Number (higher = best) 80 90 10 70 803 Vendor Qualifications 40 Number (higher = best) 70 80 10 50 904 Product Integration Capabilities 40 Number (higher = best) 80 90 10 30 1005 Implementation Process 30 Number (higher = best) 70 40 10 70 806 Training Capability/Availability 30 Number (higher = best) 10 10 10 60 60

Total Score 26,400 30,800 3,900 26,600 35,800 Rank 4 2 5 3 1

CIO Key PointsCIO Key Points

CertpointCertpointVendor is relatively unknown Vendor is relatively unknown

HealthstreamHealthstreamSaaS highly desirableSaaS highly desirable

OracleOracleCost prohibitiveCost prohibitive

eLeapeLeapUnclear integration capabilities and contentUnclear integration capabilities and content

Solo LearningSolo LearningFirst choiceFirst choice

User Acceptance TestingUser Acceptance Testing

User Acceptance TestingUser Acceptance Testing

Vendor's obligation to correct any defects Vendor's obligation to correct any defects discovered during testingdiscovered during testing

Acceptance criteria generally includes:Acceptance criteria generally includes: System functional capabilitiesSystem functional capabilities Interfaces work properlyInterfaces work properly System complies with scalability and System complies with scalability and

performance requirementsperformance requirements

CFO RankingCFO Ranking

Filters

Relative Importance

(scale 1-200) Ranking Scale (1-100) Certpoint HealthStream Oracle eLEAPSolo

Learning

Filters1 Product Functionality 200 Number (higher = best) 85 87 84 85 852 Price 50 Number (higher = best) 80 75 83 95 973 Vendor Qualifications 40 Number (higher = best) 82 95 93 75 924 Product Integration Capabilities 40 Number (higher = best) 95 93 95 90 905 Implementation Process 30 Number (higher = best) 86 85 80 85 826 Training Capability/Availability 30 Number (higher = best) 87 87 85 80 85

Total Score 33,270 33,830 33,420 33,300 34,140 Rank 5 2 3 4 1

CFO Pricing AnalysisCFO Pricing Analysis

Certpoint HealthStream Oracle eLEAP Solo LearningLicense 1 Year (2,000 users): $70,000 $232,000 $78,000 $19,000 $20,000Price Per Year/Per User: $35 $116 unlimited user license $10 $10One Time Costs: $25,000 $0 $0 $5,500 $10,000

Does NOT include T&E --- --- --- ---Training : $8,000 ? $5,000 $3,000

Does NOT include T&E --- --- --- ---Monthly Costs: $0 $0 $0 $875 $417

Total 1 Year Costs: $103,000 $232,000 $83,000 $38,000 $35,000Total 3 Year Costs: $243,000 $696,000 $239,000 $97,000 $85,000Total 5 Year Costs: $383,000 $1,160,000 $395,000 $156,000 $135,000

Perpetual Initial Cost 175,000.00 --- --- --- $20,000Perpetual Annual Cost 38,500.00 --- --- --- $9,800

Total 1 Year Costs: $175,000 --- --- --- $20,000Total 3 Year Costs: $252,000 --- --- --- $39,600Total 5 Year Costs: $329,000 --- --- --- $59,200

CFO Pricing AnalysisCFO Pricing Analysis

$0

$200,000

$400,000

$600,000

$800,000

$1,000,000

$1,200,000

$1,400,000

Total 1 Year Costs: Total 3 Year Costs: Total 5 Year Costs:

Certpoint

HealthStream

Oracle

eLEAP

Solo Learning

CNO and DON RankingCNO and DON Ranking

Filters

Relative Importance

(scale 1-200) Ranking Scale (1-100) Certpoint HealthStream Oracle eLEAPSolo

Learning

Filters1 Product Functionality 200 Number (higher = best) 65 50 70 95 902 Price 50 Number (higher = best) 80 75 83 95 973 Vendor Qualifications 40 Number (higher = best) 82 95 93 75 924 Product Integration Capabilities 40 Number (higher = best) 95 93 95 95 905 Implementation Process 30 Number (higher = best) 86 85 80 85 826 Training Capability/Availability 30 Number (higher = best) 87 87 85 80 85

Total Score 29,270 26,430 30,620 35,500 35,140 Rank 4 5 3 1 2

CNO AnalysisCNO Analysis

Created a Survey for clinical end-users focusing Created a Survey for clinical end-users focusing on the following: on the following:

Tool Set/FeaturesTool Set/Features Ease of UseEase of Use Technological issues Technological issues related to learningrelated to learning

Log-inLog-in IntuitivenessIntuitiveness Cross-platformCross-platform

ContentContent AccessibilityAccessibility RobustnessRobustness

CommunicationCommunication Interface ConsistencyInterface Consistency Plug-ins browser supportPlug-ins browser support

GradebookGradebook Number of ClicksNumber of Clicks

AssessmentAssessment SearchingSearching

Survey ResultsSurvey ResultsOracle Solo Learning

Certpoint Healthstream

Survey ResultsSurvey Results

eLeap

HR Director and Compliance HR Director and Compliance Officer RankingsOfficer Rankings

Filters

Relative Importance

(scale 1-200) Ranking Scale (1-100) Certpoint HealthStream Oracle eLEAPSolo

Learning

Filters1 Product Functionality 200 Number (higher = best) 95 93 97 90 852 Price 50 Number (higher = best) 60 90 80 40 953 Vendor Qualifications 40 Number (higher = best) 90 100 100 60 804 Product Integration Capabilities 40 Number (higher = best) 80 100 100 80 905 Implementation Process 30 Number (higher = best) 100 100 100 80 906 Training Capability/Availability 30 Number (higher = best) 100 100 100 80 90

Total Score 34,800 37,100 37,400 30,400 33,950 Rank 3 2 1 5 4

Political EnvironmentPolitical Environment

HR Director and Compliance Officer HR Director and Compliance Officer aligned strategically aligned strategically

Chosen vendor was not initially preferred Chosen vendor was not initially preferred vendor for HR, Compliance, DON, or CNO vendor for HR, Compliance, DON, or CNO

Buy-in from the clinicians was gained Buy-in from the clinicians was gained through the survey processthrough the survey process

Change Management Change Management

Decision Authority Decision Authority

User Acceptance TestingUser Acceptance Testing

Training-- SuperusersTraining-- Superusers

Communication PlansCommunication Plans

Cumulative RankingsCumulative Rankings

Filters

Relative Importance

(scale 1-200) Ranking Scale (1-100) Certpoint HealthStream Oracle eLEAPSolo

Learning

Filters1 Product Functionality 200 Number (higher = best) 78.75 80 65.25 87.5 902 Price 50 Number (higher = best) 75 82.5 64 75 92.253 Vendor Qualifications 40 Number (higher = best) 81 92.5 74 65 88.54 Product Integration Capabilities 40 Number (higher = best) 87.5 94 75 73.75 92.55 Implementation Process 30 Number (higher = best) 85.5 77.5 67.5 80 83.56 Training Capability/Availability 30 Number (higher = best) 71 71 70 75 80

Total Score 30,935 32,040 26,335 31,450 34,758 Rank 4 2 5 3 1

THANK THANK

YOU!YOU!