Welcome 2018 Board of Examiners - Tennessee Center for ......Reread Org Profile/ Key Factors, and...

Welcome 2018 Board of Examiners

Examiner Training – Day 3

Master Examiner Introductions

• Name

• Company

• What is your intention for examiner training?

• What are you famous for?

2

Master Examiners…

• Have served for a minimum of 3 years on examiner teams, AND

• Have been either a scorebook editor or team leader, AND

• Have demonstrated mastery of the Framework

• They serve TNCPE in leadership roles, AND

• Are only required to attend Day 3 of the training course…

• For which they earn an individual TNCPE membership

3

Summary of Key Changes

• Lots of change!• New TNCPE staff

• New Score Summary Worksheet

• New Level 2 workshop

• Level 1 Redesign Pilot

• Introduced in 2017 (and embraced):• Extra Credit slides (now “Superstar”)

• Scorebook Navigator system

4

Site Visit Issues“There comes a time when what is needed is not just rhetoric,

but boots on the ground.”

Baldwin Spencer

The 2018 Approach to Site Visit

• Use Scorebook Navigator to document SVI issues, document requests, etc.

• Use SVI Worksheets in Word to prepare for interviews and take notes• These are only for you, the judges will not see them

• Document your findings in Scorebook Navigator

6

7

Planning Phase

Reread Org Profile/ Key Factors, and Key Themes to get grounded

Discuss Site Visit agenda and approach during consensus meeting

Watch site visit video

Develop site visit issues and complete Scorebook Navigator form

Send site visit issues to applicant 1-2 weeks prior to site visit

Site Visit Video

8

Selecting Site Visit Issues

• Use site visit issues to• Verify role model strengths and

• Clarify OFIs

• How many site visit issues do I need?• As a general rule, prepare a site visit issue for each OFI and

double strength (++)

• Your team leader will assist you in determining the correct number of site visit issues based on

• the length of the site visit

• the size of the organization

9

Sample Site Visit Issues

“Verify the applicant’s use of the PES to evaluate workforce capability and capacity.”

“Clarify whether the applicant tailors its benefits and services to its different workforce groups and segments.”

10

11

12

Complete the form in Scorebook Navigator

• The comment and rationale will auto-populate

• Enter any documents you would like to review

• Enter whom you will interview

• Write ONLY the SVI question (verify/clarify) in the “potential questions” box

• You will complete the “Findings” box later

• Only complete this form for the comments you have selected as site visit issues!

13

14

15

16

Next Steps

• Once team members have completed the site visit forms in Scorebook Navigator, the team leader may pull a report including:• Requested Documents

• Potential Interviewees

• SVI Questions (Verify/Clarify)

• Team leader edits and formats this list 1-2 weeks prior to the site visit

• Team members then go back to prepare questions on the SVI Worksheet (Word)

17

The Site Visit Issue Worksheet

• Complete a separate Site Visit Issue (SVI) Worksheet for each site visit issue identified• Download template from TNCPE website

• Complete the entire front page of the worksheet prior to site visit:• Site visit issue (verify or clarify statement)

• Comment(s) affected (cross-walk to Scorebook Navigator)

• Strategy (A-D-L-I or Le-T-C-I questions)

• You will use the worksheet to conduct your interviews and take notes on site

18

What Questions Should I Ask?

• Use your process evaluation factors (A-D-L-I) to “move the applicant to the right”

• If your site visit issue clarifies the applicant’s approach, be prepared with follow-up questions regarding deployment, learning, and integration.

• This approach works for results too (Le-T-C-I) most of the time.

19

Let’s Review…

• Complete SVI form in Scorebook Navigator first• Documents, interviewees

• Site Visit Issue only (verify/clarify questions)

• Then complete a SVI worksheet in Word for each issue

• The applicant will receive your site visit issues (verify/clarify statements) and requested documents but not your prepared A-D-L-I questions or strategy

• Prioritize your SVI worksheets in case you run out of time

20

Assignment

21

Table Item

1 1.2

2 2.2

3 4.2

4 1.2

5 2.2

6 4.2

7 1.2

8 2.2

Table Exercise

• Review Criteria requirements, key factors and comments for your item.

• Using the Consensus Scorebook, make note of key processes GG uses to address Criteria requirements.

• Identify one OFI site visit issue and complete:• The SVI form in Scorebook Navigator (flipchart)

• Documents

• Interviewees

• SVI question (verify/clarify)

• The SVI Worksheet in Word (poster)

• A-D-L-I questions

22

Remember…

Trust the process!

23

What about Results Items?

• Process works the same

• Identify SVI Issues

• Complete SVI form in Scorebook Navigator• Documents

• Interviewees

• Verify/Clarify Questions

• Complete SVI Worksheet (Word)• Still “move to the right” (Le-T-C-I) WHERE APPROPRIATE

24

25

On-Site Phase

Opening Meeting

Category interviews

Review of documents

Team caucus

Remember, after site visit, “it is not clear” means you didn’t do your job!

Sample Level 3 Site Visit Schedule

26

Day 1 Day 2

8:00 am Opening MeetingFollow-up Category 1Follow-up Category 6

9:30 am Category 1Category 6

Follow-up Category 2Follow-up Category 3

11:30 am Lunch/Caucus Lunch/Caucus

NoonCategory 2Category 3

Follow-up Category 4Follow-up Category 5

2:00 pmCategory 4Category 5

Visit other sites; review documentationFinal Caucus

4:00 pm Examiner Caucus Closing Meeting

27

Post-Site VisitPhase

Enter site visit findings in Scorebook Navigator

Revise comments and key themes

Complete score summary form

Complete summary of sites visited form

Complete Award Recommendation form

Site Visit Findings

• Use your SVI Worksheet (Word) to take notes during site visit

• Share with your back-up and team leader

• Document your findings and conclusion in the Scorebook Navigator form:• OFI remains

• Delete OFI

• OFI becomes a strength

28

29

30

Revise Comments and Key Themes

• Re-read each strength and OFI comment for the items you are assigned

• Edit comments based on site visit findings• Use the site visit form to explain any changes!

• Remove “the applicant”

• Most of this work will happen during site visit and/or the wrap-up meeting

• Don’t forget to double-check key themes as well

31

Ethics and Conflict of Interest“People forget how fast you did a job, but they

remember how well you did it.”

Howard W. Newton

Applicant Expectations

• Integrity

• Confidentiality

• Professional conduct

• Respect for intellectual property

33

Rules of Conduct

• Established to maintain the confidentiality of ALL award applicant information

• Ensure the fairness of the examination process

• Aligned with Baldrige standards for state awards

• A pledge by the Board of Examiners to uphold professional principles

• Pertains to the entire Board of Examiners, including Judges

34

Potential Conflicts

• Employer• Past, present or future

• Previous evaluation of applicant• Within last 3 years

• Key suppliers, customers, or competitors• Those critical to your organization

• Roughly 5% or greater of your business

• Financial holdings

35

True or False

No one can serve on the Board of Examiners if s/he has not attended the three-day training course.

True False

36

True or False

The team leader is the only examiner that may contact the applicant after the site visit to clarify responses as we complete the final report.

True False

37

True or False

To meet critical team deadlines, it is acceptable for my administrative assistant or other members of my staff that have been trained as examiners to edit my observations and/or feedback-ready comments.

True False

38

True or False

When doing the independent review, I should visit the applicant organization’s website for additional information.

True False

39

True or False

My service on the 2018 Board of Examiners ends once the Panel of Judges meets and the awards are announced.

True False

40

True or False

Cell phones should be set to vibrate during site visit interviews.

True False

41

True or False

At the conclusion of my site visit, TNCPE will automatically reimburse me for the appropriate site visit per diem.

True False

BONUS: 2018 site visit per diem is $________.

42

True or False

The conference and awards banquet is the proper time to approach and congratulate the organization I reviewed.

True False

43

True or False

Once I have completed examiner training, I may add 2018 TNCPE Board of Examiners to my business cards and resume.

True False

44

True or False

Only organizations headquartered in Tennessee may apply for TNCPE awards.

True False

45

True or False

Evaluating a real application will take less time than my pre-work.

True False

46

Multiple Choice

If on site visit an Examiner suspects s/he may have a conflict of interest, s/he should:

a) ask the applicant contact person if s/he objects to their participation

b) refrain from participating in site visit questioning and turn focus to closing meeting

c) immediately call the TNCPE office

47

Multiple Choice

If your assigned applicant approaches you with an offer of employment:

a) you may accept only if it has been 3 or more years since your site visit

b) you may accept only if it has been 5 or more years since your site visit

c) you may accept, provided the applicant sends a signed waiver to the TNCPE office

d) you may not accept

48

Fill in the Blank

If a second-year examiner is unable to fulfill his/her team obligations, TNCPE will send an invoice for the examiner training fee in the amount of $___________.

49

Fill in the Blank

The Baldrige Excellence Framework is offered in three versions or formats: __________________________, __________________________, and _____________________________.

50

Ethics Vignettes

Turn to the ethics vignettes at the end of this module.

51

Table Assigned Vignette

1 1

2 2

3 3

4 4

5 5

6 6

7 7

8 8

Ethics Vignettes

At your table, discuss the assigned vignette and prepare to report out to the class:

• What is the ethical issue?

• Which ethical standard or rule of conduct is involved?

• What is the “right” answer?

52

Your Commitment

• As a member of the TNCPE Board of Examiners, will you uphold the Rules of Conduct and Code of Ethical Standards?

• Please sign and return the Code of Conduct

• Welcome to the 2018 Board of Examiners!

53

Putting It All TogetherIndependent Review | Consensus | Site Visit

How Am I related to Baldrige/TNCPE?

55

Applicant Assessment Process

56

Self assess

Apply

Examiner review & site visit

Award Decision

Receive Feedback

Report

Address OFIs

2

3

45

1

Examiner Evaluation Cycle

57

Complete Pre-work &

Training

IndependentReview

Consensus Review

Site Visit Review

Finalize Feedback

Report

June & July

August

Review for Conflict

Review the Framework

Read the Application

Log on to the system

Create Key Factors List

Click “Done”!

Prepare Consensus items

Participate in Consensus meeting

Prepare Site Visit issues

Complete Site Visit

Prepare Final Scorebook

12 process items

• Criteria

• Key Factors

• Application: PROCESS

• 6-10 comments (ADLI)

• Score

• 1 Feedback-Ready strength and OFI

5 results items

• Criteria

• Key Factors

• Application: RESULTS

• 6-10 comments (LeTCI)

• Score


Independent Review

58

Review – Identify Key Factors

59

• What is a “key factor”?

• Where do I find key factors?

• How and where do I record key factors?

A key factor is an attribute of an organization or its environment that influences the way the organization operates and the key challenges it faces. Examiners will use key factors to focus their assessments on what is important to the applicant.

60

12 process

items

•Criteria – Read the Criteria item requirements•Key Factors – Select 4-6 most relevant key factors from master list•Application – Read relevant section of the application to identify processes

and gaps•6-10 Comments– identify and outline 6-10 strength and OFI comments

using process evaluation factors (A-D-L-I)•Score the item •Feedback-Ready Comments – Write one strength + one OFI comment

5 results

items

•Criteria – Read the Criteria item requirements•Key Factors – Select 4-6 most relevant key factors from master list•Application – Read relevant section of the application; group results and

identify gaps•6-10 Comments– identify and outline 6-10 strength and OFI comments

using results evaluation factors (Le-T-C-I)•Score the item •Feedback-Ready Comments – Write one strength + one OFI comment

Item Evaluation Steps

61

Review – Insightful Process Comments

• Identify gaps between the Criteria questions and the applicant’s response. Are these gaps important to the applicant?

• Look for key factors not addressed. Did the applicant…• Address all customer and stakeholder requirements?

• Consider all employee groups and segments?

• Set measures for all relative goals/objectives?

• Address all strategic challenges?

62

Review – Insightful Results Comments

• Identify gaps between the processes described in

Categories 1-6 and the results in Category 7.

Are these gaps important to the applicant?

• Use the applicant results tracker

• Group results charts to provide new information by…

• Common benchmark or comparison

• Area to address

• Integration with process item

63

Assignment

64

Examiner Item

1 7.4

2 7.5

3 3.2

4 4.1

5 5.2

6 6.2

Exercise – Independent Review

• Review the Criteria requirements for your assigned item (1-2 min.)

• Using the process item worksheet or the results item worksheet:• Select 4-6 relevant key factors (5-10 min.)

• Read Green Gateway’s response (15-20 min.)

• Assess (30 min.)

• Note key processes [OR groups of key results] and any gaps

• Assess processes/results using A-D-L-I or Le-T-C-I

• Outline 6-10 strength and OFI comments

• Score your assigned item (5 min.)

• Do NOT write feedback-ready comments yet 65

66


67

Complete Pre-work &

Training

IndependentReview

Consensus Review

Site Visit Review

Finalize Feedback

Report

June & July

August

September

Review for Conflict





Click “Done”!




Complete Site Visit


12 process items

• Criteria

• Key Factors



• Score


5 results items

• Criteria

• Key Factors



• Score


Consensus Review

68

69

70

71

72

Preparing an Item for Consensus Meeting

74

1. Review the Criteria requirements

2. Assign 4-6 key factors

3. Read applicant’s response

4. Review team members’ Independent Reviews

SYNTHESIZE

Synthesize team members’ IR into 6-10 comment topics

Develop rationale

WRITE

Draft 6-10 feedback comments based on your chosen topics

Balance strengths and OFIs

SCORE

Score the item based on your consensus review

REVISE

Revise comments based on feedback from your backup

Provide feedback to your partner

PREPARE

Prepare to present your items during the team’s consensus meeting

Remember…

• It is your job to select the MOST insightful 6–10 pieces of information, not necessarily those that have already been written as feedback-ready comments.

• Not all Criteria requirements are equally important to every applicant!

• Tell the applicant something it doesn’t already know…

75

Exercise – Consensus Part 1

• Move to a table with others who completed the

same item

• Using your independent reviews, work as a team to

select 4-6 key factors for your item

• As a team, select 6-10 comment topics (strengths

and OFIs)

• What is your rationale for each comment?

• As a team, score your assigned item

76

Table Assignment

77

Table Item

1 7.4

2 7.5

3 3.2

4 4.1

5 5.2

6 6.2

Exercise – Consensus Part 2

• Select one OFI comment from your team’s list

• Independently write your assigned comment on the worksheet provided

• Return to your original table

• Get feedback on your comment from someone at your table (your backup)

• Revise your comment based on the feedback

78

Comment Writing TipsIs the comment Criteria-based?

Is it insightful?

T = Start with the “topic sentence” or main point

E = Give 1 – 2 supporting examples from the application

S = Explain the “so what” (relevance) to the applicant by linking the comment to a key factor

T = Try it out loud!

79


80

Complete Pre-work &

Training

IndependentReview

Consensus Review

Site Visit Review

Finalize Feedback

Report

June & July

August

SeptemberSeptember & October

Review for Conflict





Click “Done”!




Complete Site Visit


12 process items

• Criteria

• Key Factors



• Score


5 results items

• Criteria

• Key Factors



• Score


Site Visit Review

81

Site Visit Video

82

Site Visit Steps

• Complete SVI form in Scorebook Navigator first

• Documents, interviewees

• Site Visit Issue only (verify/clarify questions)

• The team leader sends these lists to the applicant 1-2 weeks

before site visit

• Then complete a SVI worksheet in Word for each issue

• The applicant will receive your site visit issues

(verify/clarify statements) and requested documents

but not your prepared A-D-L-I questions or strategy

83

Individual Exercise – Site Visit

• Complete a site visit issue worksheet based on the comment you wrote in the last exercise (verify/clarify)

• What questions will you ask the applicant?• A-D-L-I or

• Le-T-C-I

• Prepare to report out

84

Components of the Feedback Report

• Cover letter

• Includes examiner hours

• Preparing to read your feedback report

• Key Themes

• Includes scoring bands pre- and post-site visit

• Item assessments

• Comments (strengths and OFIs) linked to key factors

• Scoring range by item

• Appendix

• Stages of assessment process

• Scoring guidelines

• Scoring band descriptors

85

Finalizing Award Recommendations

“The secret to success is constancy of purpose.”

Benjamin Disraeli

86

Award Recommendation

Score Summary

Key Themes

87

Key Themes

• Review key themes before you leave the wrap-up meeting

• Do they appropriately reflect the applicant’s maturity?

• Do they tell the applicant what critical few things it must do to move to the next level?

• Are they traceable to the item comments?

88

Scoring Your Applicant

• Review item scores and complete the Score Summary Worksheet• Are item scores supported by the item comments?

• Are scores stratified over all of the items?

• Do not change scores in Scorebook Navigator!• Indicate on worksheet if score would move up or down by

scoring range

• Select a scoring band for the applicant• Does the scoring band reflect the applicant’s maturity?

• Does the scoring band align with the key themes?

89

New Score Summary Worksheet

• Developed by Panel of Judges

• Completed by team on final day

• Captures changes in score by item from consensus to site visit

• Conditional formatting to help show where new scores may land and tie to scoring bands

• Will be covered in team leader webinar and JIT webinar

90

Jim Hill & Lavona Russell

SCORNG SUMMARY FOR APPLICANT # 1709

Item Number Judge's Observations

Strengths (+) Strengths (++) OFIs (-) OFIs (- - ) Strengths (+) Strengths (++) OFIs (-) OFIs (- -) Comments

KT a/b

7 7

2nd KT is not supported by a (++) strength; 6th KT

strength and related comment need word "problem"

replaced with "program" .

3rd ,4th, 6th KT OFIs are not supported by a (- - )

OFI; I don't see where 5th KT OFI is supported at

all. (OFI from 6.1 was deleted)

KT c/d5 3

None of the KT strengths ae supported by (++)

strength comments

1.1 55% 39 3 2 4 0 50% 35 65% 46 3 2 3 0 Deleted 1 OFI

1.2 45% 23 4 0 3 1 30% 15 45% 23 3 0 2 1

1 strength merged with

another strength; deleted 1

OFI

Scorebook Visit Summary says (- -) moved to 1.1,

but no evidence this was actually done.

2.1 45% 20 4 0 4 0 50% 23 65% 29 6 1 1 1

Moved 1 strength from 4.1 to

2.1; changed 2 OFIs to

strengths; changed 1 OFI to

(- -)

No key themes related to SPP.

2.2 50% 20 3 0 3 0 50% 20 65% 26 2 1 2 1Changed 1 strength to ++;

changed 1 OFI to (- -).

3.1 30% 12 3 0 1 2 50% 20 65% 26 5 0 3 0

Added 2 strengths; deleted 1

OFI; added 1 OFI; no more (-

-) OFIs

3.2 35% 16 3 0 2 1 50% 23 65% 29 3 0 2 1 Why was scoring range increased?

4.1 40% 18 3 2 3 1 30% 14 45% 20 2 1 2 0

Moved 1 (++) strength to 2.1;

deleted 1 strength; delete 1 (-

) OFI and 1 (- - ) OFI.

4.2 60% 27 4 2 2 1 50% 23 65% 29 3 2 1 1Moved 1 strength to 5.2;

deleted 1 OFI

5.1 65% 26 4 0 3 0 70% 28 85% 34 4 0 1 0Deleted 3 OFIs; added 1 OFI

5.2 60% 27 5 1 2 0 50% 23 65% 29 5 2 2 0

Moved 1 strength from 4.2

and made it a (++); deleted 1

OFI; added 1 OFI

Maybe this scoring range should be increasd due to

number of strengths and strengths being tied to 3

KT.

6.1 40% 18 3 0 5 0 30% 14 45% 20 3 0 1 1Deleted 3 OFIs;changed 1

OFI to a (- - )

6.2 45% 18 4 0 4 0 50% 20 65% 26 4 0 2 0 Deleted 2 OFIs

263 255 338

7.1 35% 42 3 0 2 1 30% 36 45% 54 3 0 2 1Deleted 1 OFI and added 1

OFI

7.2 25% 21 2 0 4 0 10% 9 25% 21 2 0 3 1 Changed 1 OFI to (- - )

7.3 40% 34 3 0 3 0 30% 26 45% 38 3 0 2 0 Deleted 1 OFI

7.4 20% 16 2 0 2 2 30% 24 45% 36 2 0 2 2 Why was scoring range increased?

7.5 40% 32 3 0 2 0 50% 40 65% 52 3 0 1 0Deleted 2 OFIs and added 1

OFI

145 134 202

408 389 539

Scoring Bands (Calculated)

Approach 4 3 5

Results 2 2 3

Scoring Bands (Team Recommendation)

Approach 5

Results 3

Consensus Site Visit

Score Scoring Range

TNCPE Recognition Levels

92

Level 4 Level 3 Level 2

Principles Continue to improve and build

upon outstanding results and

excellent systems

Commitment and practice Beginning to commit and

implement

Processes Exhibit processes that serve

as role models for others,

with some at or near “best-in-

class.”

Demonstrate significant

progress in building

systematic processes

Put in place some key

process improvements

EffectivelyAddress

Multiple requirements Overall requirements Basic requirements

Results Demonstrate management

excellence with superior

results over time, directly

attributable to a systematic

well-deployed improvement

approach.

Results for some key

processes show

improvement that is

directly attributable to a

systematic approach.

Process improvements are


fact-based improvement

process. Results may or

may not be evident;

however, a measurement

system should be in place.

Practices Outstanding examples of

high-performance

organizations

Many practices from

which other organizations

can learn and grow.

Level 1 organizations are . . .

. . . interested in adopting and applying performance improvement principles

93

94

Level 2 Award Recommendation

ABC is in the early stages of developing systematic approaches to the basic requirements of the process categories, as evidenced by: listening to customers through XX system; conducting an annual Strategic Planning retreat; recruiting and hiring of new employees; emergency preparedness and prevention planning; and the existence of processes that promote ethical standards of conduct. While there are multiple processes in place, many are not fully deployed and/or lack the means to establish cycles of learning that could lead to continuous improvements for the organization.

ABC collects large amounts of data but is still in the early stages of determining how to effectively analyze this data for use in strategic planning. Segmentation of data and important comparison results that would allow the organization to benchmark itself against competitors in a rapidly changing healthcare environment are missing.

95


XYZ has demonstrated significant progress in building systematic processes that effectively address the overall requirements of each item . . . It has established documented processes for most of the identified key work systems. These processes are deployed and aligned throughout the organization appropriately to meet the key business needs of the organization. Some of the processes remain informal as it is still a small company at this point. Organizational learning has mostly been the result of the new owner and is now in the early stages of being transitioned to the entire workforce.

96

Level 3 Recommendation (cont.)

Results for many of the key processes show improvement that is directly attributable to a systematic improvement approach. There are 26 KPIs that are managed.

What the company lacks in maturity is results and depth of addressing all multiple requirements, including segmentation and comparisons to companies offering similar products.

There are many examples from which other organizations can learn and grow, such as the application of multiple technologies to run and grow the business, which is unique for this industry and company size.

97


ABC is an outstanding example of a high-performing organization. This high performance starts with the leadership system and with the senior leaders who demonstrate an uncommon commitment to continuing improvement and Baldrige principles. Their approaches for strategic planning and innovation are “best in class,” and their processes for ensuring patient-centered care and excellence are role model. ABC has demonstrated management excellence with superior results over time, including increasing market share and national top decile performance in numerous healthcare measures. These results are directly attributable to a systematic, well-deployed improvement approach, which includes XYZ committees throughout the organization, training for all team members, and a focus on innovation.

98

Level 4 Recommendation (cont.)

The management team effectively addresses the multiple requirements of each item and demonstrates alignment throughout the organization. Patients and families are at the center of each system, including leadership, strategic planning, operations, and workforce systems. ABC continues to improve and build upon its outstanding results and excellent systems as demonstrated by its favorable trends and results.

99

Note: Level 4 applicants complete an HRO survey for review by the Panel of Judges

Table Exercise• As a group, reach consensus on the process and results

Scoring Bands for Green Gateway

• As a group, reach consensus on your Award level recommendation for the Panel of Judges.• Green Gateway submitted a Level 4 application

• On the poster provided, write your team’s recommendation. Include supporting comments.• Use language from the Recognition Level descriptions in the Health

Care Framework booklet

• Give examples to support your recommendation (refer to GG’s Key Themes)

• If appropriate, tell what was missing that held the team back from a higher Award level recommendation

100

Panel of Judgesand Editorial Review “Excellence – the difference between ordinary and

extraordinary is that little extra.”

Jimmy Johnson

Panel of Judges

• A subset of the Board of Examiners

• Trained in the Criteria and required to stay current

• Identify potential conflicts and recuse themselves from discussing these applicants

• Meet twice per year• August/September: Check and Act, Plan

• November: Do

102

Role of Panel of Judges

• Review each award application evaluation, including

• Application

• Site visit issue documentation in Scorebook Navigator

• Final scorebook

• Ensure consistency in determination of Award levels

• Validate the integrity of the Award Program

• Determine Award levels

• Ensure equitable treatment of all applicants

103

Judges’ Needs and Expectations

• Complete, well-written award recommendations with concrete examples

• Key Themes consistent with award level recommendation

• Well-written comments that support item scores

• Site Visit Issue findings in Scorebook Navigator that explain WHAT was found on site visit… and WHY comments changed

104

2018 Panel of Judges

Doug BrockKendall ElectricChattanooga

Donn FisherMQPCMemphis

Jim HillJohn Deere (retired)Winter Haven, FL

Cheryl JanoskiTrainer/FacilitatorMills River, NC

Lavona RussellCat Financial (retired)Nashville

Renee TewMaury Regional Medical CenterColumbia

105

TNCPE Recognition Levels

106

Level 4 Level 3 Level 2

Principles Continue to improve and build

upon outstanding results and

excellent systems

Commitment and practice Beginning to commit and

implement

Processes Exhibit processes that serve

as role models for others,

with some at or near “best-in-

class.”

Demonstrate significant

progress in building

systematic processes

Put in place some key

process improvements

EffectivelyAddress

Multiple requirements Overall requirements Basic requirements

Results Demonstrate management

excellence with superior

results over time, directly

attributable to a systematic

well-deployed improvement

approach.

Results for some key

processes show

improvement that is


systematic approach.

Process improvements are


fact-based improvement

process. Results may or

may not be evident;

however, a measurement

system should be in place.

Practices Outstanding examples of

high-performance

organizations

Many practices from

which other organizations

can learn and grow.

Judges’ Meeting Outputs

• Final award decisions for all applicants

• Feedback for team leaders on content and quality of feedback reports

• If necessary, feedback for Editorial Review Board

107

Scorebook Editors

Support the team leader and team by:• Consolidating key factors

• Drafting key themes

• Ensuring that comments are Criteria-based, actionable and serve the best interests of the applicant

• Ensuring correct grammar and consistent writing style

• Incorporating feedback from Panel of Judges

• Working with team leader to prepare Final Scorebook and deliver to TNCPE within 2 weeks of site visit

108

Editorial Review Board

PurposeTo provide an independent review of the final Feedback Report to ensure that the information and comments are Criteria-based, actionable, and serve the best interests of the applicant organization.

Process1. Team submits final scorebook to TNCPE

2. TNCPE staff formats scorebook and sends scorebook to ERB member

3. ERB member reviews scorebook; discusses questions with team leader; edits scorebook and returns it to TNCPE

4. TNCPE sends final Feedback Report to applicant

109

Recap: Timeline

• 1-2 weeks before site visit• Team leader sends SV agenda and issues to applicant

• Site Visit

• 2 weeks after site visit• Team leader (with scorebook editor) completes Final Scorebook

and notifies TNCPE

• TNCPE sends Final Scorebook to ERB member

• Panel of Judges meeting

• 8-10 weeks after site visit• TNCPE sends Feedback Report to applicant

110

Upcoming Webinars

• Team Leaders (August 2)

• Independent Review (August 7)• for Level 3 and 4 teams @ 11 Central/12 Eastern• for Level 2 teams @ 1 Central/2 Eastern

• Consensus Review (August 28)

• Site Visit Planning (September 18)

• Level 1 (TBD, January 2019)

All webinars will take place at 11 Central/12 Eastern, except as noted above.

111

AssessmentDid you achieve your intention?

Feedback for team placement.

Graduation!

Thank you!“One person with a commitment is worth more than

100 people who have only an interest.”

Mary Crowley

113

Date post:	08-Jun-2020
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times