+ All Categories
Home > Documents > 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin...

1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin...

Date post: 25-Dec-2015
Category:
Upload: paul-johnson
View: 217 times
Download: 0 times
Share this document with a friend
Popular Tags:
93
1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment and Training Administration, DOL May 4, 2011
Transcript
Page 1: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

1

Overview of O*NET Data Collection and Activities

OIDAP Meeting

Phil M. LewisDavid R. Rivkin

National Center for O*NET Development

Pam FrugoliEmployment and Training Administration, DOL

May 4, 2011

Page 2: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

2

Goals of the Update Briefing

• Overview of O*NET Project

• Data Collection Program– Address OIDAP Questions

• Products & Tools

• O*NET Users

• Special Projects

Page 3: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

3

OIDAP Questions

• Please describe how the O*NET data collection strategy builds upon the BLS Occupational Employment Statistics (OES) database.

• Are you still using Dun & Bradstreet data to find establishments? Were OES data not able to accomplish this, or is it an efficiency issue?

• What was the original balance between the Establishment Method and the Occupational Expert Method for populating the O*NET database? Has that changed now that you are in maintenance mode? How are the occupational experts identified?

• Can you describe the role of the state workforce development offices in data collection for O*NET? Has this changed over time?

• Why did O*NET decide not to use field analysts to collect the data on occupations?

Page 4: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

4

OIDAP Questions (cont.)

• What are the major challenges associated with identifying employees in specific occupations to observe in the field?

• How do Detailed Work Activities differ from Generalized Work Activities in the O*NET? How were they empirically derived?

• We understand that a rule of thumb for statistical sufficiency was set at 15 observations for each domain. Are you still satisfied with that number?

• Are you planning any changes in procedure or content as a result of the recent review of O*NET by the National Research Council?

• How might your sampling parameters change if the results were subject to legal challenge?

• What advice do you have for SSA as they begin to develop an OIS for disability adjudication purposes?

Page 5: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

5

Overview of O*NET Project

Page 6: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

6

Why O*NET?

1980 Work, Jobs, and Occupations: a Critical Review of the Dictionary of Occupational Titles (National Research Council)

1993 Final report of the Advisory Panel on the DOT (APDOT)

1999 The Changing Nature of Work: Implications for Occupational Analysis

2000 O*NET Data Collection Program Survey Pretest

2001 Official OMB approved O*NET data collection using the O*NET survey questionnaires initiated

Page 7: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

7

O*NET Project Team

• U.S. Department of Labor, Employment & Training Administration

• National Center for O*NET Development– North Carolina Employment Security

• RTI; MCNC; HumRRO; NC State University; Maher & Maher

Page 8: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

8

National Center for O*NET Development

– Data Collection– Dissemination– Implementation– Research and Development– Technical Assistance/Customer Support

Page 9: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

9

What is O*NET?

• A “common language” and dynamic system for describing the world of work for both the public and private sectors

• A comprehensive system for collecting and disseminating information on occupational and worker requirements

Page 10: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

10

What is O*NET?

• Flexible competency-based system with emphasis on skills transferability

• Framework for organizing job and worker information

• Data on occupations covering the entire U.S. Economy

Page 11: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

11

What is O*NET?

• Uses information technologies to facilitate the collection, storage, and distribution of quality data

• A resource for businesses, educators, job seekers, HR professionals, and publicly funded government programs

Page 12: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

12

• The O*NET-SOC Occupational Taxonomy

• The O*NET Content Model

O*NET Structure

Page 13: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

13

• SOC mandated by US Office of Management and Budget

• Developed by multi-agency initiative

SOC and O*NET-SOC

Page 14: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

14

Key characteristics of U.S. SOC

• Structured for comparability

• Unified classification structure

• Four hierarchical levels to enable data collectors to choose a level of detail corresponding to their needs and ability to collect data on different occupations

Page 15: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

15

• O*NET-SOC is a SOC based classification that provides a greater level of detail as needed – O*NET-SOC 2010 taxonomy released December 2010– Currently data collected on 974 O*NET-SOCs

• Adds 269 more specific occupations– New and emerging– Different tasks and KSAs

SOC and O*NET-SOC

Page 16: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

16

O*NET Content Model

Page 17: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

17

Worker CharacteristicsAbilitiesInterests

Work Styles

Worker CharacteristicsAbilitiesInterests

Work Styles

AbilitiesCognitive

PsychomotorPhysicalSensory

AbilitiesCognitive

PsychomotorPhysicalSensory

CognitiveVerbal

Idea Generation & ReasoningQuantitative

MemoryPerceptual

SpatialAttentiveness

CognitiveVerbal

Idea Generation & ReasoningQuantitative

MemoryPerceptual

SpatialAttentiveness

VerbalOral Comprehension

Written ComprehensionOral Expression

Written Expression

VerbalOral Comprehension

Written ComprehensionOral Expression

Written Expression

Content Model: Sub-Domains

http://www.onetcenter.org/content.html

Page 18: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

Scales ReferenceScales Reference

Survey Booklet LocationsSurvey Booklet Locations

Educ, Trng & ExpEduc, Trng & Exp

Level Scale AnchorsLevel Scale Anchors

KnowledgeKnowledge

Job Zone ReferenceJob Zone Reference

Job ZonesJob Zones

Occupation DataOccupation Data

InterestsInterests

Work ContextWork Context

Work ActivitiesWork Activities

Work Context CategoriesWork Context Categories

Educ, Trng & Exp Categories

Educ, Trng & Exp Categories

Work StylesWork Styles

SkillsSkills

O*NET 15.1Database

Occupation Level MetadataOccupation Level Metadata Work ValuesWork Values

Content Model ReferenceContent Model Reference

AbilitiesAbilities

Supplemental Files

• Related Occupations• Crosswalks• Detailed Work Activities• Emerging Tasks• Lay Titles• Tools and Technology• O*NET-SOC 2000 to

O*NET-SOC 2006• Tasks (Release 5.1 File

Layout)• Work Needs

The O*NET Database: Version 15.1

• Occupation data

– Cross-Occupational + Occupation Specific

– 230+ variables

– Importance, level, frequency

– @ 500 ratings per occupation

– @ 3500 metadata per occupation

• Crosswalks• Detailed Work Activities• Emerging Tasks• In-Demand Occupations• Lay Titles• Related Occupations• Tools and Technology• Work Needs

• Crosswalks• Detailed Work Activities• Emerging Tasks• In-Demand Occupations• Lay Titles• Related Occupations• Tools and Technology• Work Needs

Task CategoriesTask Categories

Task RatingsTask Ratings

Task StatementsTask Statements

Page 19: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

19

Occupational Level Statistics• O*NET-SOC Establishment Response

Rate• O*NET-SOC Employee Response

Rate• O*NET-SOC Case Completeness Rate• Total Completes for O*NET-SOC

Occupational Level Distribution Statistics• Data Collection Mode• Current Job Tenure• Industry

The O*NET Database: Metadata

Ratings Level Statistics• Confidence Intervals

– Lower and upper 95% bounds

• Standard Deviation

• Standard Error

• Sample Size

• Flags

– Not Relevant for the Occupation

– Recommended Suppression

Page 20: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

20

• 874 occupations– Comprehensive data– 359 second update

• 100 occupations– Description, task list, lay titles– Majority also have interests, work values, and tools & technology

O*NET Data Availability

Page 21: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

21

• New database released annually– Minimum of 100 occupations updated

• Average currency of all occupations = 2.59 years• Priority established by DOL

– Maximum 5 years-old– Bright Outlook– Green occupations – Linked to technology, math, and science, computers, engineering,

and innovation

O*NET Data Publication Goals

Page 22: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

22

O*NET Data Currency

Data Currency Across O*NET-SOC Occupations

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

0-1 years: 2-2.5 years: 3-3.5 years: 4-4.5 years 5 years or more

Number of Years Since Published

Perc

en

tag

e o

f O

ccu

pati

on

s

Page 23: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

23

O*NET Data Collection Program

Page 24: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

24

O*NET Data Collection Overview

• Proven successful and cost effective methodology designed to collect and yield high quality occupational data

• Multi-method approach to provide flexibility within a framework of standardized procedures

– Establishment, Occupational Expert, Supplemental Frames, Analyst Ratings, Web-Based

• Minimizes public burden and costs

• Approved by Office of Management & Budget (OMB)

Page 25: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

25

• Continuous data collection since June 2001– Three successful OMB Clearances

• Comprehensive update by job incumbents and occupational experts of the 2006 O*NET-SOC Taxonomy

• Transition to 2010 O*NET-SOC– New & Emerging occupations

• Unparalleled partnership between Department of Labor and private/public community

• 40,000+ business/organizations• 160,000+ job incumbents/experts• 450+ National Associations

O*NET Data Collection Overview

Page 26: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

26

Data Collection Overview (cont.)

• High quality data from a national sample of job incumbents/occupational experts– Strong business participation

• 76% plus response rate

– Strong employee participation• 65% plus response rate

– Strong occupation expert participation• 82% response

Page 27: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

27

Data Collection Overview (cont.)

• Web-based case management system used to control all sampling and data collection systems

– Case management, BL contacts with establishments, questionnaire and informational mailings, questionnaire processing, inventory control, etc.

• Finely tuned procedures, systems and infrastructure capable of surveying multiple occupations simultaneously

– Capability developed, tested, and enhanced over 11 years

Page 28: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

28

Sources of Occupational Data

• Job Incumbents and Occupation Experts

– Education, Job Titles, Knowledge, Tasks, Work Activities, Work Context, Work Experience, Work Styles

• Occupation Analysts

– Abilities, Skills

• Web-based Research

– Detailed Work Activities, Green, Tasks, Tools and Technologies (T2)

Page 29: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

29

Establishment Method

• Two stage sample

– Business establishments - POC

– Job incumbents within business establishments

Page 30: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

30

Establishment Method (cont.)

• Job incumbents complete one of three survey questionnaires (25 -30 minutes)– Generalized Work Activities,

Knowledge/Work Styles, or Work Context – Task List– Background Info

• Incumbents choose response option– Paper-and-pencil– Web-based (approximately 25%)

Page 31: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

31

Design of Collection Waves

• Identify ~50 primary occupations to target in a sample wave – Wave X.1: Designed to get 34% of sample– Wave X.2: Designed to get 33% of sample– Wave X.3: Designed to get 33% of sample– Wave X.4: Sample residual

Page 32: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

32

Design of Collection Waves (cont.)

• Each wave is a cluster of similar occupations– Secondary occupations which are found across

industries are also included to maximize efficiency

• Multiple sub-waves allow for greater precision– Locating occupations– Controlling public burden and project resources

Page 33: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

33

Stage One Sampling

• OES data from BLS used to determine the initial industry distribution for each occupation

• Sample business establishments selected from database of business locations

Page 34: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

34

Stage One Sampling (cont.)

• OES data from BLS used to determine the initial industry distribution for each occupation– Indicates which industries occupations are employed in

and the share and distribution of occupational employment across industries

– Does not contain information on establishments

Page 35: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

35

Stage One Sampling (cont.)

• Industry information for each occupation is refined by O*NET Center analysts– Review and face validity checks

• For example, religious institution sub-section removed from service industry if sampling for bartenders

– Determine industries to include based on overall distribution and population coverage goals

– Refined/target by experience from previous updates, when available

Page 36: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

36

Stage One Sampling (cont.)

• Sample business establishments selected from a frame of business locations

– Dunn & Bradstreet (D&B) database• ~15 Million establishments

• Info obtained from multiple sources– Tax records, credit reports, telephone directories

• Updated continuously on a monthly basis

• Links to SIC and NAICS industry information

Page 37: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

37

Population Coverage

• Gather data on the “core” of the occupation– Where the majority of incumbents

employed

– Average coverage level is 85%

Page 38: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

38

Population Coverage (cont.)

Population Coverage for Occupations Collected Via Establishments

0.79%

15.33%

8.78% 9.70% 9.17%

56.23%

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

< 50% 50%-60% 60%-70% 70%-80% 80%-90% 90%-100%

Percent Occupations by Population Coverage Level

Pe

rce

nt

of

Oc

cu

pa

tio

ns

Page 39: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

39

Stage Two Sampling

• Led by highly qualified O*NET Business Liaisons (O*NET BL)– Full time staff working in dedicated call center– Educational and work experience criteria higher than typical

telephone interviewer

• The sampled establishment’s Point-of-Contact (POC) works with the O*NET BL to identify the a list of eligible employees

• Identification Profiles (ID Profile) are used when asking POC if occupations are present– Helps ensure accuracy in matching employees to occupations

Page 40: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

40

Stage Two Sampling (cont.)

• Automated, random selection of job incumbents from the POC’s eligible list

• Limits placed on POC burden– No more than 5 occupations sampled– Never more than 20 employees selected– Can only be included within the data collection once each year

• Selected employees– Asked to complete the questionnaire on their own time– Responses remain anonymous and confidential from both the employer and the

public• Complete via the web or mail back directly• All individual identifiers removed

Page 41: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

41

Model-Aided Sampling (MAS)

• Innovative sampling approach that reduces data collection cost and burden to the public by preventing occupations from greatly exceeding their targeted sample – Builds on existing sampling paradigms: traditional and model

based– For each occupation, a targeted sample size for specific

demographic domains is modeled• Census region • Establishment size • Industry division

• Data collection is halted in a MAS cell when the targeted respondent sample size is projected to be achieved

Page 42: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

42

Summary of Establishment Method Sample Selection Process

42

Page 43: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

43

Establishment Method Data Collection Protocol

43

Page 44: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

44

Other Key Features

• Incentives

– Employer • Toolkit for Business

– POC• Clock, Certificate of Appreciation

– Employee• $10

• Outreach to professional/trade associations increase awareness– Endorsement list provided to POC

Page 45: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

45

Supplemental Frame Method

• Multiple strategies to augment the establishment data collection– Supplemental Frame Incumbent

• Job incumbents are directly accessed via an association listing to complete the data collection

– e.g. Industrial Organizational Psychologists – Supplemental Frame Establishment

• Targeted employer sample developed via expert contact/associations where the sampling frame coverage is significantly high but is not adequate by itself

– e.g. Freight and Cargo Inspectors– Special Frame Establishment

• Targeted employer sample completely developed via expert contact/associations where coverage is extremely high

• Normal establishment method is bypassed– e.g. Nuclear Power Reactor Operators; Flight Attendants

Page 46: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

46

Occupational Experts (OE) Method

• Used when occupation is difficult to locate in establishments– Small employment size – Job incumbents inaccessible due to work in

remote locations – New and emerging occupations

Page 47: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

47

OE Method (cont.)

• Data collected from experts in target occupation– Supervisors, trainers, others with extensive knowledge of

occupation

• Identify appropriate source organizations (e.g. professional associations)– Good coverage of occupation– Can identify members who are occupation experts– Willing to provide lists of experts

47

Page 48: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

48

OE Method (cont.)

• Select sample from membership lists

• Contact, screen, and survey OEs directly – no establishment or POC

• OEs complete all three domain questionnaires, background and task questionnaires

• OE incentives – clock, Certificate of Appreciation, $40

48

Page 49: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

49

OE Method DataCollection Protocol

49

Page 50: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

50

Analyst Ratings Method

• Occupational Analysts Rate the Ability and Skill

Domains

– Updated occupation information collected from job

incumbents used to describe occupation and assist

with the rating process

– Extensive training and quality assurance procedures

Page 51: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

51

Analyst Rating Process

Prepare Stimulus Materials

Prepare Stimulus Materials

Select AnalystsSelect

Analysts

Train AnalystsTrain

AnalystsDistribute Stimulus

MaterialsDistribute Stimulus

Materials

Collect RatingsCollect Ratings

Provide Analyst Feedback

Provide Analyst Feedback

Analyze DataAnalyze Data

Create FinalDatabase

Create FinalDatabase

Receive New Incumbent DataReceive New

Incumbent Data

Page 52: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

52

Stimulus Material• Occupation title and definition • Job Zone • Important knowledges • Mean importance of core and supplementary tasks• Mean importance of GWAs that:

– Mean > 3.0 for occupation– Require the targeted ability/skill to be performed

• Mean rating of work context statements that:– Mean > 3.0 for occupation

– Require the targeted ability/skill to work in that context

Page 53: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

53

Data Collection

• Two groups of eight analysts• Both groups first given same 10 occupations• Rate importance and level of 52 abilities and 35

skills• Ratings compared and discussed if warranted• Batches of five occupations/week; different

occupations to each group of 8

• Evaluate agreement (SEM); facilitate discussion if SEM > .51 for importance

Page 54: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

54

Analysts Qualifications

• 16 Trained Analysts• 5 + years work experience

– Currently work for diverse organizations • Marriott, FedEx, SAS, DDI

– Not internship, assistantship or summer job

• Masters or PhD degree in I/O psychology, vocational psychology, human resources (business department) or industrial relations– Graduate level job analysis course (or something comparable)– Graduate level research methods course (or something

comparable)

Page 55: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

55

Analyst Training

• 1 ½ days• Hands-on exercises, quizzes, and rating

practice

Module 1: History of O*NET

Module 2: Overview of Stimulus Materials

Module 3: Making Your Ratings

Module 4: Recording Your Ratings

• Refresher training

Page 56: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

56

Web-Based Method

• Trained analysts collect and process more specific occupational information from industry, professional, labor, and educational organizations– Scan internet for existing information linked to O*NET-SOC – Collect tasks and detailed information– Compile data, analyze data/expert review– Organize using standardized taxonomies– Generate final output

Page 57: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

57

Special Projects

Page 58: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

58

Revision of Data Collection Instruments

• Variety of cognitive methods used to evaluate the content and design of the initial O*NET data collection surveys– Expert evaluation (cognitive forms appraisal)– Expanded interviews with individual respondents– Focus group interviews

• Results led to significant enhancements to the instruments while maintaining comparability to the theoretical underpinnings of the variables and taxonomies, as well their psychometric qualities– Simplification of instructions and layout– Reduction in the number of items and scales per item– Wording changes to specific variable definitions

• Current item response rate range 96-99%

http://www.onetcenter.org/reports/Data_appnd.html

Page 59: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

59

O*NET Integration Projects

• Occupational Code Assignment– Formal request of an assignment of a job/occupation to the O*NET-SOC Taxonomy

• Lay titles– 50,000+ titles– Average of 57 titles linked per occupation

• Crosswalks– Military Occupational Classification (MOC)– Registered Apprenticeship Partners Information Data System (RAPIDS)– Classification of Instructional Programs (CIP)– Dictionary of Occupational Titles (DOT)– Standard Occupational Classification (SOC)

• O*NET Online Applications– Browse by Career Cluster– Browse by Bright Outlook– Browse by Industry– Browse by Job Family– Browse by Science Technology Engineering & Math (STEM)

• O*NET Occupation Browser– CD-ROM based version of O*NET Online – Designed for organizations serving populations with little to no access to the internet

Page 60: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

60

O*NET Career Exploration Tools

Tool Format Purpose

O*NET Interest Profiler (IP) Paper/Pencil Work-related Interests

O*NET Computerized Interest Profiler (CIP)

Standalone or Network

Work-related Interests

O*NET Work Importance Locator (WIL)

Paper/PencilWhat is Important in a Job (Values)

O*NET Work Importance Profiler (WIP)

Standalone or Network

What is Important in a Job (Values)

O*NET Ability Profiler (AP) Paper/PencilWhat Individual Can Do Well (Ability)

http://www.onetcenter.org/tools.html

Page 61: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

61

Tools and Technology (T2)

• Machine, Equipment, Tools, and Software workers must be able to use for optimal functioning in a high performance workplace

– This is what employers refer to as “Hard Skills”

– Emphasis placed on cutting edge technologies and emerging workplace practices

http://online.onetcenter.org/link/summary/17-2081.00

Page 62: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

62

Tools and Technology (T2)

• 620 occupations populated– All green occupations

• 43,000 objects

• 76 objects per occupation on average– Range = 12-300

Page 63: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

63

T2 Development

• Internet based data collection– Build on previous O*NET project tasks (i.e.,

task development)– Trained analysts

• Strong proficiency in Internet searching procedures• Strong background and training in occupational

analysis

Page 64: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

64

T2 Development (cont.)

• Data classification– United Nations Standard Products and Services Code

classification system (UNSPSC)

• Quality control • Customer input

– Feedback via O*NET Online & O*NET Resource Center http://www.onetcenter.org/t2/

– Transactional analysis of DOL’s Job Description Writer

Page 65: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

65

O*NET New & Emerging (N &E) Project

• 154 New & Emerging Occupations Identified– Significantly different work from existing O*NET-SOCs– Not adequately reflected in current classification– Significant employment– Positive projected growth rate– Education, credentialing, certification programs– Related professional associations

http://www.onetcenter.org/reports/NewEmerging.html

Page 66: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

66

O*NET N & E Project (cont.)

– Advanced Manufacturing– Aerospace– Automotive– Biotechnology– Construction– Education– Energy– Financial Services– Geospatial Technology

– Green– Health Care– Homeland Security– Hospitality– Information Technology– Nanotechnology– Retail– Transportation

• Investigated 17 In-Demand Industries

Page 67: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

67

O*NET N & E Project (cont.)

• Extensive Web Search Conducted by Trained Occupational Analysts:– Industry Associations and Organizations– Educational Programs– Job posting sites

• Information Gathered, Documented, and Detailed Criteria for Inclusion Applied

Page 68: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

68

• Trained occupational analysts conduct extensive web searches to investigate each industry– Background of industry (i.e., when industry started

changing)– Major innovations in industry– Employment trends– New products– Government regulations (e.g., Automotive Emissions

Standards)

O*NET N & E Project (cont.)

Page 69: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

69

37 New Health Care O*NET-SOCs• 13-1199.02 Patient Representatives• 19-3039.01 Neuropsychologists and Clinical

Neuropsychologists• 21-1019.01 Genetic Counselors• 29-1069.01 Allergists and Immunologists• 29-1069.02 Dermatologists• 29-1069.03 Hospitalists• 29-1069.04 Naturopathic Physicians • 29-1069.05 Neurologists• 29-1069.06 Nuclear Medicine Physicians• 29-1069.07 Ophthalmologists• 29-1069.08 Pathologists• 29-1069.09 Physical Medicine and Rehabilitation

Physicians• 29-1069.10 Preventive Medicine Physicians• 29-1069.11 Radiologists• 29-1069.12 Sports Medicine Physicians• 29-1069.13 Urologists• 29-1129.01 Low Vision Therapists, Orientation and Mobility

Specialists, and Vision Rehabilitation Therapists• 29-1199.01 Acupuncturists• 29-1199.02 Informatics Nurse Specialists• 29-1199.03 Acute Care Nurses• 29-1199.04 Advanced Practice Psychiatric Nurses

• 29-1199.05 Clinical Nurse Specialists• 29-1199.06 Critical Care Nurses• 29-1199.07 Nurse Anesthetists• 29-1199.08 Nurse Practitioners• 29-2099.01 Cytogenetic Technologists• 29-2099.02 Cytotechnologists• 29-2099.03 Electroneurodiagnostic

Technologists• 29-2099.04 Hearing Instrument Specialists• 29-2099.05 Histotechnologists and

Histologic Technicians• 29-2099.06 Ophthalmic Medical

Technologists and Technicians

• 29-2099.07 Orthoptists• 29-2099.08 Nurse Midwives• 29-9099.02 Midwives• 31-9099.01 Anesthesiologist Assistants• 31-9099.02 Endoscopy Technicians• 31-9099.03 Speech-language Pathology

Assistants

Page 70: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

70

Greening of the World of Work

• Investigated the implications for the O*NET System- Current O*NET-SOC Taxonomy

- N & E Occupations

• “Green Economy” economic activity related to reducing the use of fossil fuels,

decreasing pollution and greenhouse gas emissions, increasing the efficiency of energy usage, recycling materials, and developing and adopting renewable sources of energy.

Page 71: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

71

Green Economy Sectors

• Renewable Energy Generation • Transportation• Energy Efficiency• Green Construction• Energy Trading• Energy and Carbon Capture• Research, Design, and Consulting Services• Environment Protection• Agriculture and Forestry • Manufacturing • Recycling and Waste Reduction• Governmental and Regulatory Administration

Page 72: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

72

Greening of Occupations

• The extent to which green economy activities and technologies increase the demand for existing occupations, shape the work and worker requirements needed for occupational performance, or generate unique work and worker requirements

Page 73: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

73

Greening of Occupations (cont.)

• Green Increased Demand Occupations: – increase in the employment demand for an existing occupation– changes in work context– few if any significant changes in work (tasks) and worker requirements of the

occupation

• Green Enhanced Skills Occupations: – significant changes in work and worker requirements– essential purposes of the occupation remain the same, but tasks, skills,

knowledge, and external elements, such as credentials, have changed– may or may not result in an increase in employment demand for the occupation

• Green New & Emerging Occupations: – impact of green economy activities and technologies creates unique work and

worker requirements, which results in the generation of a new occupation relative to the O*NET taxonomy.

– The new occupation could be new or “born” from an existing occupation

Page 74: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

74

O*NET Green Results

• Green Increased Demand Occupations:

– 64 O*NET-SOC occupations• Geological and Petroleum Technicians; Locomotive Engineers;

Architectural Drafters; Chemists; Natural Science Mangers; Agricultural Inspectors

• Green Enhanced Skills Occupations: – 60 O*NET-SOC occupations

• Power Plant Operators; Electrical Engineers; Heating and Air Conditioner Mechanics and Installers; Roofers; Nuclear Engineers; Construction Managers; Farmers and Ranchers; Hazardous Materials Handlers

Page 75: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

75

O*NET Green Results (cont.)

• Green New & Emerging Occupations: – 91 N & E Occupations (13 waitlisted)

• Logistic Engineers, Fuel Cell Engineers, Energy Auditors, Precision Agriculture Technicians, Photonics Engineers, Robotics Technicians, Manufacturing Engineering Technologists

• Wind Turbine or Farm Engineers, Wind Turbine Service Technicians, Biofuels Plant Operators, Solar Power Plant Technicians, Solar Sales Representatives/Assessors, Weatherization Technicians/Installers, Carbon Credit Traders

Page 76: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

76

Detailed Work Activities (DWAs)

• Detailed job behaviors required across multiple occupations

• More detailed and more specific to a finer set of occupations than Generalized Work Activities (GWAs)

• Linked to and organized by GWAs

• Less specific than unique occupation tasks

• 2000+ statements• 30,000+ linkages

Page 77: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

77

Original DWA Development• 2000 to 2002

• Original statements developed to help clients perform skills matching• Oregon State

• Classification of Instructional Programs, OES data, DOT data• Transactional data from employers in Oregon

• Statements linked to O*NET occupations, new statements added to increase coverage, increase consistency, reduce redundancy

• Labor Exchange Skills Project sponsored by DOL• Rational review by occupational analysts

• Further refinement and enhancement of statements• National Center for O*NET Development

• Rational review by occupational analysts

Page 78: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

78

Current DWA Project

• Develop new DWAs statements with direct linkages to tasks statements and GWAs

• Occupational analyst rating project• Builds on previous database

• Identify new Green and Healthcare related DWAs

• Populate the 2010 O*NET-SOC taxonomy • O*NET New and Emerging occupations• Other new occupations and changes

Page 79: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

79

Spanish Translations of O*NET Questionnaires

• Now available along with the previously available generic, customizable versions in English

• Can be used as a starting point to collect occupational data in support of a wide range of economic/workforce investment activities and human resource management functions

• http://www.onetcenter.org/questionnaires.html

Page 80: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

80

O*NET Toolkit for Business

• Information of the features of O*NET and its many uses for human resource professionals and businesses

• On-screen and print version

http://www.onetcenter.org/toolkit.html

Page 81: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

81

O*NET Products & Tools

Page 82: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

82

• Where Can O*NET Products & Tools be found?– O*NET Resource Center (www.onetcenter.org)

• Databases• Classification & Crosswalks• About O*NET & O*NET Content Model• Career Exploration Tools

– Incorporated within Private, Not-for-Profit, and Government tools and systems

O*NET Products & Tools

• Toolkit for Business• Questionnaires• Research & Technical Reports• Links to Related Sites

Page 83: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

83

• O*NET Database (www.onetcenter.org)– Core Database– Supplemental Files (e.g., lay titles, DWAs, crosswalks)– Production versus Development

• O*NET OnLine (www.onetonline.org)– Variety of search options– Detailed occupation information

• My Next Move (www.mynextmove.org)– Easy-to-use search and career overviews– Web-based Interest Profiler

• O*NET Code Connector (www.onetcodeconnector.org) – Occupational coding assistant

O*NET Products & Tools

Page 84: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

84

• O*NET Career Exploration Tools– Interest Profiler– Work Importance Profiler/Locator– Ability Profiler

• Training and E-Learning (http://www.onetacademy.com/)– 60,000+ registered participants

• Technical Assistance– Testing & Assessment Guides– Implementation guidance

• Customer Service– [email protected]

O*NET Products & Tools (Cont.)

(www.onetcenter.org)

Page 85: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

85

ProductNumber of Downloads

Database 82,968

Career Exploration Tools

Ability Profiler 173,744

Interest Profiler 201,085

Work Importance Locator 96,409

Computerized IP, WIP 142,128

Total Career Exploration Tools 613,366

Other (e.g., Toolkit for Business) 134,434

TOTAL O*NET PRODUCTS 830,768

O*NET Downloads Jan 2002 – Dec 2010

O*NET Widespread Use

Page 86: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

86

O*NET Online

average visits per month 1.1 million

linked sites 14,496

O*NET Resource Center

average visits per month 305,000

linked sites 4,223

O*NET Code Connector

average visits per month 63,000

linked sites 1,585

TOTAL VISITS PER MONTH 1.4 million +

TOTAL LINKED SITES 20,304

O*NET Website Statistics - 2010

O*NET Widespread Use (cont.)

Page 87: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

87

Students and Youth

Educators

HR Professionals

Employers

Training Specialist

s

Government Officials and Policy Makers

Job Seekers

Career Counselors

Researchers

Who uses O*NET?

MilitaryInternation

al

Community Developme

nt

Page 88: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

88Sample of O*NET Users • Manpower• Microsoft• American Foundation for the Blind• Booz, Allan, & Hamilton• IBM• ACT• Torque• Bill and Melinda Gates Foundation• The Boys and Girls Club of American• Catholic Community Services• Community Preservation and

Development Corporation• Arizona State University CRESMET

Center• Colorado State University Department

of Psychology• Harvard Business School • Lehigh Carbon Community College• Temple University• Seattle Washington Public School• Army Research Institute• Federal Reserve Bank of New York• U.S. Navy• U.S. Department of Defense

• National Institutes for Health• Alabama Department of Rehabilitation• California Employment Development

Department• Connecticut Department of Labor• U.S. Department of Labor, Employment

and Training Administration• Main Department of Labor• NCESC—Job Connector• State of Montana Human Resources

Division• Texas Labor Market and Career

Information Department• USAID • Cornell University• Canadian International Education

Development Company• E-Career Guidance.Com (Ireland)• NKOKA (South Africa)• Technical Education and Skills

Development Authority (Philippines)• JNET ( Japan)• U21 Global (includes 21 Universities in

11 countries)• UK Commission for Employment and

Skills (United Kingdom)

Page 89: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

89

• Human Resources Personnel• Business Forecasters• Industry Analysts• Organizational Consultants• Workforce and Economic Development

Specialists• Curriculum Developers • Researchers

Employers Using O*NET

Page 90: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

90

• Career exploration

• Career development

• Job search

• Employment transitions

Individuals Using O*NET

Page 91: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

91

Department of Labor Employment & Training Administration

• mySkills myFuture• America’s Career InfoNet and

CareerOneStop E-Tools• Foreign Labor Certification• Apprenticeship

Page 92: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

92

One-Stop Partners:

• Career Counselors• Interviewers• Rehabilitation Counselors• Veterans’ Representatives• Training Providers• Business Consultants

Page 93: 1 Overview of O*NET Data Collection and Activities OIDAP Meeting Phil M. Lewis David R. Rivkin National Center for O*NET Development Pam Frugoli Employment.

93

Questions, Feedback, Additional Input?

www.onetcenter.orgonline.onetcenter.org

orCustomer Service

National Center for O*NET Development:e-mail: [email protected]


Recommended