Transcript How to Interpret and Use the O*NET Ability Profiler Results

An O*NET Academy Briefing
How to Interpret the O*NET Ability
Profiler Results
Dr. Janet E. Wall
Senior Trainer, ONET Academy
1
Relax and Enjoy
• Session will be recorded and archived
• Can listen to the session again at
http://www.onetacademy.com
• Can download slides
• Come in with questions as you have
them
2
Part 3 of 3
• 3 part series
– Introduction to the O*NET Tools and the Ability
Profiler (30 July)
– How to Administer the Ability Profiler (31 July)
– How to Interpret the Ability Profiler (1 August)
• After attending all 3 sessions – certificate of
completion
• Any session stands on its own
3
Session 3 - Learning Objectives
•
•
•
•
•
Overview the Ability Profiler (AP)
Describe contents of the AP Score Report
Review percentiles
Overview norms
Overview how AP results are matched to
occupations
• Review occupational information using O*NET
Online
• Discuss example profile
4
Three Instruments
• O*NET Interest Profiler
• O*NET Work Importance
Locator/Profiler
• O*NET Ability Profiler
5
O*NET Career Exploration Tools
Tool
Format
Purpose
O*NET Interest
Profiler
Paper/Pencil
Work-related
Interests
O*NET Interest
Profiler
Standalone or
Network
Work-related
Interests
O*NET Work
Importance Locator
Paper/Pencil
What is Important in
a Job (Values)
O*NET Work
Importance Profiler
Standalone or
Network
What is Important in
a Job (Values)
O*NET Ability
Profiler
Paper/Pencil
What Individual
Can Do Well
(Ability)
6
Proper Use
• Developed only for career exploration, career
counseling
• Not for job selection or selection into job
training programs
• Administered to 1 or more persons
• Paper/pencil only
7
Ability Profiler Overview – 11 tests
• Computation
• Arithmetic
Reasoning
• Vocabulary
• Name Comparison
• Object Matching
• Three Dimensional
Space
•
•
•
•
•
Mark Making
Place
Turn
Assemble
Disassemble
8
Relationship Between Measured Constructs
and AP Exercises
What is Measured/Reported
Exercise/Subtest
Verbal Ability
Vocabulary
Arithmetic Reasoning
Arithmetic Reasoning
Computation
Computation
Spatial Ability
Three-Dimensional
Space
Form Perception
Object Matching
Clerical Perception
Name Comparison
Motor Coordination
Mark Making
Manual Dexterity
Place
Turn
Finger Dexterity
Assemble
Disassemble
9
Tests Administered and Scored
10
Options
• Hand data entry program can be
downloaded from the
www.onetcenter.org website
• Scoring Program and User’s Guide
found on www.onetcenter.org website
11
Score Report (1)
Person’s scores are compared to
general working population – the
norm group.
graphic, numerical and
verbal information
12
Score Report (2)
Reports the
Constructs Measured
– not the subtests
Percentiles
13
What is a Percentile?
Raw No. People Cum Freq Cum Per
1
2
2
0.4%
2
3
5
1.0%
3
5
10
2.0%
4
9
19
3.8%
5
13
32
6.4%
6
22
54
10.8%
7
35
89
17.8%
8
52
141
28.2%
9
68
209
41.8%
10
50
259
51.8%
11
72
331
66.2%
12
65
396
79.2%
13
20
416
83.2%
14
15
431
86.2%
15
14
445
89.0%
16
12
457
91.4%
17
10
467
93.4%
18
9
476
95.2%
19
7
483
96.6%
20
5
488
97.6%
21
6
494
98.8%
22
3
497
99.4%
23
2
499
99.8%
24
1
500
100.0%
25
0
500
100.0%
14
Score Report (3)
Number Correct of Total Items
No number
correct; number
attempted
15
Score Report (4)
Note
16
Norms
• Based on a sample of 4000 people selected to reflect
the distributions of workers in five occupational
categories as per the US Census Bureau
–
–
–
–
–
Professional and Semi-professional
Clerical, Sales, and Kindred Workers
Craftsmen, Foreman, and Kindred Workers
Operatives and Kindred Workers
Laborers (except farm and mine)
17
General Working Population
• Norms developed in 1950s
• Studies show Means and SDs stable over
time (USES Test Report No 148, 1984)
• Sample called the General Working
Population
18
General Working Population (2)
• Sample selected to represent the percent of
population by occupational groupings
– Age Range = 18-54 years
– Mean Education = 11 years
• Males, 10.2
• Females, 11.7
– Gender
• Males, 46%
• Females, 54%
– Supplemented by many additional studies to
include high school students
– See General Aptitude Test Battery, Development
19
Report, Section III for details
Linking GATB Norms to the AP
• Equating study performed between GATB
and AP
• Results sufficiently similar between GATB
and AP so that the general working
population norms could be used (Segall and
Monzon, 1995)
20
Score Report (5)
21
Score Report (6)
22
Score Report (7)
23
Selecting a Job Zone
24
Occupational Reports
• Five occupational listings are generated, one
for each job zone
25
Job Zone 1 Occupations
26
Job Zone 2 Occupations
27
Job Zone 3 Occupations
28
Job Zone 4 Occupations
29
Job Zone 5 Occupations
30
Match Profile to
Occupational Information (1)
• Occupational Ability Profiles (OAPs) were
created for each of the 950+ O*NET
occupations (see available development
report for more detail)
• Ability scores of job incumbents (1000+ jobs)
along with information from the DOT (e.g.,
data, people things; SVP) were used to
estimate the 9 ability scores for each
occupation
• Occupation profiles were converted to the
existing O*NET/SOC classification system
31
Match Profile to Occupational
Information (2)
• Person’s ability profile is matched to
occupational profile
– Using index of similarity (correlation)
• Shape of the profile matters, not the level or
percentile
• Minimum of 10 occupations are generated for
each job zone
– up to 25 if they are “strong matches”
– correlation cutoff depends on number of AP
subtests taken
32
Score Report (8)
Based on list of occupations, the
client selects one job from Job
Zone 1 and two from Job Zone 3
33-2021.01
41-2031.00
41-3011.00
Fire Inspector
Retail Salesperson
Advertising Sales Agent
33
Exploring an Occupation
• Select occupation to explore
• Example: Fire Inspectors, Job Zone 3
• Go to O*NET ONLINE
– http://online.onetcenter.org
34
35
36
37
38
39
40
41
42
43
44
Discussion – Joe Luwis
45
Questions/Comments
46
O*NET AP Administrators Training
Tools available on O*NET Academy
• Online Self-Assessment Quiz !
Gauge your understanding of what it takes to
successfully administer the Ability Profiler .
• Downloadable Lunch and Learn Training Packet
Includes PowerPoint Slides, FAQs, Administrator
Checklist, and Scenarios for Group Discussion
www.onetacademy.com
• Check out www.onetcenter.org for more
information
47
Supporting Webinars
• How to Download and Use the O*NET Interest Profiler
and Work Importance Profiler
• Overview of the O*NET Ability Profiler
• How to Administer the O*NET Ability Profiler
• How to Interpret the Ability Profiler
• O*NET for Job Seekers and Students
• New Enhancements to O*NET
• O*NET Tools for School Counselors
• O*NET Tools for Military in Transition
• Links between Occupations, Education, and Pay
48