Transcript Document

Refreshing Your Testing Toolkit
What’s New? What’s Revised? What are You Missing?
Presented by:
Dr. Deirdre Pickerell, CHRP, GCDFi
Life Strategies Ltd.
Setting the
Scene
Getting
Started
Refreshing
My Testing
Toolkit
Agenda
SETTING
THE SCENE
A Pan-Canadian Perspective
Little overlap between what is taught vs. used
Evidence of a “one size fits all” approach
Most commonly used for career exploration and planning
Tool effectiveness impacted selection decisions
Rich mixture of informal and standardized assessments
Interest assessment widely used for career decision-making
FLMM-CDSWG, 2009
Influences on Testing Choices
Proposal requests (RFPs)
Mandates and contracts
Familiarity and habit
Budget
Qualifications
Marketing
Canadian Standards / Guidelines:
Area of Specialization—S1 Assessment
Knowledge
• Describe assessment instruments and methods
Skill
Competencies
• Identify appropriate standardized career
assessments and informal assessment methods
• Explore appropriate instruments and
procedures with clients
• Use standardized career assessments
• Review and evaluate results with clients
Assessment . . .
Processes
Models
Tools/Tests
Types of Assessment Tools/Tests
Informal
•
•
•
•
Checklists
Games
Fantasies
Forced-choice
activities
• Card sorts
• Structured interviews
Formal
•
•
•
•
•
•
Needs
Interests
Skills
Aptitude/Achievement
Work Values
Personal Style
Emerging Approaches to Assessment Tools
Assessment tools are not “magic bullets”
They are useful for …
• Gathering data
• Providing some (not all) pieces of the puzzle
• Exploration vs. prediction
Best practices include engaging the test-taker in
• Choosing what to assess
• Interpreting the results
• Converting test results into goals and action
GETTING STARTED
Before You Start
Test?
No Test?
Testing Considerations
Location
Distraction
Level
Security /
Supervision
Client
Accommodation
Computers
Requirements
Budget and
Mandate
Timeline
• Onsite / Offsite/ Online
• Public vs. private space
• Group vs. individual
• Proctoring
• Physical / Language
• Online / Computer scored
• Consumable vs. Non-consumable
• Funder/employer preferred / program goal
• Administration and scoring
• Interpretation
Qualification Levels
C Level
B Level
A Level
• Unrestricted
• Anyone can
purchase / use
• University training
in tests and
measurements
• Specific training
• Advanced training
/ supervision
• PhD / Registered
Psychologist
Assessment Framework
Reproduced with permission from Career Pathways 2nd Ed.
(Amundson & Poehnell, 2008)
Do You Know What’s Available?
Ask others
• What are your colleagues using? Why?
Look online
• What is available through test publishers?
Bookmark helpful resources
• Publisher websites
• Buros’ Mental Measurements Yearbook
• http://buros.org/mental-measurements-yearbook
Test Publishers
Example:
Research Psychologist Press (Sigma)
 Ashland Interest Assessment
 Career Directions Inventory
 Employee Screening Questionnaire2
 Five-Factor Nonverbal Personality Questionnaire
 Jackson Career Explorer
 Jackson Vocational Interest Survey
 Leadership Skills Profile - Development Report
 Multidimensional Emotional Intelligence Assessment
 Occupational Stress Inventory-Revised
 Personnel Assessment Form
 SIGMA Survey for Police Officers
 Six Factor Personality Questionnaire
REFRESHING MY TESTING TOOLKIT
Considerations…
There are countless assessment tools available
This presentation introduces just a few
• To illustrate a range of test formats and content
• To whet your appetite for further exploration
These are not recommendations or “best picks”
• Many good assessments are not included here
• Some of these assessments may not fit your clients
• A “one size fits all” approach is not recommended
Assessing Skills
Card Sorts
• Motivated Skills (Dick Knowdell)
• SkillScan
Aptitude / General • Multi-Aptitude Battery (MAB)
Intelligence
Achievement /
Grade Level
Emotional
Intelligence
• Wide Range Achievement Test
(WRAT4)
• BarOn Eqi
• MEIA
Motivated Skills Cards
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• Motivated Skills
• Richard L. Knowdell
• n.d.
• Level A
• Card Sort
• Online
• 54
• Workbook / Worksheet also available
Source:
http://career-lifeskills.com/career-assessments-79/knowdell-card-sorts-153/
SkillScan
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• SkillScan
• Lesah Beckhusen
• 2009
• Level A
• Card Sort
• Online
• Professional: 64
• Advanced: 60
Source:
http://career-lifeskills.com/career-assessments-79/skillscan-card-sorts-151/
Transferable Skills Scale
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• TSS
• John Liptak & Laurence Shatkin
• 2011
• Level A
• Paper-and-pencil
• 96
Source: http://career-lifeskills.com/career-assessments-79/jist-assessments150/transferable-skills-scale-tss-10-2425.html
Others
Aptitude
Achievement
Emotional
Intelligence
Multi-Aptitude
Battery-II
Wide Range
Achievement Test
Emotional
Quotient
Inventory 2.0
Kaufman Brief
Intelligence Test
Kaufman Test of
Educational
Achievement
Multi-Dimensional
Emotional
Intelligence
Assessment
Assessing Interests
Holland Self-Directed Search (SDS)
Career Decision-Making System (CDMS)
Career Exploration Inventory (CEI)
Career Directions Inventory (CDI)
Ashland Interest Inventory (AII)
Strong Interest Inventory (SII)
Jackson Vocational Interest Survey (JVIS)
Holland Self-Directed Search
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• SDS
• John Holland
• 1994 (4th ed., Canadian)
• Level A
• Paper-and-pencil
• Online
• 217
Source: http://www.self-directed-search.com/
Career Decision-Making System
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• CDMS
• Arthur J. O'Shea & Rich Feller
• 2008 (Canadian ed.)
• Level A
• Paper-and-pencil
• 120
Source:
http://www.pearsonassess.ca/en/programs/00/63/36/p006336.html?prodCategor
y=psychological-vocational
Career Exploration Inventory (5th ed)
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• CEI
• John J. Liptak
• 2015
• Level A
• Paper-and-pencil
• 128
Source: http://career-lifeskills.com/career-assessments-79/jist-assessments150/career-exploration-inventory-cei-the-5th-edition-11-824.html
Career Directions Inventory
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• CDI
• Douglas N. Jackson
• 2000
• Level A
• Paper-and-pencil
• Online
• 100
Source: http://www.sigmaassessmentsystems.com/assessments/cdi.asp
Ashland Interest Assessment
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• AIA
• Douglas N. Jackson & Connie W. Marshall
• 1997
• A Level
• Paper-and-pencil
• Online
• 144
Source:
http://www.sigmaassessmentsystems.com/assessments/aia.asp
Jackson Vocational Interest Survey
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• JVIS
• Douglas N. Jackson
• 1999
• A Level
• Paper-and-pencil
• Online
• 289
Source:
http://www.sigmaassessmentsystems.com/assessments/jvis.asp
Strong Interest Inventory
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• SII
• E. K. Strong Jr.
• 2012
• B Level
• Paper-and-pencil
• Online
• 291
Source: http://www.psychometrics.com/en-us/assessments/stronginterest-inventory.htm
Assessing Values
Card Sorts
• Planning on Purpose Cards
• Career Values Cards
Surveys
• Work Motivation Scale
• Career Values Scale
Informal
• Informal Work Values Checklist
• Corporate Culture Audit
Planning on Purpose Cards
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• Planning on Purpose
• Hudson Institute
• n.d.
• Level A
• Card Sort
• 66
Source: http://hudsoninstitute.com/product/planning-on-purpose-card-deck/
Career Values Cards
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• Career Values
• Richard L. Knowdell
• n.d.
• Level A
• Card Sort
• Online
• 54
• Workbook / Worksheet also available
Source: http://career-lifeskills.com/career-assessments-79/knowdell-card-sorts153/?zenid=9daa536042de03fe5d703dc1e050898e
Work Motivation Scale
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• WMS
• Robert P. Brady
• 2008
• Level A
• Paper-and-Pencil
• 32
Source: http://career-lifeskills.com/career-assessments-79/jist-assessments150/work-motivation-scale-wms-10-2689.html
Career Values Scale
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• CVS
• Donald MacNab, Shawn Bakker,
and George Fitzsimmons
• 2002
• Level A
• Online
• 88
Source:
https://www.psychometrics.com/en-us/assessments/career-survey.htm
Informal Work Values Checklist
Aesthetics
Belonging
Challenge
Competition
Creativity
Independence
Knowledge
Leadership
Money
People
Publicity
Quality
Stability
Source: Career Strategies for a Lifetime of Success (p. 192)
Informal Corporate Culture Audit
Artefacts
Insider
“Language”
Common
Employee
Traits
Source: Career Strategies for a Lifetime of Success (p. 154)
Assessing Personal Style
Temperament
• Personality
Dimensions
• True Colours
Personality
Type
Five Factor
Models
• Myers-Briggs
Type Indicator
(MBTI)
• Majors
Personality Type
Indicator (PTI)
• Type Focus
• NEO-FFI
• NEO PI-3
• Six Factor
Personality
Questionnaire
(SFPQ)
Other
• Work
Personality
Index
Work Personality Index
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• WPI
• Psychometrics
• 2014
• Level A
• Paper-and-pencil
• Online
• 198
Source:
http://www.psychometrics.com/en-us/assessments/work-personality.htm
Type Focus
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• Type Focus
• David J. Wood
• 1997
• Level A
• Online
• 62
Source: https://www.typefocus.com/beforelogin/why_typefocus
Career Personality Inventory
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• Career Personality Inventory
• John J. Liptak
• 2010
• Level A
• Paper-and-pencil
• 80
Source: http://career-lifeskills.com/career-assessments-79/jistassessments-150/career-personality-inventory-cpi-10-3249.html
True Colours
Acronym
Authors
Date of
Publication
Qualifications
Format
• True Colours
• Don Lowry
• 1978
• Level B
• Paper-and-pencil
• Online
Items
Source: https://truecolorsintl.com/
Personality Dimensions
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• PD
• Lynda McKim
• 2003
• Level B
• Paper-and-pencil
• Online
• Card Sort
• Traits & Characteristics Checklist
• Introversion/Extraversion Quiz
Myers-Briggs Type Indicator
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• MBTI
• Isabel Briggs Myers & Katharine C. Briggs
• 2010
• Level B
• Paper-and-pencil
• Online
• Step I – 93
• Step II - 144
Sources: http://www.psychometrics.com/en-us/assessments/mbti_stepi.htm and
http://www.psychometrics.com/en-us/assessments/mbti_stepii.htm
Majors Personality Type Indicator
Majors Personality Type Elements
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• MajorsPTI & MajorsPTE
• Mark S. Majors
• 2011
• Level B
• Paper-and-pencil (PTI only)
• Online
• MajorsPTI – 52
• MajorsPTE - 127
Source: http://career-lifeskills.com/majors-assessments-145/
Six Factor Personality Questionnaire
Acronym
Authors
Date of
Publication
Qualifications
Format
Items
• SFPQ
• Douglas N. Jackson, Sampo V. Paunonen,
& Paul F. Tremblay
• 2000
• Level B
• Paper-and-pencil
• Online
• 108
Source: http://www.sigmaassessmentsystems.com/assessments/sfpq.asp
Other Tests and Tools (JIST)
Ability Explorer
Interview Style Inventory
Assessing Barriers to Education
Job Search Attitude Inventory
Barriers to Employment Success
Job Search Knowledge Scale
Career and Life Explorer
Job Survival and Success Scale
Career Planning Scale
Military-to-Career Transition Inventory
Career Priorities Profile
Re-Employment Success Inventory
College Survival and Success Scale
Transition-to-Work Inventory
College-to-Career Transition Inventory
Work Activities Matcher
Employability Skills Inventory
Work Readiness Inventory
Other Tests and Tools
ACER Mechanical Reasoning Test
ACER Select Series
Career Beliefs Inventory
Career Factors Inventory
Exam Preparation Inventory
Five Factor Wellness Inventory
Salient Beliefs Review
Style Matters: Kraybill Conflict Style Inventory
Thomas-Kilmann Conflict Mode Inventory
Final Thoughts
Define Your “Client”
Individual
3rd
Party
Referrer
Funder
Get Informed Consent
What is being
done?
How will it
help?
Why?
By whom?
What are the
risks?
What happens
with the
results?
What are my
options?
What happens
if I choose not
to continue?
Know What You Need
Online
•
•
•
•
Manual
Test Codes
Computer
Internet Access
Paper-and-Pencil
•
•
•
•
•
Manual
Assessment Booklets
Record Forms
Templates for Scoring
Worksheets/Workbooks
Think Before You Buy
Is the tool appropriate for my purpose?
Is it a reliable/valid measure?
Am I qualified to administer the tool?
What is the age / reading level?
How long does it take to administer?
How long does it take to score?
Make Sure You . . .
Have a goal
Consider all options
Monitor appropriateness
Consider culture, competency, comfort
Allow sufficient time
Remember
Don’t be wooed by marketing campaigns
• Do your research
• Read the manual
Don’t just rely on the status quo
• Find alternatives
• Go beyond your favourites
Take the tools yourself
Use the most recent version
• Understand the changes that occurred and why