Transcript Needs Assessment: Asking and answering the right questions

Needs Assessment: Collecting
information, making decisions, and
accomplishing results
Ryan Watkins, Ph.D.
George Washington University
Maurya West Meiers
WBI Evaluation Group
Presentation to the
Knowledge and Learning Board
Dec. 11, 2007
Needs Assessments Help Us…





2
Collect useful information that can inform our
decisions
Link the results we want to accomplish to our
decisions about “what to do”
Consider our alternatives and options
Verify that our activities will lead to desired results
Create consistency in decision making by
implementing systematic processes
Needs Assessments Help Us Avoid…





3
“What we really need is training on XYZ.”
“But that is the way we have always done it
here.”
Training that isn’t aligned with World Bank
priorities
Solutions in search of problems
Answers that are simple, straightforward,
acceptable, understandable… and yet wrong
Why Needs Assessment
4

Provides a systematic process to guide
decisions.

Provides justification for decisions before
they are made.

It is scalable for any size project, time frame,
or budget.

Offers a replicable model that can be applied
by novices or experts.

Provides a systemic perspective for decision
makers.

Allows for interdisciplinary solutions for
complex problems.
Many Needs Assessments

Disciplines
–
–
–
–
5
Medical (Health) Needs Assessments
Community Needs Assessments
Organizational Needs Assessments
Individual-Decision Needs
Assessments
Three Types of Organizational Needs
Assessments

Strategic Needs Assessment
–
–

Tactical Needs Assessments
–
–

Focus on organizational performance and contributions
Alignment of organizational objectives with programs and projects
Operational Needs Assessments
–
–
6
Focus on needs of those external to the organizational (e.g.,
clients, communities, countries)
Alignment of societal goals with organizational objectives
–
Focus on individual or team performance
Alignment of program and projects with individual or team
performance objectives
Guide the development of pragmatic learning plans
Needs Assessments and Results Chains
Current
Results
The Results We
Are Accomplishing
Impacts
Desired
Results
The Results We Should
Be Accomplishing
Gap
Outcomes
Impacts
Gap
Outputs
Strategic Needs Assessment
Outcomes
Outputs
Gap
Activities
Gap
Inputs
7
Tactical Needs Assessment
Operational Needs Assessment
Activities
Gap
Inputs
Needs Assessments and Results
Chains
Plan
Performance Expectations
(Societal)
Measure Outcomes
Performance Expectations
(Organization)
Impacts
Plan
Measure Outputs
Measure Activities
Measure
8
Performance Expectations
(Individual or Team)
Plan
Plan
Inputs
Developing
Learning Plans
Calendar of
Learning Events
No more starting with…





9
We need to train them on…
You need to buy the latest release of…
We need a course on…
They need a new attitude about…
We really need do be doing…
Aren’t we already doing this?

Maybe
–

Systematic and consistent needs assessments
are, nevertheless, better since they…
–
–
–
10
Example, “My team should go to training X this year
because they will have to be able to do Y next year.”
–
Systematically align desired results with plans and
activities
Use performance expectations to guide decisions
Examine training and non-training alternatives
Provide consistent processes from manager to
manager
Where to Begin
Phases of Needs Assessment
 Pre-Assessment
–

Assessment
–
–

Collecting data
Turning data into information
and knowledge
Post-Assessment
–
11
Planning for success
Making decisions
Continuum of Assessments


12
Not every needs assessment has to be
complex
Scope of the assessment should be based on
the scope of the project
Small Project
Large Project
Small needs
assessment
Large needs
assessment
Tools for Collecting Information and
Making Decisions











13
Focus Groups - DACUM
Focus Groups - Delphi
Focus Groups - Nominal
Focus Groups – Straw Votes
Interviewing
Task Analysis
Cognitive Task Analysis
Card Sorts
Tabletop analysis
SWOT + Causal Utility
Dual-response surveys
Johari
Window
Concept mapping
Fault Tree Diagrams
Fishbone Diagrams
Multi-attribute Utility Analysis
Force Field Analysis
Risk and Resilience Analysis
Scenarios
Systematic Document Review
Performance Observation
Guided Expert Review
Performance System
WHAT
Needs
Assessments
Current
Results
14
WHAT
Required
Results
WHY
HOW
WHAT
Analysis
Examples: Program,
Project, Learning Plan,
Learning Activity, Mentor,
Recruitment Plan
Performance
Objectives
Needs Assessment Series:
Multi-Method Approach
Training Sessions:
Principles and
Practice
Training Sessions:
Practical
Application
Knowledge Base
15
Consulting Services
& Team Support
Training Sessions
Principles and Practice
Basics of conducting needs assessment
 Framework for conducting a needs assessment
 Aligning needs assessment with program logic
 Managing the process of needs assessment
 Multiple strategies for using needs assessment to
accomplish intended results
16
Training Sessions
Practical Application

Focus: Practice with data collection and analytical tools
for decision-making
–
–
–
–
–
17
SWOT with Causal Utility Analysis
Dual-Response Surveys
JOHARI Window
Task Analysis
Qualitative Data Analysis
Support for Implementation
Online Knowledge Base




18
Materials posted for just-in-time learning
Readings: tools and techniques
FAQ and Discussion Boards
Coming attractions (e.g., sample surveys, question
database, etc.)
Support for Implementation
Consulting Services &
Team Support



19
WBI Evaluation Group team, first stop for
advice
Consultant available for advisory services
With HRSLB, support to teams on learning
plans