Transcript MHS 6220 Psychoeducational Testing I

Week 3
Class Discussion
Assessment Procedures for Counselors and Helping Professionals, 7e
© 2010 Pearson Education, Inc.
All rights reserved.
Confidence Intervals




Pull out the psychometric summary data from
the sample report.
Discuss the relationship between the reported
standard scores and the confidence intervals.
What relationship does a smaller confidence
interval have to test error?
What relationship does test error have to
reliability?
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-2
© 2010 Pearson Education, Inc.
All rights reserved.
What is Reliability?

Reliability refers to the degree to which
test scores are dependable, consistent,
and stable upon additional testings.

Multiple factors can impact reliability.
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-3
© 2010 Pearson Education, Inc.
All rights reserved.
Level of Acceptable Reliability

The level of acceptable reliability depends on:



the construct being measured
the way the test scores will be used
the method used for estimating reliability
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-4
© 2010 Pearson Education, Inc.
All rights reserved.
Validity: Definitions



Validity: the claims and decisions made on
the basis of assessment results are sound,
meaningful, and useful for the intended
purpose of the results.
Validity: adequacy and appropriateness of the
uses of assessment results.
Construct: scientifically developed concepts,
ideas, or hypotheses that are used to
describe or explain behavior
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-5
© 2010 Pearson Education, Inc.
All rights reserved.
Sources of Validity Evidence
Sources of
Validity Evidence
Description
Procedures for Assessing
Validity
Content
Evidence based on the
representativeness of test content
(test items) and response
processes to the content domain
•Table of specifications
•Expert judges
•Analysis of response processes
Criterion-Related
Evidence based on the relationship
between test scores and external
variables
•Correlation b/w test scores &
other scores on similar test.
•Correlation b/w test scores &
some other data about same
concept.
Construct
Evidence based on the
appropriateness of inferences
drawn from test scores as they
relate to a particular construct
•Evidence of homogeneity
•Convergent and discriminant
validity evidence
•Group differentiation studies
•Factor analysis
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-6
© 2010 Pearson Education, Inc.
All rights reserved.
Test Selection




Examine the following advertisements
from test publishers.
What information is useful in
determining the selection of the test?
What additional information would you
need to know?
Where might you locate that
information?
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-7
© 2010 Pearson Education, Inc.
All rights reserved.
Evaluate a Test: WRAT-4

Evaluate the following

Reliability




What did they use to evaluate this?
Rate the reliability information for this test.
What does that mean in real words?
Validity



What did they use to evaluate this?
Rate the validity information for this test.
What does that mean in real words?
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-8
© 2010 Pearson Education, Inc.
All rights reserved.
Career Assessment

You have a private practice:

When might you use a career assessment
for a client?



What type might you want to use and why?
Base the type you might use on the clients you
expect to see.
When might you use a career assessment
for your business?

What type might you want to use and why?
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-9
© 2010 Pearson Education, Inc.
All rights reserved.
Project Discussion




Discuss what is expected of the first
project.
Discuss how the first project will be
graded.
Distribute materials needed to complete
the first project.
Question and Answer?
Assessment Procedures for Counselors and Helping
Professionals, 7e
Drummond/Jones
15-10
© 2010 Pearson Education, Inc.
All rights reserved.