Report Meeting
Download
Report
Transcript Report Meeting
TM
:
Quantitative Grounding
“22 Items and a Box”
Bruce Thompson
Colleen Cook
Martha Kyrillidou
Glasgow
January 19-20, 2004
Project web site: http://old.libqual.org
Score Integrity
Reliability
Validity
1. alpha By Language
By Language
Group
American (all)
British (all)
French (all)
n
59,318
6,773
172
Service
Affect
.95
.93
.95
Info.
Control
.91
.87
.90
Lib as
Place
.88
.81
.89
TOTAL
.96
.94
.95
alpha by University Type
By University Type
Group
Comm Colleges
4 yr Not ARL
4 yr, ARL
Acad Health
n
4,189
36,430
14,080
3,263
Service
Affect
.96
.95
.95
.95
Info.
Control
.92
.91
.90
.92
Lib as
Place
.89
.88
.87
.90
TOTAL
.97
.96
.96
.96
alpha by Consortium
By Consortium
Group
AAHSL
OhioLINK
Oberlin
Merlin
NY3R Coll/Uni
SCONUL
Alabama
n
3,186
7,203
2,945
991
13,008
6,773
1,203
Service
Affect
.95
.95
.94
.96
.95
.93
.95
Info.
Control
.92
.91
.88
.92
.92
.87
.92
Lib as
Place
.90
.88
.87
.88
.88
.81
.89
TOTAL
.96
.96
.94
.96
.96
.94
.96
n = 59,318; α = .9593
Item
SA01APER
SA04APER
SA07APER
SA10APER
SA12APER
SA15APER
SA17APER
SA20APER
SA23APER
"Corrected"
ItemTotal
Correlation
.6989
.7338
.7621
.7726
.7590
.7760
.7263
.7649
.7914
alpha
if Item
Deleted
.9575
.9571
.9568
.9567
.9568
.9566
.9572
.9567
.9565
n = 59,318; α = .9593
Item
PC02APER
PC11APER
PC16APER
PC21APER
PC25APER
IA03APER
IA14APER
IA18APER
"Corrected"
ItemTotal
Correlation
.6728
.6766
.7313
.7774
.6285
.6327
.6964
.7355
alpha
if Item
Deleted
.9578
.9577
.9571
.9567
.9583
.9583
.9575
.9571
n = 59,318; α = .9593
Item
LP05APER
LP09APER
LP13APER
LP19APER
LP24APER
"Corrected"
ItemTotal
Correlation
.5633
.6614
.6944
.6144
.7116
alpha
if Item
Deleted
.9593
.9579
.9576
.9586
.9573
Service Affect
Service Affect (n = 71,170 English)
SA20APER
SA07APER
SA17APER
SA04APER
SA15APER
SA23APER
SA01APER
SA12APER
SA10APER
.80541
.80338
.79655
.77062
.73437
.73391
.71589
.71541
.68825
.22199
.27236
.20844
.29258
.34646
.34359
.29773
.32229
.35941
.27521
.20993
.22793
.17694
.24299
.27896
.16972
.25528
.28090
Library as Place
Library as Place (n = 71,170 English)
LP13APER
LP05APER
LP09APER
LP24APER
LP19APER
.26213
.20412
.27765
.26672
.19630
.25710
.15920
.24869
.34873
.28102
.80013
.73601
.72631
.72148
.70295
Information Control
Information Control (n = 71,170 English)
IA18APER
PC11APER
IA03APER
PC25APER
PC21APER
PC02APER
PC16APER
IA14APER
.29824
.29045
.24482
.21770
.41572
.37847
.33439
.28759
.73480
.71111
.70341
.68760
.65615
.63860
.61598
.58521
.28164
.19999
.18989
.22736
.30096
.16559
.36448
.39295
2. Validity Correlations
Validity Correlations
Serv_Aff
Serv_Aff
1.0000
Info_Con
.7113
LibPlace
.5913
TOTALper
.9061
ESAT_TOT
.7286
EOUT_TOT
.5315
Info_Con
.7113
1.0000
.6495
.9029
.6761
.6155
LibPlace
.5913
.6495
1.0000
.8053
.5521
.4917
TOTALper
.9061
.9029
.8053
1.0000
.7587
.6250
Mean Perceived Scores
2001/2002 Trend (n=34)
7.2000
7.0000
2002 Data
6.8000
6.6000
6.4000
6.2000
6.0000
6.0000
6.2000
6.4000
6.6000
2001 Data
6.8000
7.0000
7.2000
The Challenge of Score Use
Securing information that contributes
meaningfully to planning and
improvement efforts at a local level
Providing analytical frameworks that
institutional staff can apply without
extensive training or assistance
Helping decision-makers understand
success of investments
Finding useful inter-institutional
comparisons
Two Interpretation Frameworks
Zone of Tolerance
Score Norms
1. Zone of Tolerance
The distance between minimally
acceptable and desired service
quality ratings
Perception ratings ideally fall
within the Zone of Tolerance
Faculty Dimension Summary
9.0
8.0
Perceived
Average Rating
7.0
Range of Minimum to Desired
Range of Minimum to Perceived
(“Gap”)
6.0
5.0
4.0
3.0
2.0
Access to
Information
Affect of
Service
Library as Place
Personal
Control
Note: LibQUAL+ Spring 2002 Survey Results - TAMU. (2002). Vol. 2, p. 42
7 Institution Types
1.
2.
3.
4.
5.
6.
7.
Community Colleges
Health Sciences
Military
Colleges/Universities
State/Publics
United Kingdom
French Canadian
LibQUAL+™ 2003 Summary
Colleges or Universities
LibQUAL+™ 2003 Colleges or
Universities – Dimension Means
LibQUAL+™ 2003 Colleges or
Universities – Library Use
LibQUAL+™ 2003 Colleges or
Universities – Core Questions
LibQUAL+™ 2003 Summary
Community Colleges
LibQUAL+™ 2003 Community
Colleges – Dimension Means
LibQUAL+™ 2003 Community
Colleges – Library Use
LibQUAL+™ 2003 Summary
Academic Health Sciences
LibQUAL+™ 2003 Health
Sciences – Dimension Means
LibQUAL+™ 2003 Health
Sciences – Library Use
LibQUAL+™ 2003 Summary
Military Institutions
LibQUAL+™ 2003 Military
Institutions – Dimension Means
LibQUAL+™ 2003 Military
Institutions – Library Use
LibQUAL+™ 2003 Summary
State and Public Institutions
LibQUAL+™ 2003 State and
Public – Dimension Means
LibQUAL+™ 2003 State and
Public – Library Use
LibQUAL+™ 2003 Summary
United Kingdom
LibQUAL+™ 2003 United
Kingdom – Dimension Means
LibQUAL+™ 2003 United
Kingdom – Library Use
LibQUAL+™ 2003 Summary
French Canadian
LibQUAL+™ 2003 French
Canadian – Dimension Means
LibQUAL+™ 2003 French
Canadian – Library Use
2. Score Norms
Norm Conversion Tables facilitate
the interpretation of observed
scores using norms created for a
large and representative sample.
LibQUAL+ norms have been
created at both the individual and
institutional level
Institutional Norms for Perceived
Means on 25 Core Questions
Note: Thompson, B. LibQUAL+ Spring 2002 Selected Norms, (2002).
Response Rates
1. It’s representativesness that
counts more than the response
rate!
Response Rates
2. We only know the lower bound (or
minimum) estimate of the
response rate, because we don’t
know the correct denominator.
Response Rate Contexts
1. Response rates are higher for
action-oriented surveys, which
are not relevant or practical for
total market surveys.
Response Rate Contexts
2. Survey saturation is tending to
lower typical response rates over
time.
2005 and Beyond
1. Matrix Sampling / Short Forms
2. Software Used for
Local/Consortial Assessments
3. “Action Snapshots”
LibQUAL+ Related Documents
LibQUAL+ Web Site
http://www.libqual.org
LibQUAL+ Bibliography
http://www.libqual.org/publications/index.cfm
Survey Participants Procedures
Manual
http://www.arl.org/libqual/procedure/lqmanual2.pdf