Developing Tools to Assess Digital Libraries

Download Report

Transcript Developing Tools to Assess Digital Libraries

TM

A Total Market Survey

from SERVQUAL to LibQUAL+

Colleen Cook

January 26-27, 2003 ALA Midwinter Meeting Philadelphia Project web site www.arl.org/libqual/

Library Remains a Credible Resource

 98% agree with statement, “My … library contains information from credible and known sources” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

Information Seeking Behaviors are Changing

 15.7% agreed with the statement “The Internet has not changed the way I use the library” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

Finding Electronic Journals for Research

    92.7% find out about e-journals on-line 21.7% report using print resources to find 16.5% would ask a person for assistance Only 2.5% would prefer to ask a librarian Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

Finding Print Journals for Research

  Only 13.9% ask a librarian Only 3.2% consider consulting a librarian a preferred way of identifying information Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

600,000 550,000 500,000 450,000 400,000 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000

Note. M. Kyrillidou and M. Young. (2002).

ARL Statistics 2000-01. Washington, D.C.: ARL, p.8.

2001

950,000 900,000 850,000 800,000 750,000 700,000 650,000 600,000 550,000 500,000 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000

Note. M. Kyrillidou and M. Young. (2002).

ARL Statistics 2000-01. Washington, D.C.: ARL, p.8.

2001

170,000 160,000 150,000 140,000 130,000 120,000 110,000 100,000 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001

Note. M. Kyrillidou and M. Young. (2002).

ARL Statistics 2000-01. Washington, D.C.: ARL, p.8.

LibQUAL+

Description

LibQUAL+  is a research and development project undertaken to define and measure library service quality across institutions and to create useful quality assessment tools for local planning.

LibQUAL+

Process

 SERVQUAL dimensions served as

a priori

theoretical starting point

Relationships: Perceptions, Service Quality and Satisfaction

….only customers judge quality; all other judgments are essentially irrelevant” Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press.

LibQUAL+

Resources

  An ARL/Texas A&M University joint developmental effort based on SERVQUAL LibQUAL+  initially supported by a 3-year grant from the U.S. Department of Education’s Fund for the Improvement of Post-Secondary Education (FIPSE)  Initial project established an expert team, regrounded concepts, and designed survey methodology  Survey conducted at over 200 libraries resulting in a data base of over 78,000 user responses

LibQUAL+

Project Goals

 Establishment of a library service quality assessment program at ARL  Development of web-based tools for assessing library service quality  Development of mechanisms and protocols for evaluating libraries  Identification of best practices in providing library service

LibQUAL+

Participants

Year 4 316 Participants Year 3 164 Participants Year 2 43 Participants Year 1 12 Participants

Spring 2000 Spring 2001

For More Information about Participants: Visit the LibQUAL+  web site.

Spring 2002 Spring 2003

LibQUAL+

Fundamental Contributions to the Measurement of Effective Delivery of Library Services

 Shift the focus of assessment from mechanical expenditure-driven metrics to user-centered measures of quality  Determine the degree to which information derived from local data can be generalized, providing much needed “best practices” information  Re-ground gap theory for the library sector, especially academic libraries  Demonstrate the efficacy of large-scale administration of user-centered assessment transparently across the web  Grounded questions yield data of sufficient granularity to be of value at the local level  Makes little demand of local resources and expertise

Multiple Methods of Listening to Customers

           Transactional surveys* Mystery shopping New, declining, and lost-customer surveys Focus group interviews Customer advisory panels Service reviews Customer complaint, comment, and inquiry capture Total market surveys* Employee field reporting Employee surveys Service operating data capture

*A SERVQUAL-type instrument is most suitable for these methods

Note. A. Parasuraman. The SERVQUAL Model: Its Evolution And Current Status. (2000). Paper presented at ARL Symposium on Measuring Service Quality, Washington, D.C.

Dimensions of Library Service Quality

Affect of Service Empathy Responsiveness Assurance Reliability Information Access Scope Timeliness Convenience Library Service Quality Personal Control Ease of Navigation Convenience Modern Equipment Library as Place Utilitarian space Symbol Refuge

Affect of Service

 Absorbed several of the original SERVQUAL questions measuring Responsiveness, Assurance and Empathy  In the current analysis also includes Reliability  All in all: the Human Dimension of Service Quality

Access to Information

 Covers scope, timeliness, and convenience of access  Adequacy of collections  Comprehensiveness, quality, and depth of information resources  All in all: required information delivered in the format, location, and time of choice

Personal Control

 Covers ease of navigation, convenience, and support services  Personal control of the information universe in general and web navigation in particular  All in all: How users want to interact with the modern library

Library as Place

 Covers usefulness of space, symbolic value, and refuge for work and study  Transcends the SERVQUAL dimension of Tangibles to include the idea of the library as the campus center of intellectual activity  All in all: As long as physical facilities are adequate, library as place may not be an issue

Survey Design Considerations

 Three scales exploring optimal, minimal, and actual service levels  Twenty-five questions clustered around four dimensions  Survey covers a sample of targeted user population  Data illuminates gap between desired level of service and perception of experience

Sample Survey

Spring 2002

Sample Survey…

continued

Sample Survey…

continued

Sample Survey…

continued

Sample Survey…

continued

LibQUAL+

2002 Iteration

 42 — ARL Libraries  35 — Health Sciences Libraries  36 — State Colleges & Universities (excluding ARL)  34 — Private Colleges & Universities (excluding ARL)  15 — Community Colleges  2 — Special & Public Libraries (Smithsonian & NYPL)

LibQUAL+

 Related Documents LibQUAL+  Web Site http://www.arl.org/libqual/ LibQUAL+  Bibliography http://www.coe.tamu.edu/~bthompson/servqbib Survey Participants Procedures Manual

http://www.arl.org/libqual/procedure/lqmanual2.pdf