Transcript E-Metrics Projects

E-Metrics: Which Ones?
Outline
comparison of international e-metrics
projects
survey results from NZ and Australia on
e-metrics practice
suggestions for metrics to be included in
the CAUL & CONZUL statistics
Increasing $ spent on
e-resources
But no national statistics
reflecting use
Why collect E-metrics?
Comparing against other similar
libraries
Demonstrating the library’s contribution
to learning/ research outcomes
To inform internal management
decisions
To assess the cost-effectiveness of
alternative products and services.
E-Metrics Projects
ARL
COUNTER
Equinox (European Union)
NISO – draft revised Z39.7 standard on
library statistics
ISO Library Statistics standard under
development
… and others
Equinox: Electronic Library Performance Indicators
1.
2.
3.
4.
5.
6.
7.
% of the population reached by electronic library
services
No. of sessions on each electronic library service per
member of the target population
No. of remote sessions on electronic library services
per member of the population to be served
No. of documents and entries (records) viewed per
session for each electronic library service
Cost per session for each electronic library service
Cost per document or entry (record) viewed for each
electronic library service
% of information requests submitted electronically
Library computer workstation use rate
9.
No. of library computer workstation hours available
per member of the population to be served
10. Rejected sessions as a percentage of total attempted
sessions
11. % of total acquisitions expenditure spent on
acquisition of electronic library services
12. No. of attendances at formal electronic library service
training lessons per member of the population to be
served
13. Library staff developing, managing and providing ELS
and user training as a percentage of total library staff
14. User satisfaction with electronic library services
8.
Selected E-Metrics
Source
Patron Accessible Electronic Resources
A,N
R1 Number of electronic full-text journals
A,N
R2 Number of electronic reference sources
A,N
R3 Number of electronic books
Use of Networked Resources and Services
A,N
U1 Number of electronic reference transactions
A,E,C,N U2 Number of logins (sessions) on electronic
databases
A,C,N
U3 No. of queries (searches) in electronic
databases
A,C,E,N U4 Items requested in electronic databases
C,N
E,N
A,N?
Full-text requests from electronic databases
Number of remote sessions on electronic services
U5 Virtual visits to library’s website and catalog
NZ
Web page hits
Expenditures for Networked Resources and
Related Infrastructure
A,N
A, (N)
A, (N)
A,N
C1 Cost of electronic full-text journals
C2 Cost of electronic reference sources
C3 Cost of electronic books
C4 Library expenditures for bibliographic utilities,
networks, and consortia
% of total acquisitions $ spent on e-resources
E
Performance Measures or Ratios
A
P1 Percentage of electronic reference
transactions of total reference
E
% of information requests submitted electronically
A
P2 % of virtual library visits of all library visits
A
P3 Percentage of electronic books to all
monographs
E
Database logins (sessions) per FTE
E
No. of library computer workstation hrs/FTE
NZ
Library computer workstations per EFTS
Patron Accessible Electronic Resources
Aus
+ NZ
n=25
Aus
n=18
A,N 1.1 Number of electronic full-text journals
24
18
A,N 1.2 Number of electronic reference
sources
9
13
A,N 1.3 Number of electronic books
10
14
Col. 1 = Australia + NZ, Currently collect
Col. 2 = Australia only, Currently collect + should
collect (1 or 2)
Use of Networked Resources and Services
A,N 2.1 Number of electronic reference
11
transactions
20
A,E, 2.2 Number of logins (sessions) on
C,N
electronic databases
A,C, 2.3 No. of queries (searches) in electronic 18
N
databases
14
A,C, 2.4 Items requested in electronic
E,N
databases
C,N 2.5 Full-text requests from electronic
16
databases
E,N 2.6 Number of remote sessions on
7
electronic services
11
A,N? 2.7 Virtual visits to website and catalog
13
NZ
2.8 Web page hits
14
16
14
14
14
12
15
15
The Zen librarian
searched for nothing on
AltaVista and received
27,987,384 hits.
http://homepage.interaccess.com/~smitters/lafnlibn//koans_yours.htm
Copyright 2002 Brian smith.
Use of Networked Resources and Services
A,N 2.1 Number of electronic reference
11
transactions
20
A,E, 2.2 Number of logins (sessions) on
C,N
electronic databases
A,C, 2.3 No. of queries (searches) in electronic 18
N
databases
14
A,C, 2.4 Items requested in electronic
E,N
databases
C,N 2.5 Full-text requests from electronic
16
databases
E,N 2.6 Number of remote sessions on
7
electronic services
11
A,N? 2.7 Virtual visits to website and catalog
13
NZ
2.8 Web page hits
14
16
14
14
14
12
15
15
Expenditures for Networked Resources
and Related Infrastructure
A,N 3.1 Cost of electronic full-text journals
A,
3.2 Cost of electronic reference sources
(N)
A,
3.3 Cost of electronic books
(N)
A,N 3.4 Library expenditures for bibliographic
utilities, networks, and consortia
E
3.5 % of total acquisitions $ spent on eresources
13
10
15
13
11
14
13
11
16
17
Performance Measures or Ratios
A
4.1 Percentage of electronic reference
transactions of total reference
4
13
E
4.2 % of information requests submitted
electronically
4.3 Percentage of electronic books to all
monographs
1
9
2
8
E
4.4 Database logins (sessions) per FTE
0
9
E
4.5 No. of library computer workstation
hrs/FTE
1
6
NZ 4.6 Library computer workstations per EFTS
5
11
A
The Zen librarian used a
palm stylus to mark the
reference desk statistics
sheet.
http://homepage.interaccess.com/~smitters/lafnlibn//koans_yours.htm
Copyright 2002 Brian smith.
Recommended E-metrics for
CAUL/CONZUL
2.2 Number of logins (sessions) on
electronic databases
2.3 No. of queries (searches) in
electronic databases
2.5 Full-text requests from electronic
databases
3.5 % of total acquisitions $ spent on
e-resources
Omitted from this survey
Size of the library’s digital collection

e-theses

e-reserve

digitized heritage resources
Use of the library’s digital collection
OPAC searches
Turnaways (rejected sessions)