Working to make online usage statistics more meaningful

Richard Gedye Chair COUNTER UKSG March 2003

Today’s agenda

    

Why was COUNTER formed?

Who are we?

Who is supporting and funding us?

COUNTER Code of Practice

   

Principles Features

Compliance and Commitment Auditing Future Plans

Why was COUNTER formed?

 Libraries and consortia need online usage statistics  Publishers need online usage statistics  Usage statistics need to be    credible compatible consistent

Why libraries need usage statistics - 1

 Collection Development Tool    Provide a more accurate match of information resources to patron needs for learning, teaching, and research Provide the right materials, at the right time, in the right format, via an appropriate method of delivery “Usage of this journal on the shelf has declined. Should we drop the journal or just its print version?”

Why libraries need usage statistics -2

     To lobby for increased funding To allocate expenditure more accurately Benchmarking  Within institutions  Within consortia To inform internal marketing and promotion strategy To develop new purchasing models, especially at the consortial level

Why publishers need usage statistics -1

    To support library efforts to procure funding To demonstrate that reduced usage of print issues has been compensated for by increased online usage To assess the relative importance of the various routes via which information reaches its market To experiment with new pricing models

Why publishers need usage statistics - 2

   

To provide editorial policy support To obtain improved market analysis and demographics To improve site design and navigation To help plan infrastructure e.g. mirror sites/caches

Who are we?

An organisation with cross community support………

Endorsed by…

           AAP, Association of American Publishers ALPSP, The Association of Learned and Professional Society Publishers ARL, Association of Research Libraries ASA, Association of Subscription Agents and Intermediaries EDItEUR JISC, Joint Information Systems Committee NCLIS, National Commission on Libraries and Information Science NISO, National Information Standards Organization PA, The Publishers Association STM, International Association of Scientific, Technical & Medical Publishers UKSG, United Kingdom Serials Group

Founding Sponsors              AAP/PSP AIP ALPSP ARL ASA Atypon Blackwell Publishing BMJ Publishing EBSCO Elsevier Science Ingenta IOPP ICSTI            ISI Lippincott, Williams & Wilkins Nature Publishing Group NEJM OCLC Oxford University Press The Publishers Association ProQuest Taylor & Francis Group STM UKSG

Governance: Executive Committee

Consortia

  Arnold Hirshon Hazel Woodward

Libraries

    Christine Fyfe David Goodman Marthyn Borghuis Roger Brown NELINET Cranfield University University of Leicester Princeton University  Phil Davis Cornell University

Publishers, Aggregators, etc.



Richard Gedye Oxford University Press

Elsevier Science GlaxoSmithKline    Timo Hannay Terry Hulbert Tony Kidd   Jack Ochs Oliver Pesch

Project Director



Peter Shepherd

Nature Publishing Group Institute of Physics University of Glasgow American Chemical Society EBSCO USA UK UK USA USA

UK (Chair

) Netherlands UK UK UK UK USA USA

UK

Governance: International Advisory Board

Consortia

 Diane Costello CAUL, Australia    Lorraine Estelle, JISC, UK Syun Tutiya, ANUL, Japan Alicia Wise, JISC/DNER, UK

Libraries

  Frances Boyle, Oxford U., UK Andrew Braid, British Library, UK        Denise Davis, Oregon State U., USA Ross MacIntyre, U. of Manchester, UK Alison McNab, U. of Nottingham, UK James Mouw, University of Chicago, USA Henning Nielsen, Novo Nordisk, Denmark Sherrie Schmidt, ARL, USA Jill Taylor-Roe, U. of Newcastle, UK                          

Publishers, Aggregators, et al

Christine Baldwin, Information Design & Management, UK Michael Butterfield, BMJ Group, UK Jill Cousins, Blackwell Publishing, UK Mary Fugle, Lippincott Williams & Wilkins, USA Kristen Garlock, JSTOR, USA Brian Green, BIC/EDItEUR, UK Tony Hammond, Harcourt Publishers, UK Pat Harris, NISO, USA Mike Hoover, ProQuest, USA Heather Joseph, BioOne, USA Kornelia Junge, Wiley, USA Barbara Lange, AAP/PSP, USA Judy Luther, Informed Strategies, USA Lex Lefebvre, STM, The Netherlands Liz McNaughton, Divine/ICEDIS, UK Tim Martin, OCLC, USA Kirsty Meddings, Ingenta, UK Robert Molyneux, NCLIS, USA Sally Morris, ALPSP, UK Lynn Norris, EduServ, UK Jill O'Neill, NFAIS, USA Chris Parker, CABI, UK Norman Paskin, DOI, UK John Sack, HighWire Press, USA Graham Taylor, Publishers' Association, UK Rollo Turner, ASA, UK

Code of Practice, Release 1 January 2003



Basic principles



Main features

Code of Practice, Release 1: Basic Principles        Start small Start with the basics Compatibility is our goal, not sophistication Be as prescriptive as possible Intended to supplement, not replace, existing more sophisticated or product-related reports Provide support and advice for implementation Auditing

Code of Practice, Release 1: Main Features       Definitions of terms used Specifications for Usage Reports Data processing guidelines Auditing Compliance Maintenance and development of the Code of Practice

Definitions of Terms     Data elements to be collected Page views

#

   Bibliographic data Page type Source of page 3.1.2

3.1.2.1

  Authentication of user Access rights Session data Market elements 3.1.2.2

3.1.2.3

Term Examples / formats Definition

Page type Item Article TOC (Table of Contents) Full text article, TOC, Abstract, Database record A uniquely identifiable piece of published work that may be original or a digest or a review of other published work. PDF, Postscript and HTML formats of the same full text article (for example), will be counted as separate items.

An item of original written work published in a journal or other serial publication. An article is complete in itself, but usually cites other relevant published works in its list of references A list of all articles published in a journal issue

Every effort was made to incorporate or reconcile the definitions with existing ones from other groups, such as NISO and ICOLC.

Specifications for Usage Reports 1. Report content and format 2. Report delivery

Specifications for Usage Reports REPORT CONTENT AND FORMAT   Level 1 Reports     

Journal Report 1:

Number of successful full-text article requests by month and journal

Journal Report 2:

Turnaways by month and journal

Database Report 1:

database Total searches & sessions by month &

Database Report 2: Database Report 3:

service T urnaways by month & database Total searches & sessions by month & Level 2 Reports  

Journal Report 3:

Number of successful item requests and turnaways by month, journal & page type

Journal Report 4:

total searches run, by month & service

Journal Report 1: Successful Full-Text Article Requests by Month and Journal

Print ISSN Online ISSN

Total for all journals Journal of AA 1212-3131 3225-3123 Journal of BB 9821-3361 2312-8751 Journal of CC 2464-2121 0154-1521 Journal of DD 5355-5444 0165-5542

Jan 01

6637

Feb 01

8732

Mar 01

7550

Calendar YTD

45897 456 203 0 203 521 251 0 251 665 275 0 275 4532 3465 0 2978

Example Level 1 Report

Journal Report 2: Turnaways Month and Journal by

Print ISSN Online ISSN Page Type

Total: full-text turn aways for all journals Journal of AA Journal of BB 1212-3131 3225-3123 9821-3361 2312-8751 Full text Turnaways Full text Turnaways

Jan 01

453

Feb 01

233

Mar 01

318

Calendar YTD

4765 23 18 40 20 12 16 342 287

Example Level 1 Report

Database Report 1: Total Searches and Sessions by Month & Database Database AA Searches Run

Jan 01 Feb 01

2322 2520

Mar 01

2742 Database AA Sessions Database BB Searches Run Database BB Sessions 1821 3466 1987 1929 3210 2200 2211 4459 2544

Calendar YTD

29878 27654 36543 24209

Example Level 1 Report

Database Report 1: Total Searches and Sessions by Month & Database

Example

Journal Name

Journal of AA Journal of AA Journal of AA Journal of AA Journal of AA Journal of AA Journal of AA Journal of AA Journal of AA ……………… Total: all Journals Total: all Journals Total: all Journals Total: all Journals Total: all Journals Total: all Journals Total: all Journals Total: all Journals Total: all Journals Journal Report 3: Number of Successful Item Requests Page-Type and Turnaways , by Month, Journal and

Print ISSN Page Type Jan-01 Feb-01 Mar-01

1212-3131 1212-3131 1212-3131 1212-3131 1212-3131 1212-3131 1212-3131 1212-3131 1212-3131 …………….

Online ISSN

3225-3123 3225-3123 3225-3123 3225-3123 3225-3123 3225-3123 3225-3123 3225-3123 3225-3123 ……………..

Table of Contents Abstracts References Full-text Postscript Requests Full-text PDF Requests Full-text HTML Requests Full-text Total Requests Full-text PDF Turnaways Full-text HTML Turnaways ……………………………………….

Table of Contents Abstracts References Full-text Postscript Requests Full-text PDF Requests Full-text HTML Requests Full-text Total Requests Full-text PDF Turnaways Full-text HTML Turnaways 66322 54126 4532 11345 32112 22500 54612 3221 1123 732 1032 543 444 621 322 943 23 10 806 1140 322 365 670 420 1090 40 21 70312 46005 3987 10947 34554 24000 58554 4112 1321 81554 55265 5473 12534 38221 19500 57721 2113 1511 676 1020 567 432 598 543 888 32 18

Calendar YTD

3543 6896 4002 3987 4657 4433 5021 186 102 400980 267980 34876 66007 224623 107841 394532 8765 6453 Example Level 2 Report

Database Report 1: Total Searches and Sessions by Month & Database Example Level 2

Example

Specifications for Usage Reports REPORT DELIVERY      CSV file, Microsoft Excel file, or file that can be easily exported to Microsoft Excel Available on a password-controlled website (accompanied by an e-mail alert when data is updated) Provided at least monthly Updated within two weeks of the end of each reporting period All of last calendar year’s data and this calendar year’s to date must be supplied

Enhancements Under Consideration    Break down usage reports by  year of publication   type of purchase (subscribed, pay per view) Note: a further survey of librarians may be conducted to learn which reports are preferred Define additional terms, e.g., “article download” Clarify how to count “full-text requests” (e.g., individual articles vs. subsets of articles)

Data processing guidelines    Covers only intended usage Code of Practice specifies the criteria to be met by the data used in building the Usage Reports  Only successful requests will be counted   Records generated by the server, together with the requested pages, should be ignored All users’ double clicks within 10 seconds on an http link should be counted as only one request (30 seconds for PDF) More detailed guidelines are being compiled on data processing and will shortly appear on the COUNTER web site

Compliance  More than one compliance level   Level 1: basic set of journal and database reports Level 2: more detailed reports  Licence Agreements  Standard clause covering COUNTER compliance  Declaration of COUNTER compliance   For 2003 Vendors sign declaration and demonstrate to COUNTER that they can provide at least Level 1 Usage Reports  Register of COUNTER-compliant vendors  Maintained on the COUNTER website

Publishers who have stated they intend to comply

Initial List

             American Chemical Society American Institute of Physics Blackwell CABI EBSCO Elsevier Extenza HighWire Ingenta Institute of Physics ISI NPG Oxford University Press

Auditing       A publisher or content provider will be able to state that it is “Counter Compliant” only if this can be certified through an independent audit Audit scope: reports, processes & application of definitions Auditing will be required beginning in 2004 RFP will be issued to qualify auditors Auditing processes are under development A list of COUNTER-approved auditors will be made available

Maintenance and Development of the Code of Practice  Full text of the Code of Practice is freely available on the COUNTER website  html and PDF formats  Code of Practice will be systematically extended  Feedback on Release 1 is actively sought  Via test sites involving publishers and libraries  Via feedback to COUNTER via the website, International Advisory Board, etc.

Future Developments: 2003 and beyond  Objectives for 2003       Promote and gain acceptance for the Code of Practice Obtain feedback on Release 1 Complete list of approved auditors Define and set up a permanent administrative structure Promote membership of COUNTER Full implementation by vendors for 2004 subscription year  Beyond 2003   Build membership of COUNTER Extend and deepen Code of Practice   Cover e-books, etc Journal reporting at article level

For more information……….

www.projectCounter.org

Peter Shepherd (Project Director) [email protected]