Transcript Library_Powerpoint complete set

JIBS - “Research evaluation - is it our
business? Librarians' roles in the brave
new world of research evaluation”
Supporting Bibliometrics
Jenny Delasalle
Academic Support Manager (Research)
connecting you with information,
support and your community
I will cover…
• Some background information about University of
Warwick and about me.
• Bibliometrics in use: how they can be relevant to
researchers
• Understanding bibliometrics: stuff I tell researchers!
connecting you with information,
support and your community
About me & my role at Warwick
Academic Support
Manager (Teaching
& Learning)
Head of
Academic
Services
Academic
Support
Manager
(Research)
Teaching Grid
and Learning
Grid Manager
Academic Services
Development Manager
connecting you with information,
support and your community
Academic Support
Librarian
(Research)
Research
Exchange
Advisers, Coordinator,
Assistant.,
Ambassadors
What the Library offers to Researchers
• Subject expert ASLs who liaise with departments about their
needs & deliver information skills training, enquiries support, etc
• Specialist collections, including MRC (Archive)
• Information Management strand on the Research Student Skills
Programme
• One-off, tailored workshops and presentations.
• WRAP repository & NEW Publications Service
• Expertise on advanced information skills… including
bibliometrics, copyright, publishing, Web 2.0
• The Wolfson Research Exchange
connecting you with information,
support and your community
Liaison with ….
• IT Services
• Student Careers and Skills - for training students (including
PhD students)
• Graduate School – administration of post-graduate students
(including PhD students)
• Institute for Advanced Studies – early career fellowships
• Learning and Development Centre - part of HR, for training
staff.
• Research Support Services – help with grant applications but
also managing fincances throughout project
• Management & Planning office – handle REF return but also
provide HoDs with information.
• Communications Office – promoting Warwick research
• Legal Compliance – guidance on copyright, data protection,
etc
connecting you with information,
support and your community
Routes to reach researchers at Warwick
•
•
•
•
•
•
•
•
•
•
RSF – Research Staff Forum
Research Committee
Faculty Research Forum (chairs)
(Heads of) Research Centres/ Institutes
(Heads of) Doctoral training centres
Directors of Graduate studies
PhD supervisers’ training
Direct e-mail (list from HR)
Via ASLs, Graduate SSLCs and Library reps
Communications Office newsletter every week & monthly
magazine & the Uni Intranet
• LDC newsletter
• WRAP newsletter
• Library website, Research Exchange website, blogs, Facebook
connecting you with information,
support and your community
An interest in bibliometrics!
• Journals to keep/withdraw
• Repository management: advocacy messages that OA
publishing boosts citations.
• Does repository deposit make a difference to citations?
• Will the REF include citation measurements?
• Web of Knowledge training free, through Mimas
• Jiscmail Lis-bibliometrics list.
connecting you with information,
support and your community
Our Approach to bibliometrics
• Understanding of bibliometrics is a key information skill
• Best not to refer to the term “bibliometrics” itself?
• Cover elements of these in other workshops:
– “Getting Published”
– “Literature Searching”
• Use the controversy around publication “strategy” to
engage audience: workshop at a doctoral centre.
• Publicise our expertise: amongst researchers and
University management.
• Online material to complement our offer.
– REx website: Researcher to Researcher approach
connecting you with information,
support and your community
Bibliometrics in use
• Considering where to publish.
• What do we do about the REF?
• Benchmarking a department.
• Evidence for a job application/grant application/salary
review, etc
– Measurements in University rankings.
connecting you with information,
support and your community
Appraising journals when considering
publication
• Librarians:
– Know the data sources (WoK Ifs, SciMago SJR, RePec, AnneWil Harzing’s website)
– Know about Open Access
– Know where journals are indexed & which indexes are
important to a discipline
• Other than impact factors, we have knowledge of:
– Features of journals such as letter, blogs, reviews, etc
– Copyright agreements
– Publicising your work using Web 2.0
– Other publication channels than journals: how to measure them!
– Cross-disciplinary perspective.
connecting you with information,
support and your community
Impact Factors : JCR and SciMago
JCR
SciMago
Subscription-based
Open access resource
No equivalent
SJR
No equivalent
Total Docs
Total Cites (given for 1 year)
Total Cites (given for 3 years)
2 year impact factor
Cites/Docs (2 years)
5 year impact factor
No equivalent
Immediacy Index
No equivalent
Cited Half-Life
No equivalent
Eigenfactor score
No equivalent
connecting you with information,
support and your community
What can we say about REF 2014 and
bibliometrics?
• Not much – yet!
• Watch for announcements this summer.
• Work with department which gathers our return.
• Ensure that publications data is properly recorded.
• Medicine, Science and Engineering most likely candidates.
connecting you with information,
support and your community
Benchmarking a department
1. No. of papers published by a department in a given period, for
example:
Source: http://www.science-metrix.com/pdf/SM_CETC_Energy_Report_V05_F3.pdf
NB how do you define which papers to be included for each set?
2. No. of citations: total or per paper?
connecting you with information,
support and your community
Evidence about an individual – h-index
h-index of 4 means there are 4 published papers each with at
least 4 citations
OR: Professor X has a total of 10 publications
Publication 1
20 cites
Publication 2
18 cites
Publication 3
11 cites
Publication 4
7 cites
----------------------------------------------------------- h-index: 4
Publication 5
4 cites
Publication 6
3 cites
Publications 7,8,9,10
0 cites
connecting you with information,
support and your community
Evidence about an individual (2)
• Egghe's g-index – aims to improve on the H-index by giving
more weight to highly-cited articles.
• Contemporary h-index - aims to improve on the H-index by giving
more weight to recent articles and therefore rewards academics
who maintain a steady level of activity.
• Be wary of others’ declared h-index scores: which data sets are
they based on?
• Context is everything!
connecting you with information,
support and your community
Measurement in University Rankings
• Which ones matter to your University?
– Academic Ranking of World Universities (ARWU) - also
known as ‘The Shanghai Rankings’
– Times Higher Education (THE) World University
Rankings
– The QS World University Rankings
– Webometrics Ranking of World Universities
• A good ranking…
– helps universities attract the most talented researchers.
– university can set higher fees and attract more funding for
research.
• BUT how they are calculated might not mean that a high hindex is the thing to ask of your researchers…
connecting you with information,
•support
! and your community
Understanding Bibliometrics
• Not one “bibliometric” measure but many:
– Paper counts
– journal impact factors
– The h-index
– citation scores at article level
– visitor numbers (or other info) for online articles
•
•
•
•
Motivations for publication.
Motivations for citation.
Effects of collaboration? Discipline?
Differences in data sources: their coverage/collection, the
measures they publish and the graphs/analysis they offer.
connecting you with information,
support and your community
RAE: what was submitted?
• All institutions 2008 RAE journal articles: 167,831
• All institutions 2008 RAE all types: 222,177
• https://www.jisc-collections.ac.uk/ProjectMerit/Merit-Search/
connecting you with information,
support and your community
RIN (September 2009). Communicating
knowledge: How and why UK researchers
publish and disseminate their findings,
Research Information Network; JISC.
connecting you with information,
support and your community
Collaboration effects
• Other researchers – own discipline, or other
disciplines?
• Peer review practices vary: in the Arts can take
upwards of 6 months.
• With industry – publication good for them?
• Agreement on what to publish & where
• Acknowledging contributions: variety of practice
• Negotiation skills!
connecting you with information,
support and your community
Some motivations for citations
• Paying homage to experts
– Especially those likely to be peer reviewers!
• Credit to peers whose work you have built upon
– Lend weight to own claims
• Provide background reading
• Criticising/correcting previous work
• Sign-posting under-noticed work
– (own paper which would affect your h-index!)
• Self citations!
connecting you with information,
support and your community
Citation patterns
•
•
•
•
Most publications have little or no citations.
Variety across the disciplines.
Therefore comparisons within a discipline are most useful.
Percentages against a world average within each discipline are
more useful than basic numbers.
connecting you with information,
support and your community
Sceptical and informed!
connecting you with information,
support and your community