Skip to Main Content

Citations, Altmetrics and Researcher Profiles: Measure research performance

A guide to the key tools for measuring and describing your research performance, as well as setting up and managing your research profiles

Overview

Measuring research performance

As a researcher, you can use research performance measures to:

  • describe your research quality or engagement for grant, promotion or tenure applications
  • identify influential collaborators
  • identify high quality, impactful journals when publishing your research.

The measures included in this guide can be broadly categorised as citation metrics, altmetrics, and indicators of esteem. Your focus on particular measures will depend on your discipline, the purpose of the analysis and the types of research outputs included.

Use this guide to familiarise yourself with measures or indicators that can be used to positively inform your assessors.

Beyond this guide, the UWA Research Impact Toolkit can help you plan for, measure and describe research impact and engagement across the economic, environmental and social domains.

Citation Metrics

Citation metrics, also known as bibliometrics, are based on the number of citations research outputs receive. They can be used as indicators of usage and engagement with your research. Use citation databases and analysis tools to find:

  • researcher - specific metrics, including total citation numbers and the average, benchmarked performance of your body of publications
  • research output - specific metrics, including how often an output was cited and field-weighted indicators
  • journal metrics, like the ranking of journals in a field, based on article citation numbers.

Citation analysis is generally considered a good and cost effective but not perfect measure of research quality. The value placed on citation and citation analysis varies across disciplines. 

There is no single citation analysis tool that collects all publications and their cited references. ScopusWeb of Science and Google Scholar are the key databases for obtaining citation metrics. There may be differences in the citation counts and your h-index between these database as each only counts the citations that appear in the journals and books that they index, and the scope of each database varies.

See below for more detail about these citation databases.

 

Altmetrics

Alternative metrics, or altmetrics, measure how many times a research output has been shared, mentioned or downloaded from online sources such as social media sites, blogs, mainstream media and reference managers.  The data is accumulated at a faster rate compared to traditional citation-based measures. 

Altmetrics compliment traditional impact measurement methods and are a good alternative for disciplines such as Humanities and Social Sciences where traditional metrics are not as useful for measuring impact.

See the Altmetrics sources box below for more information.

Indicators of esteem

Indicators of esteem, such as awards, journal editorship, commissions, reviews, library holdings and many more, can also be used when describing the significance of your research. They are particularly useful for describing the importance of non-traditional research outputs, and for disciplines where citation of others' work is rare or takes longer because books are the primary form of publication.

Before you begin

Before you begin to gather your citation metrics, ensure that you have an up to date profile in each of the databases you will be using. This table introduces the researcher profiles that UWA researchers should have set up and manage.

In addition to enabling you to track engagement with your research outputs, researcher profiles increase the visibility and potential discovery of your  outputs - which may in turn lead to future citation and impact. Grant assessors, potential collaborators, practitioners and the general public may all find your profiles, so it is important to keep them current.

Citation databases

Scopus is a comprehensive abstract and citation database covering the scientific, medical, technical and social science subject areas. It includes abstracts from 1966 onwards, and cited references from 1996, enabling researchers to track where, by whom, and how often an article has been cited.

As well as citation numbers, Scopus provides a number of other citation-based metrics for evaluating the impact of articles, journals and authors, including the Field-Weighted Citation Index (FCWI).

SciVal enables users to analyse publications at an individual, group and institutional level using Scopus data. SciVal enables users to visualise research performance, benchmark against peers using a number of metrics, review co-author networks and identify potential collaborative partnerships.

The Introduction to SciVal page in the SciVal Support Hub contains some useful introductory material on SciVal and the different modules.

Note: Scopus and thus SciVal data is limited to citation of publications in other Scopus-indexed publications. Coverage of humanities literature is limited.

There are some useful tutorials available to help you navigate your way around the Scopus database: Scopus tutorials.

Web of Science is a comprehensive abstract and citation database covering a broad range of subject areas. It enables researchers to track where, by whom, and how often an article has been cited. While Web of Science provides many citation-based metrics, even more including the Category Normalized Citation Index (CNCI), can be accessed through InCites (Benchmarking and Analytics), an analytical tool using Web of Science data.

Note: Web of Science data is limited to citation of publications in other web of Science-indexed publications. Coverage of humanities and social sciences literature is limited.

Web of Science tutorials:

Watch the Getting help in InCites video, below, to find relevant Incites tutorial

Google Scholar provides access to scholarly content that is indexed by Google. Users can search for articles, theses, books, abstracts and court opinions, from academic publishers, professional societies, online repositories, universities and other websites. Each publication record indicates the number of times the publication has been cited within another Google Scholar-indexed publication. By clicking on the citation total you can link to the list of citing publications.

Authors who have a Google Scholar Profile can find the citations for all of their publications in the one location, along with their Google Scholar H-index. A profile also allows you to ensure that publications are correctly attributed to you in the database. Check your profile regularly for accuracy.

Dimensions is a comprehensive abstract and citation database with over 100 million publications in science, health, humanities and social sciences. Dimensions includes journal articles, preprints, edited books, book chapters and monographs relating to research, indexed via Crossref, PubMed, PubMed Central, arXiv.org and more that 160 publishers directly.

A free version of Dimensions is available that provides access to citation metrics for research outputs and researchers. Though it does not provide access to all of the features of the platform, it is able to provide citation totals for research outputs and authors and provides analysis by field of research, author and source.

How to search in Dimensions

Quick Start Guide

More instructions for finding citation numbers and other citation-based metrics can be found on:

Altmetrics sources

Two popular altmetrics platforms are PlumX  and Altmetric.com . These platforms differ in the way they source and report metrics.

UWA researchers can find altmetrics for their individual publications on their public profiles page of the UWA Profiles and Research Repository.

 Altmetric.com 

Altmetric sources data from social media, traditional media and online reference managers to track the level of attention a research output is receiving online. Altmetric disambiguates links to outputs and looks at the quantity and quality of the attention an output is receiving. This information is then displayed visually in the Altmetric circle or donut. The Altmetric.com donut can be seen on the UWA Profiles and Research Repository, many publisher and journal websites, plus as a third party application in Scopus.

Altmetric.com offers a free Altmetric it! bookmarklet for Chrome, Firefox and Safari.

Images:    
(Above) Altmetric it! Bookmarklet from https://www.altmetric.com/products/free-tools/bookmarklet/ 
(Right) Altmetric bookmarklet result for the article: King, T. E., Fortes, G. G., Balaresque, P., Thomas, M. G., Balding, D., Delser, P. M., . . . Schürer, K. (2014). Identification of the remains of King Richard III. Nature Communications, 5. Retrieved from http://dx.doi.org/10.1038/ncomms6631 

PlumX  

PlumX gathers metrics for scholarly research output and categorises these into five separate metric types: Usage, Captures, Mentions, Social Media, and Citations.

As of 01/09/2023 PlumX have ceased gathering and displaying Twitter metrics due to changes to the social media site Twitter (or "X").

PlumX uses a range of identifiers to track the metrics of research outputs across a wide range of sources.

The PlumX PlumPrint represents a publication's available metrics, with each metric type allocated a colour. Further metric details can be viewed by hovering over the PlumPrint or by clicking the see details link. In the UWA Profiles and Research Repository the PlumPrint is embedded at the research output level. 

For more information about PlumX, please see the PlumX About PlumX Metrics webpage or contact a UWA Librarian.

Citations, Usage, Captures, Mentions, Social Media

Images:
(Above) from: About PlumX Metrics
PlumX PlumPrint example from: http://plumanalytics.com/plumx-widget-review/

 

  PlumX Altmetric

Types of research output tracked

Blogs, Books, Book chapters, Cases, Clinical trials, Conference , Paper, Datasets, Dissertations, Figures, Grants, Interviews, Journal articles, Media, Patents, Posters, Slide Presentations, Software/Sourcecode, Videos, Web Pages 

For a comprehensive list of artifacts gathered please consult PlumX's About Artifacts

Altmetric blog provides information on the attention score and their sources in their post "Numbers behind Numbers: The Altmetric Attention Score and Sources Explained".

Identifiers used to track research output

DOI, URL, ISBNs, PubMedID, PebMed Cenral IDs, arXiv IDs, OCLC numbers, RePEc ID, SSRN IDs, Vimeo IDs, GitHub IDS or URLS, SourceForge IDs, US Patent Publication IDs, ClinicalTrials.gov IDs.

PubMedID, arXiv ID, ADS ID, SSRN ID, RePEC ID, Handle.net identifers, URN, ISNDs, DOIs.

from Altmetric's Tracking and collating attention

Metrics collected
  1. Usage: clicks, downloads, views, library holdings, video plays              
  2. Captures : bookmarks, code forks, favourites, readers, watcher          
  3. Mentions: blog posts, comments, reviews, Wikipedia links                    
  4. Social media: +1s, likes, shares, Tweets (PlumX ceased tracking activity on Twitter 01/09/2023)        
  5. Citations: PubMed Central, Scopus, USPTO
Full list of PlumX metrics
  • Social media mentions
  • Traditional media (mainstream and science specific)
  • Online reference managers

Altmetric's Sources of Attention 

Score calculation No score allocated Altmetric score derived from 3 main factors:
  • Volume of mentions (1 mention per person, per source)
  • Source of mentions (e.g. newspaper, blog, tweet)
  • Authors (who is the author, audience, bias?)

The donut and score

ORCID integration Yes Yes
API/Widgets PlumX embeddable widgets Free API for non-commercial use and embeddable badges
Subscription model Subscription-based Subscription-based Altmetric for Institutions.
Free use of Altmetric.com bookmarklet 
 

 

It is becoming more common for academic researchers to raise the profile of their research in the community through Social Networking and other similar websites. Below is a list of suggested resources:

  • The Conversation: Write for academic-specific media outlets. 
  • LinkedIn: A professional networking site. Free access.
  • Research Gate: Connect with other academic researchers.
  • Academia.edu: Connect with other academic researchers.
  • X(Twitter): Share short updates about your research.
  • Facebook: Create a Facebook page for your research group.
  • Blogs: Start a blog to share your research.
  • YouTube: Use multimedia to share your research.

In November 2021, UWA Library hosted a panel discussion with researchers from a range of disciplines on socialising their research (60 mins):

CONTENT LICENCE

 Except for logos, Canva designs, AI generated images or where otherwise indicated, content in this guide is licensed under a Creative Commons Attribution-ShareAlike 4.0 International Licence.