Evaluating Excellence: Implications of Bibliometric Indicators for Equity

In recent years the methods, criteria, and processes through which the quality, impact and value of academic work are evaluated and measured have come under increasing scrutiny. Academic assessment methods in virtually all fields have focused on quantitative metrics such as publication counts, journal rankings, and h-index scores, but initiatives such as the Coalition for Advancing Research Assessment and DORA have been advocating for the diversification of evaluation methods and of the outputs which are valued.  

Informed by his extensive record of research on bibliometrics and scientometrics, Dr. Vincent Larivière will discuss key concerns and challenges associated with some metrics that are heavily used in researcher evaluation, such as the Journal Impact Factor (JIF) and H-index. How objective are such metrics? Do they advantage some groups over others? What are the implications of using JIF and H-index in researcher evaluation for open science, decolonization of academic research, and individual and organizational wellbeing? Together with discussant Dr. Tanja Tajmel of Concordia’s Centre for Engineering in Society and attendees, Dr. Larivière will also discuss possible best practices for the use of indicators in researcher evaluation. 

This talk is the second event in the Evaluating Excellence: Rethinking Academic Assessment speaker series co-sponsored by the OVPRGS and the Provost’s Office. The series aims to provide a platform for insightful discussions and practical advice about the evolving landscape of academic assessment and inclusive excellence. It will feature prominent leaders in academia, policy, and academic administration who are at the forefront of driving this transformation. 

Lunch will be served onsite at 12pm, and the event will begin at 12:15pm.

How can you participate? Join us online by watching live on YouTube.

Have questions? Send them to info.4@concordia.ca

Vincent Larivière

Université de Montréal

Vincent Larivière is the UNESCO Chair in Open Science and a full professor of information science at the École de bibliothéconomie et des sciences de l'information, Université de Montréal, where he teaches research methods and bibliometrics. He is also the scientific director of the Érudit journal platform, associate scientific director of the Observatoire des sciences et des technologies, Vice-Rector of strategic planning and communications at l’Université de Montréal, and a regular member of the Centre interuniversitaire de recherche sur la science et la technologie. From 2013-2023, he was the Canada Research Chair on the Transformations of Scholarly Communication. He is a co-author of the recent book Equity for Women in Science: Dismantling Systemic Barriers to Advancement (2023). 

Tanja Tajmel

Concordia University

Tanja Tajmel, Associate Professor, Centre for Engineering in Society, Gina Cody School of Engineering and Computer Science, Concordia University, Montreal, holds a Concordia University Research Chair (Tier 2) in “Equity, Diversity and Inclusion (EDI) in Science, Technology, Engineering and Mathematics (STEM)” and is leading the EDI Research Lab.

For many years, Dr. Tajmel has been engaged in implementing principles of Equity, Diversity and Inclusion (EDI) in academic practices, teaching, and research and in mentoring and empowering women and members from marginalized groups in academia. Her work focusses on EDI in science and technology, the relation of colonialism and science, the impact of Artificial Intelligence on society, and on the development of frameworks and policies for socially equitable technology.

Organized by Concordia’s Office of the Vice-President, Research and Graduate Studies and Office of the Provost and VP, Academic.

Funding for this series is provided by the Canada Research Chairs Program Equity, Diversity, and Inclusion Grant.