Resources

Bias Mitigation in Peer Review Training for Program Staff

Bias in peer review of grants and fellowships can affect funding decisions and lead to inequitable outcomes. To reduce the impact of bias during peer review, the Health Research Alliance (HRA) has developed a Bias Mitigation in Peer Review Training for Program Staff as part of our Inclusive Grantmaking Initiative. This training for staff is available for all HRA members. The training is available in two formats: 1) an asynchronous, self-directed online training, and 2) as a facilitator toolkit for those who would like to facilitate this training at their own organization.

Click the video below to play a brief overview of the training.

Training Contents

The HRA Bias Mitigation in Peer Review Training for Program Staff will define bias, discuss how bias can occur and present during peer review, and outline strategies that can mitigate the impact of bias on decision making. This training is online and totally asynchronous, and takes approximately 30-40 minutes to complete. The training contains short videos with audio voiceovers and closed captions, examples of realistic scenarios, and supplemental documents for future reference. The content is organized into three modules:

  1. Basics of Bias: Definition of bias, including types of bias and different manifestations of bias
  2. Bias in Peer Review: How bias can impact the peer review process
  3. Strategies for Mitigating Bias: Literature-informed, actionable, practical strategies staff can use to mitigate bias during the peer review process

Intended Audience

This training is designed for program staff at HRA member organizations. The content is situated within the context of peer review of grants, and the strategies and examples presented within the training are most directly relevant for staff at organizations who include live review committee meetings as part of their review process, though those who have other peer review processes may still find the information valuable.

This training was developed for an audience of program staff based on HRA member interests. In an interest survey distributed to Health HRA members in Fall 2022, respondents were asked who at their organization would benefit from a bias mitigation training. The most frequently chosen response (chosen by 78% of respondents) was program staff.

A separate training that is tailored for reviewers at HRA member organizations was released in February 2024. Learn more about HRA’s Bias Mitigation Training for Reviewers.

Access the Asynchronous Training

Visit the Members Only Bias Mitigation in Peer Review Training for Program Staff page for instructions to access the training (member login is required to access the page). If you are an employee at an HRA member organization and do not have a login, please contact Jenna Hicks at jenna [at] healthra [dot] org.

Access the Facilitator Toolkit

This toolkit equips HRA member organizations to facilitate the Bias Mitigation Training in a live session for program staff at their own organizations. The toolkit consists of a slide deck containing visuals, case study videos, and a facilitator script; handouts; and a detailed facilitator guide with supplemental discussion activities. The materials within the toolkit cover the same content as the asynchronous version of the training. Use these materials as-is, or customize to best fit your needs!

Visit the Members Only Bias Mitigation in Peer Review Training for Program Staff page for instructions to access the training (member login is required to access the page). If you are an employee at an HRA member organization and do not have a login, please contact Jenna Hicks at jenna [at] healthra [dot] org.

Development Team and Process

The Bias Mitigation in Peer Review Training for Program Staff was developed by the Health Research Alliance with invaluable contributions from volunteers from HRA member organizations, including:

  • Jenna Hicks, Inclusive Grantmaking Initiative Program Lead, HRA
  • Jessica Biddinger, National Senior Director, American Heart Association
  • Kim Lezak, Managing Director, Biomedical Research Grantmaking, Heath Resources in Action
  • Kevin Sia, Program Officer for Medical Research, Doris Duke Foundation
  • Maryrose Franko, Executive Director, HRA

A pilot version of the Bias Mitigation in Peer Review Training for Program Staff was tested with a small group of volunteers who had indicated an interest in learning more about the training on a membership-wide interest survey. Feedback from pilot testers informed the design of the current version of the training. Read the full pilot test evaluation report.