A screening template for knowledge synthesis: the IED-uOttawa algorithm

Abstract

When conducting a knowledge synthesis, the screening of studies appears to be the critical task and is the most time-consuming segment and human resources. The development of the IED-uOttawa was the result of a hands-on natural experience using several knowledge synthesis projects since 2019, with the intention of critically enhancing the screening task. The project intends to support and ease the screening stage of knowledge syntheses to judge the eligibility of studies for inclusion or exclusion. The IED-uOttawa development involved a 4-step process. First, we reviewed pertinent literature to learn about tools development and upgrading. Second, we piloted the tool from the collection of ex-ante experience and studies concerning the ongoing use of IED-uOttawa. Third, a qualitative study was conducted with 10 authors and research assistants to complement the results. Finally, we held a meeting to discuss the survey results and draft and refine the final IED-uOttawa. The analyses of experienced researchers and research assistants who have had hands-on experience working on several projects shed light on how IED-uOttawa offers a user-friendly and time-efficient experience at the screening stage of a review implementation process. In addition to being user-friendly and time-efficient, the IED-uOttawa tool allows users to improve the interrater reliability of the records at the screening stage of a knowledge synthesis project. Most current users (80%) of the IED-uOttawa appreciated its clarity and its structural logic. About 70% found it to be very helpful as it provides a clear-cut way to proceed during the screening stage. It easily fits into any other project involving knowledge synthesis or a form of it (e.g., concept analysis). From both ex-ante to current IED-uOttawa users, we anticipate that it will be of great benefit to research assistants, authors, and peer reviewers. Apart from easing the process, this tool could significantly reduce time burden and increase transparency, as well as reporting accuracy. In short, it will offer sufficient evidence for pertinent decision-making.