Library of risk of bias tools

Recommended by LATITUDES ROBIS

Study design(s) targeted by the tool Systematic reviewssystematic-review
Additional details on designs All types of SR
Tool area Health
Link to the tool Get the ROBIS tool (PDF)

Details

Website https://www.bristol.ac.uk/population-health-sciences/projects/robis/robis-tool/
Primary publication Whiting P, Savovic J, Higgins JP, Caldwell DM, Reeves BC, Shea B, et al. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol 2016;69
DOI 10.1016/j.jclinepi.2015.06.005
Guidance document Get the ROBIS guidance (PDF)
Training

Webinar delivered by the ROBIS tool developer.

Language English
Translations

Portuguese

Record last updated 22/06/2023

Related tools and Publications

Previous versions

None

Updated versions

None

Related tools

None

Evaluations

Gates A, Gates M, Duarte G, Cary M, Becker M, Prediger B, Vandermeer B, Fernandes RM, Pieper D, Hartling L. Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study. Systematic Reviews. 2018 Dec;7(1):1-7.

Pieper D, Puljak L, González-Lorenzo M, Minozzi S. Minor differences were found between AMSTAR 2 and ROBIS in the assessment of systematic reviews including both randomized and nonrandomized studies. Journal of clinical epidemiology. 2019 Apr 1;108:26-33.

Banzi R, Cinquini M, Gonzalez-Lorenzo M, Pecoraro V, Capobussi M, Minozzi S. Quality assessment versus risk of bias in systematic reviews: AMSTAR and ROBIS had similar reliability but differed in their construct and applicability. Journal of clinical epidemiology. 2018 Jul 1;99:24-32.

Perry R, Whitmarsh A, Leach V, Davies P. A comparison of two assessment tools used in overviews of systematic reviews: ROBIS versus AMSTAR-2. Systematic reviews. 2021 Dec;10:1-20.

Swierz MJ, Storman D, Zajac J, Koperny M, Weglarz P, Staskiewicz W, Gorecka M, Skuza A, Wach A, Kaluzinska K, Bochenek-Cibor J. Similarities, reliability and gaps in assessing the quality of conduct of systematic reviews using AMSTAR-2 and ROBIS: systematic survey of nutrition reviews. BMC Medical Research Methodology. 2021 Dec;21:1-0.

Banzi R, Cinquini M, Gonzalez-Lorenzo M, Pecoraro V, Capobussi M, Minozzi S. Quality assessment versus risk of bias in systematic reviews: AMSTAR and ROBIS had similar reliability but differed in their construct and applicability. Journal of clinical epidemiology. 2018 Jul 1;99:24-32.

Other publications

None known – please contact us if you are aware of any publications that should be listed here.

Key Criteria

Focuses on risk of bias, or makes a distinction between items that assess risk of bias and other aspects of study quality Yes
Offers a method to reach either a domain specific or overall assessment of risk of bias Yes
Tool development involving a range of stakeholders from different disciplines (e.g. methodologists, statisticians, clinicians) Yes
Avoids recommending use of summary numerical quality scores Yes