The following tools have been assessed by the LATITUDES team but do not meet criteria for inclusion in the library:
| Tool Name | Design | Exclusion Reason | Publication |
| AHRQ guidance | RCT | Not report of tool | Viswanathan M PC, Berkman ND, Bass EB, Chang S, Hartling L, Murad HM, Treadwell JR, Kane RL. Assessing the Risk of Bias in Systematic Reviews of Health Care Interventions. In: Quality AfHRa, editor. Methods Guide for Comparative Effectiveness ReviewsRock |
| AHRQ outcome and analysis reporting bias framework | Reporting bias | Not validity assessment | Balshem H, Stevens A, Ansari M, Norris S, Kansagara D, Shamliyan T, et al. AHRQ Methods for Effective Health Ca. Finding Grey Literature Evidence and Assessing for Outcome and Analysis Reporting Biases When Comparing Medical Interventions: AHRQ and the E |
| Andrews | DTA | Not used<10 years | Andrew E. Method for assessment of the reporting standard of clinical trials with roentgen contrast media. Acta Radiol Diagn (Stockh). 1984;25(1):55-8. |
| Angelillo | Observational (mixed) | Minor adaptation of existing tools; Developed specifically for this SR | Angelillo IF, Villari P. Residential exposure to electromagnetic fields and childhood leukaemia: a meta-analysis. Bull World Health Organ 1999;77(11) |
| Annals | reporting guideline | Reporting guideline | Goodman SN, Berlin J, Fletcher SW, Fletcher RH. Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121(1):11-21 |
| Antczak | Observational (mixed) | Not targeted at evidence synthesis | Antczak AA, Tang J, Chalmers TC. Quality assessment of randomized control trials in dental research. I. Methods. J Periodontal Res 1986;21(4) |
| Audet | Observational (mixed) | Minor adaptation of existing tool | Audet N, Gagnon R, Ladouceur R, Marcil M. [How effective is the teaching of critical analysis of scientific publications? Review of studies and their methodological quality]. Cmaj 1993;148(6) |
| Beckerman | RCT | Developed specifically for the review; not targeted at wider research community | Beckerman H, de Bie RA, Bouter LM, De Cuyper HJ, Oostendorp RA. The efficacy of laser therapy for musculoskeletal and skin disorders: a criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72(7):483-91. |
| Bours | Observational (mixed) | Minor adaptation of existing tools; Developed specifically for this SR | Bours GJ, Ketelaars CA, Frederiks CM, Abu-Saad HH, Wouters EF. The effects of aftercare on chronic patients and frail elderly patients when discharged from hospital: a systematic review. J Adv Nurs 1998;27(5) |
| Brown | Observational (mixed) | Minor adaptation of existing tool | Brown SA. Measurement of quality of primary studies for meta-analysis. Nurs Res. 1991;40(6):352-5. |
| Cameron | Observational (mixed) | Not used<10 years | I Cameron, M Crotty, C Currie, T Finnegan, L Gillespie, W Gillespie, et al. Geriatric rehabilitation following fractures in older people: a systematic review. 2000. |
| Campos-Outcalt | Observational (mixed) | Developed specifically for this SR | Campos-Outcalt D, Senf J, Watkins AJ, Bastacky S. The effects of medical school curricula, faculty role models, and biomedical research support on choice of generalist physician careers: a review and quality assessment of the literature. Acad Med 1995;70 |
| Carter | Observational (mixed) | Minor adaptation of existing tool | Carter J, MJ. V. Efficacy of self-help and alternative treatments of premenstrual syndrome. . 1995. |
| CASP: CC | Case-control | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Case control) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Case-Control-Study-Checklist/CASP-Case-Control-Study-Checklist-2018-fillable-form.pdf Accessed: 22nd July |
| CASP: clinical prediction | Clinical prediction rule | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Clinical prediction rule) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Clinical-Prediction-Rule-Checklist/CASP-Clinical-Prediction-Rule-Checklist_2018_fillable_form |
| CASP: DTA | DTA | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (DTA) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Diagnostic-Study-Checklist/CASP-Diagnostic-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 |
| CASP: Economic | Economic | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Economic Evaluation) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Economic-Evaluation-Checklist/CASP-Economic-Evaluation-Checklist-2018_fillable_form.pdf Accessed: |
| CASP:CASP cohort | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Cohort) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Cohort-Study-Checklist/CASP-Cohort-Study-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 | |
| CASP:RCT | RCT | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (RCT) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Randomised-Controlled-Trial-Checklist/CASP-RCT-Checklist-PDF-Fillable-Form.pdf Accessed: 22nd July 2023 |
| CASP:SR | Systematic Review | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Systematic review) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Systematic-Review-Checklist/CASP-Systematic-Review-Checklist-2018_fillable-form.pdf Accessed: 22nd |
| Chalmers, I | RCT | Not targeted at evidence synthesis | Chalmers I, Adams M, Dickersin K, Hetherington J, Tarnow-Mordi W, Meinert C, et al. A cohort study of summary reports of controlled trials. Jama 1990;263(10) |
| Chalmers, TC | RCT | Not targeted at evidence synthesis | Chalmers TC, Smith H, Blackburn B, Silverman B, Schroeder B, Reitman D, et al. A method for assessing the quality of a randomized control trial. Controlled Clinical Trials 1981;2(1) |
| CHAMP | Statistical analysis | Not targeted at evidence synthesis – aimed at peer review | Mansournia MA, Collins GS, Nielsen RO, Nazemipour M, Jewell NP, Altman DG, et al. CHecklist for statistical Assessment of Medical Papers: the CHAMP statement. British Journal of Sports Medicine 2021;55(18) |
| CHEERS | Economic | Not validity assessment – reporting guideline | Husereau D, Drummond M, Augustovski F, de Bekker-Grob E, Briggs AH, Carswell C, et al. Consolidated health economic evaluation reporting standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. Int J Technol Ass |
| CiNeMA | Network meta-analysis | Not validity assessment – confident in body of evidence (like GRADE) | Adriani Nikolakopoulou, Julian P. T. Higgins, Theodoros Papakonstantinou, Anna Chaimani, Cinzia Del Giovane, Matthias Egger, et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLOS Medicine 2020 |
| Cochrane Working Group | DTA | Not used<10 years | Cochrane Methods Working Group. Cochrane Methods Working Group on Systematic Review of Screening and Diagnostic Tests: recommended methods [Internet] 1996 [Available from: https://www.cochrane.org/docs/sadtdoc1.htm. |
| Colditz | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | GA Colditz, JN Miller, Mosteller F. How study design affects outcomes in comparison of therapy. Med Stat Med. 1989;8. |
| COREQ checklist | Qualitative | Reporting guideline | Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care 2007;19(6) |
| COSMIN | Reliability | Not targeted at evidence synthesis – aims to help select outcome measurement instruments | Mokkink LB, Boers M, van der Vleuten CPM, Bouter LM, Alonso J, Patrick DL, et al. COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study. BMC Medical Research Metho |
| Cowley | Observational (mixed) | Minor adaptation of existing tool | Cowley DE. Prostheses for primary total hip replacement. A critical appraisal of the literature. Int J Technol Assess Health Care. 1995;11(4):770-8. |
| de Boer | Observational (mixed) | Not a report of a new tool | de Boer AG, Verbeek JH, van Dijk FJ. Adult survivors of childhood cancer and unemployment: A metaanalysis. Cancer 2006;107(1) |
| Detsky | RCT | Minor adaptation of existing tools | Detsky AS, Naylor CD, O’Rourke K, McGeer AJ, L’Abbé KA. Incorporating variations in the quality of individual randomized trials into meta-analysis. J Clin Epidemiol. 1992;45(3):255-65. |
| EPOC ROB Tool | Mixed | Adapted from Cochrane Handbook | Cochrane Effective Practice and Organisation of Care (EPOC). Suggested risk of bias criteria for EPOC reviews. 2023. URL: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/suggested_risk_of_bias_criteria_for |
| Framework for evaluating quality of evidence from a network meta-analysis | Network meta-analysis | Not validity assessment – GRADE type approach | Salanti G, Del Giovane C, Chaimani A, Caldwell DM, Higgins JPT. Evaluating the Quality of Evidence from a Network Meta-Analysis. PLOS ONE 2014;9(7) |
| GRADE | NA | Not validity assessment | See website |
| Kay | Observational (mixed) | Developed specifically for this review – not targeted at wider research community | Kay EJ, Locker D. Is dental health education effective? A systematic review of current evidence. Community Dent Oral Epidemiol 1996;24(4) |
| Khan | DTA | Suggestions of criteria to consider; not a tool | Khan KS, Dinnes J, Kleijnen J. Systematic reviews to evaluate diagnostic tests. Eur J Obstet Gynecol Reprod Biol 2001;95(1) |
| Koes | RCT | Minor adaptation of existing tool | Koes BW, Assendelft WJ, van der Heijden GJ, Bouter LM, Knipschild PG. Spinal manipulation and mobilisation for back and neck pain: a blinded review. British Medical Journal 1991;303(6813) |
| Kreulen | Observational (mixed) | Minor adaptation of existing tool | Kreulen CM, Creugers NH, Meijering AC. Meta-analysis of anterior veneer restorations in clinical studies. J Dent. 1998;26(4):345-53. |
| Kwakkel | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Kwakkel G, Wagenaar RC, Koelman TW, Lankhorst GJ, Koetsier JC. Effects of intensity of rehabilitation after stroke. A research synthesis. Stroke. 1997;28(8):1550-6. |
| Lee | Observational (mixed) | Not primary report of tool | Lee TM, Chan CC, Paterson JG, Janzen HL, Blashko CA. Spectral properties of phototherapy for seasonal affective disorder: a meta-analysis. Acta Psychiatr Scand. 1997;96(2):117-21. |
| Lee | Case studies | General critical appraisal | Lee E, Mishna F, Brennenstuhl S: How to critically evaluate case studies in social work. Research on Social Work Practice 2010, 20(6):682-689. |
| MacMillan | Observational (mixed) | Minor adaptation of existing tool | MacMillan HL, MacMillan JH, Offord DR, Griffith L, MacMillan A. Primary prevention of child physical abuse and neglect: a critical review. Part I. J Child Psychol Psychiatry. 1994;35(5):835-56. |
| Marq checklist | Overview | Aimed at reporting quality not validity | Singh JP. Development of the Metareview Assessment of Reporting Quality (MARQ) Checklist. Rev Fac Med. 2012;60:285-92. |
| MASTER Scale | Developed specifically for the review; not targeted at wider research community | ||
| ORBIT-I | Reporting bias | Not validity assessment -reporting bias | Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365. |
| ORBIT-II classification for harms outcome | Reporting bias | Not validity assessment -reporting bias | Saini P, Loke YK, Gamble C, Altman DG, Williamson PR, Kirkham JJ. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349. |
| PHW Cost of illness checklist | Cost of illness studies | NA | Cost of illness checklist |
| R-AMSTAR | Systematic Review | Minor adaptation of existing tool | Kung J, Chiappelli F, Cajulis OO, Avezova R, Kossan G, Chew L, et al. From Systematic Reviews to Clinical Recommendations for Evidence-Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Re |
| Selective reporting bias algorithm | Reporting bias | Not validity assessment | Reid EK, Tejani AM, Huan LN, Egan G, O’Sullivan C, Mayhew AD, et al. Managing the incidence of selective reporting bias: a survey of Cochrane review groups. Syst Rev. 2015;4:85. |
| Sign1_SR | Systematic Review | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign2_RCT | RCT | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign3_Cohort | Cohort | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign4_CC | Case-control | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign5_DTA | DTA | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign6_Economic | Economic | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Spencer-Green | Observational (mixed) | ||
| STNS Score | Reporting guideline | Akram H, Mirza B, Kitchen N, Zakrzewska JM. Proposal for evaluating the quality of reports of surgical interventions in the treatment of trigeminal neuralgia: the Surgical Trigeminal Neuralgia Score. Neurosurg Focus. 2013;35(3):E3. | |
| TECH-VER | Economic models to verify technical implementatopm | Designed to assess model validity | Büyükkaramikli NC, Rutten-van Mölken M, Severens JL, Al M. TECH-VER: A Verification Checklist to Reduce Errors in Models and Improve Their Credibility. Pharmacoeconomics. 2019;37(11):1391-408. |
| Vickers | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Vickers AJ. Can acupuncture have specific effects on health? A systematic review of acupuncture antiemesis trials. J R Soc Med. 1996;89(6):303-11. |
| Wingood | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Wingood GM, DiClemente RJ. HIV sexual risk reduction interventions for women: a review. Am J Prev Med. 1996;12(3):209-17. |
| Wright | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Wright J, Dye R. Systematic review on obstructive sleep apnoea: its effect on health and benefit of treatment. 1996. |
| Zaza | Observational (mixed) | Not validity assessment | Zaza S, Wright-De Agüero LK, Briss PA, Truman BI, Hopkins DP, Hennessy MH, et al. Data collection instrument and procedure for systematic reviews in the Guide to Community Preventive Services. Task Force on Community Preventive Services. Am J Prev Med. 20 |