The following tools have been assessed by the LATITUDES team but do not meet criteria for inclusion in the library:
| Tool Name | Design | Exclusion Reason | Publication |
| AHRQ outcome and analysis reporting bias framework | Reporting bias | Not validity assessment | Balshem H, Stevens A, Ansari M, Norris S, Kansagara D, Shamliyan T, et al. AHRQ Methods for Effective Health Ca. Finding Grey Literature Evidence and Assessing for Outcome and Analysis Reporting Biases When Comparing Medical Interventions: AHRQ and the Effective Health Care Program. In: Methods Guide for Effectiveness and Comparative Effectiveness ReviewsRockville (MD): Agency for Healthcare Research and Quality (US); 2008. |
| AHRQ guidance | RCT | Not report of tool | Viswanathan M PC, Berkman ND, Bass EB, Chang S, Hartling L, Murad HM, Treadwell JR, Kane RL. Assessing the Risk of Bias in Systematic Reviews of Health Care Interventions. In: Quality AfHRa, editor. Methods Guide for Comparative Effectiveness ReviewsRockville, MD: AHRQ Publication No. 17(18)-EHC036-EF; 2017. URL: https://doi.org/10.23970/AHRQEPCMETHGUIDE2.) |
| Andrews | DTA | Not used<10 years | Andrew E. Method for assessment of the reporting standard of clinical trials with roentgen contrast media. Acta Radiol Diagn (Stockh). 1984;25(1):55-8. |
| Angelillo | Observational (mixed) | Minor adaptation of existing tools; Developed specifically for this SR | Angelillo IF, Villari P. Residential exposure to electromagnetic fields and childhood leukaemia: a meta-analysis. Bull World Health Organ 1999;77(11) |
| Annals | reporting guideline | Reporting guideline | Goodman SN, Berlin J, Fletcher SW, Fletcher RH. Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121(1):11-21 |
| Antczak | Observational (mixed) | Not targeted at evidence synthesis | Antczak AA, Tang J, Chalmers TC. Quality assessment of randomized control trials in dental research. I. Methods. J Periodontal Res 1986;21(4) |
| Audet | Observational (mixed) | Minor adaptation of existing tool | Audet N, Gagnon R, Ladouceur R, Marcil M. [How effective is the teaching of critical analysis of scientific publications? Review of studies and their methodological quality]. Cmaj 1993;148(6) |
| Beckerman | RCT | Developed specifically for the review; not targeted at wider research community | Beckerman H, de Bie RA, Bouter LM, De Cuyper HJ, Oostendorp RA. The efficacy of laser therapy for musculoskeletal and skin disorders: a criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72(7):483-91. |
| Bours | Observational (mixed) | Minor adaptation of existing tools; Developed specifically for this SR | Bours GJ, Ketelaars CA, Frederiks CM, Abu-Saad HH, Wouters EF. The effects of aftercare on chronic patients and frail elderly patients when discharged from hospital: a systematic review. J Adv Nurs 1998;27(5) |
| Brown | Observational (mixed) | Minor adaptation of existing tool | Brown SA. Measurement of quality of primary studies for meta-analysis. Nurs Res. 1991;40(6):352-5. |
| Cameron | Observational (mixed) | Not used<10 years | I Cameron, M Crotty, C Currie, T Finnegan, L Gillespie, W Gillespie, et al. Geriatric rehabilitation following fractures in older people: a systematic review. 2000. |
| Campos-Outcalt | Observational (mixed) | Developed specifically for this SR | Campos-Outcalt D, Senf J, Watkins AJ, Bastacky S. The effects of medical school curricula, faculty role models, and biomedical research support on choice of generalist physician careers: a review and quality assessment of the literature. Acad Med 1995;70(7) |
| Carter | Observational (mixed) | Minor adaptation of existing tool | Carter J, MJ. V. Efficacy of self-help and alternative treatments of premenstrual syndrome. . 1995. |
| Chalmers, I | RCT | Not targeted at evidence synthesis | Chalmers I, Adams M, Dickersin K, Hetherington J, Tarnow-Mordi W, Meinert C, et al. A cohort study of summary reports of controlled trials. Jama 1990;263(10) |
| Chalmers, TC | RCT | Not targeted at evidence synthesis | Chalmers TC, Smith H, Blackburn B, Silverman B, Schroeder B, Reitman D, et al. A method for assessing the quality of a randomized control trial. Controlled Clinical Trials 1981;2(1) |
| CHAMP | Statistical analysis | Not targeted at evidence synthesis – aimed at peer review | Mansournia MA, Collins GS, Nielsen RO, Nazemipour M, Jewell NP, Altman DG, et al. CHecklist for statistical Assessment of Medical Papers: the CHAMP statement. British Journal of Sports Medicine 2021;55(18) |
| CHEERS | Economic | Not validity assessment – reporting guideline | Husereau D, Drummond M, Augustovski F, de Bekker-Grob E, Briggs AH, Carswell C, et al. Consolidated health economic evaluation reporting standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. Int J Technol Assess Health Care 2022;38(1) |
| CiNeMA | Network meta-analysis | Not validity assessment – confident in body of evidence (like GRADE) | Adriani Nikolakopoulou, Julian P. T. Higgins, Theodoros Papakonstantinou, Anna Chaimani, Cinzia Del Giovane, Matthias Egger, et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLOS Medicine 2020 |
| Cochrane Working Group | DTA | Not used<10 years | Cochrane Methods Working Group. Cochrane Methods Working Group on Systematic Review of Screening and Diagnostic Tests: recommended methods [Internet] 1996 [Available from: https://www.cochrane.org/docs/sadtdoc1.htm. |
| Colditz | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | GA Colditz, JN Miller, Mosteller F. How study design affects outcomes in comparison of therapy. Med Stat Med. 1989;8. |
| COREQ checklist | Qualitative | Reporting guideline | Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care 2007;19(6) |
| COSMIN | Reliability | Not targeted at evidence synthesis – aims to help select outcome measurement instruments | Mokkink LB, Boers M, van der Vleuten CPM, Bouter LM, Alonso J, Patrick DL, et al. COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study. BMC Medical Research Methodology 2020;20(1) |
| Cowley | Observational (mixed) | Minor adaptation of existing tool | Cowley DE. Prostheses for primary total hip replacement. A critical appraisal of the literature. Int J Technol Assess Health Care. 1995;11(4):770-8. |
| de Boer | Observational (mixed) | Not a report of a new tool | de Boer AG, Verbeek JH, van Dijk FJ. Adult survivors of childhood cancer and unemployment: A metaanalysis. Cancer 2006;107(1) |
| EPOC ROB Tool | Mixed | Adapted from Cochrane Handbook | Cochrane Effective Practice and Organisation of Care (EPOC). Suggested risk of bias criteria for EPOC reviews. 2023. URL: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/suggested_risk_of_bias_criteria_for_epoc_reviews.pdf). |
| Framework for evaluating quality of evidence from a network meta-analysis | Network meta-analysis | Not validity assessment – GRADE type approach | Salanti G, Del Giovane C, Chaimani A, Caldwell DM, Higgins JPT. Evaluating the Quality of Evidence from a Network Meta-Analysis. PLOS ONE 2014;9(7) |
| GRADE | NA | Not validity assessment | See website |
| Kay | Observational (mixed) | Developed specifically for this review – not targeted at wider research community | Kay EJ, Locker D. Is dental health education effective? A systematic review of current evidence. Community Dent Oral Epidemiol 1996;24(4) |
| Khan | DTA | Suggestions of criteria to consider; not a tool | Khan KS, Dinnes J, Kleijnen J. Systematic reviews to evaluate diagnostic tests. Eur J Obstet Gynecol Reprod Biol 2001;95(1) |
| Koes | RCT | Minor adaptation of existing tool | Koes BW, Assendelft WJ, van der Heijden GJ, Bouter LM, Knipschild PG. Spinal manipulation and mobilisation for back and neck pain: a blinded review. British Medical Journal 1991;303(6813) |
| Kreulen | Observational (mixed) | Minor adaptation of existing tool | Kreulen CM, Creugers NH, Meijering AC. Meta-analysis of anterior veneer restorations in clinical studies. J Dent. 1998;26(4):345-53. |
| Kwakkel | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Kwakkel G, Wagenaar RC, Koelman TW, Lankhorst GJ, Koetsier JC. Effects of intensity of rehabilitation after stroke. A research synthesis. Stroke. 1997;28(8):1550-6. |
| Lee | Observational (mixed) | Not primary report of tool | Lee TM, Chan CC, Paterson JG, Janzen HL, Blashko CA. Spectral properties of phototherapy for seasonal affective disorder: a meta-analysis. Acta Psychiatr Scand. 1997;96(2):117-21. |
| MacMillan | Observational (mixed) | Minor adaptation of existing tool | MacMillan HL, MacMillan JH, Offord DR, Griffith L, MacMillan A. Primary prevention of child physical abuse and neglect: a critical review. Part I. J Child Psychol Psychiatry. 1994;35(5):835-56. |
| Marq checklist | Overview | Aimed at reporting quality not validity | Singh JP. Development of the Metareview Assessment of Reporting Quality (MARQ) Checklist. Rev Fac Med. 2012;60:285-92. |
| ORBIT-I | Reporting bias | Not validity assessment -reporting bias | Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365. |
| ORBIT-II classification for harms outcome | Reporting bias | Not validity assessment -reporting bias | Saini P, Loke YK, Gamble C, Altman DG, Williamson PR, Kirkham JJ. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349. |
| Selective reporting bias algorithm | Reporting bias | Not validity assessment | Reid EK, Tejani AM, Huan LN, Egan G, O’Sullivan C, Mayhew AD, et al. Managing the incidence of selective reporting bias: a survey of Cochrane review groups. Syst Rev. 2015;4:85. |
| Sign1_SR | Systematic Review | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign2_RCT | RCT | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign3_Cohort | Cohort | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign4_CC | Case-control | General critical appraisal | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign5_DTA | DTA | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| Sign6_Economic | Economic | Minor adaptation of existing tool | https://www.sign.ac.uk/what-we-do/methodology/checklists/ |
| STNS Score | Reporting guideline | Akram H, Mirza B, Kitchen N, Zakrzewska JM. Proposal for evaluating the quality of reports of surgical interventions in the treatment of trigeminal neuralgia: the Surgical Trigeminal Neuralgia Score. Neurosurg Focus. 2013;35(3):E3. | |
| CASP:RCT | RCT | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (RCT) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Randomised-Controlled-Trial-Checklist/CASP-RCT-Checklist-PDF-Fillable-Form.pdf Accessed: 22nd July 2023 |
| CASP:SR | Systematic Review | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Systematic review) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Systematic-Review-Checklist/CASP-Systematic-Review-Checklist-2018_fillable-form.pdf Accessed: 22nd July 2023 |
| Critical Appraisal Skills Programme (2018). CASP (insert name of checklist i.e. Qualitative) Checklist. [online] Available at: URL. Accessed: Date Accessed. | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Qualitative) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Qualitative-Studies-Checklist/CASP-Qualitative-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 | |
| CASP:CASP cohort | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Cohort) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Cohort-Study-Checklist/CASP-Cohort-Study-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 | |
| CASP: DTA | DTA | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (DTA) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Diagnostic-Study-Checklist/CASP-Diagnostic-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 |
| CASP: CC | Case-control | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Case control) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Case-Control-Study-Checklist/CASP-Case-Control-Study-Checklist-2018-fillable-form.pdf Accessed: 22nd July 2023 |
| CASP: Economic | Economic | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Economic Evaluation) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Economic-Evaluation-Checklist/CASP-Economic-Evaluation-Checklist-2018_fillable_form.pdf Accessed: 22nd July 2023 |
| CASP: clinical prediction | Clinical prediction rule | General critical appraisal | Critical Appraisal Skills Programme (2018). CASP (Clinical prediction rule) Checklist. [online] Available at: https://casp-uk.net/images/checklist/documents/CASP-Clinical-Prediction-Rule-Checklist/CASP-Clinical-Prediction-Rule-Checklist_2018_fillable_form.pdf Accessed: 22nd July 2023 |
| Vickers | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Vickers AJ. Can acupuncture have specific effects on health? A systematic review of acupuncture antiemesis trials. J R Soc Med. 1996;89(6):303-11. |
| Wingood | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Wingood GM, DiClemente RJ. HIV sexual risk reduction interventions for women: a review. Am J Prev Med. 1996;12(3):209-17. |
| Wright | Observational (mixed) | Developed specifically for the review; not targeted at wider research community | Wright J, Dye R. Systematic review on obstructive sleep apnoea: its effect on health and benefit of treatment. 1996. |
| R-AMSTAR | Systematic Review | Minor adaptation of existing tool | Kung J, Chiappelli F, Cajulis OO, Avezova R, Kossan G, Chew L, et al. From Systematic Reviews to Clinical Recommendations for Evidence-Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance. Open Dent J. 2010;4:84-91. |