The following tools have been assessed by the LATITUDES team but do not meet criteria for inclusion in the library:
| Tool Identifier | Reason for exclusion | Citation |
| Benchmarking Controlled Trial (BCT) | Not targeted at evidence synthesis | Malmivaara A. Assessing validity of observational intervention studies – the Benchmarking Controlled Trials. Ann Med. 2016;48(6):440-443. doi:10.1080/07853890.2016.1186830. |
| Adaptation of QUADAS-2 | Minor adaptation of existing tool | Kossoff J, Duncan S, Acharya J, Davis D. Automated Analysis of Ultrasound for the Diagnosis of Pneumothorax: A Systematic Review. Cureus. 2024;16(11):e72896. doi:10.7759/cureus.72896. |
| Akram | Reporting guideline | Akram H, Mirza B, Kitchen N, Zakrzewska J. Proposal for evaluating the quality of reports of surgical interventions in the treatment of trigeminal neuralgia: the Surgical Trigeminal Neuralgia Score. Neurosurg Focus. 2013;35(3):E3. doi:10.3171/2013.6.focus13213. |
| Andrew | Reporting guideline | Andrew E. Method for assessment of the reporting standard of clinical trials with roentgen contrast media. Acta Radiol Diagn (Stockh). 1984;25(1):55-8. doi:10.1177/028418518402500111. |
| Angelillo | Minor adaptation of existing tools; Developed specifically for this SR | Angelillo I, Villari P. Residential exposure to electromagnetic fields and childhood leukaemia: a meta-analysis. Bull World Health Organ. 1999;77(11):906-15. |
| Antczak | Not targeted at evidence synthesis | Antczak A, Tang J, Chalmers T. Quality assessment of randomized control trials in dental research. I. Methods. J Periodontal Res. 1986;21(4):305-14. doi:10.1111/j.1600-0765.1986.tb01464.x. |
| Audet | Minor adaptation of existing tool | Audet N, Gagnon R, Ladouceur R, Marcil M. [How effective is the teaching of critical analysis of scientific publications? Review of studies and their methodological quality]. CMAJ. 1993;148(6):945-52. |
| Beckerman | Developed specifically for the review; not targeted at wider research community | Beckerman H, de Bie R, Bouter L, De Cuyper H, Oostendorp R. The efficacy of laser therapy for musculoskeletal and skin disorders: a criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72(7):483-91. doi:10.1093/ptj/72.7.483. |
| Bizzini | Minor adaptation of existing tools; Developed specifically for this SR | Bizzini M, Childs J, Piva S, Delitto A. Systematic review of the quality of randomized controlled trials for patellofemoral pain syndrome. J Orthop Sports Phys Ther. 2003;33(1):4-20. doi:10.2519/jospt.2003.33.1.4. |
| Bleijenbergh | Not targeted at evidence synthesis | Bleijenbergh I, Korzilius H, Verschuren P. Methodological criteria for the internal validity and utility of practice oriented research. Qual Quant. 2010;45(1):145-156. doi:10.1007/s11135-010-9361-5. |
| Bours | Minor adaptation of existing tools; Developed specifically for this SR | Bours G, Ketelaars C, Frederiks C, Abu-Saad H, Wouters E. The effects of aftercare on chronic patients and frail elderly patients when discharged from hospital: a systematic review. J Adv Nurs. 1998;27(5):1076-86. doi:10.1046/j.1365-2648.1998.00647.x. |
| Brown | Minor adaptation of existing tool | Brown S. Measurement of quality of primary studies for meta-analysis. Nurs Res. 1991;40(6):352-5. |
| Cain | Minor adaptation of existing tools; Developed specifically for this SR | Cain L, Geneen L, Wiltshire M, et al. Universal irradiation of platelets: Does irradiation affect the quality, effectiveness, and safety of platelets for transfusion?. Transfusion Medicine Reviews. 2024;38(4):150840. doi:10.1016/j.tmrv.2024.150840. |
| Cameron | Developed specifically for the review; not targeted at wider research community | Cameron I, Crotty M, Currie C, et al. Geriatric rehabilitation following fractures in older people: a systematic review. Health Technol Assess. 2000;4(2):i-iv, 1-111. |
| Campos-Outcalt | Developed specifically for the review; not targeted at wider research community. | Campos-Outcalt D, Senf J, Watkins A, Bastacky S. The effects of medical school curricula, faculty role models, and biomedical research support on choice of generalist physician careers: a review and quality assessment of the literature. Acad Med. 1995;70(7):611-9. doi:10.1097/00001888-199507000-00012. |
| CASP | General critical appraisal | CASP checklists. casp-uk.net/casp-tools-checklists/. ; |
| Chalmers | Not targeted at evidence synthesis | Chalmers I, Adams M, Dickersin K, et al. A cohort study of summary reports of controlled trials. JAMA. 1990;263(10):1401-5. |
| Chalmers | Not targeted at evidence synthesis | Chalmers T, Smith H, Blackburn B, et al. A method for assessing the quality of a randomized control trial. Control Clin Trials. 1981;2(1):31-49. doi:10.1016/0197-2456(81)90056-8. |
| CHAMP | Not validity assessment | Mansournia M, Collins G, Nielsen R, et al. CHecklist for statistical Assessment of Medical Papers: the CHAMP statement. Br J Sports Med. 2021;55(18):1002-1003. doi:10.1136/bjsports-2020-103651. |
| CHEERS 2922 | Reporting guideline | Husereau D, Drummond M, Augustovski F, et al. Consolidated health economic evaluation reporting standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. Int J Technol Assess Health Care. 2022;38(1):e13. doi:10.1017/s0266462321001732. |
| Cho | Not targeted at evidence synthesis | Cho M, Bero L. Instruments for assessing the quality of drug studies published in the medical literature. JAMA. 1994;272(2):101-4. |
| CINeMA | Not validity assessment – confidence in body of evidence (like GRADE) | Nikolakopoulou A, Higgins J, Papakonstantinou T, et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLoS Med. 2020;17(4):e1003082. doi:10.1371/journal.pmed.1003082. |
| Colditz | Developed specifically for the review; not targeted at wider research community | Colditz G, Miller J, Mosteller F. How study design affects outcomes in comparisons of therapy. I: Medical. Stat Med. 1989;8(4):441-54. doi:10.1002/sim.4780080408. |
| Community-Partnered Research (CPR) appraisal tool | Not validity assessment | Park A, van Draanen J. Community-Partnered Research appraisal tool for conducting, reporting and assessing community-based research. BMJ Open. 2024;14(4):e081625. doi:10.1136/bmjopen-2023-081625. |
| COREQ | Reporting guideline | Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-57. doi:10.1093/intqhc/mzm042. |
| Cost of Illness Studies checklist | General critical appraisal | Tyler E. Cost of illness studies – Critical appraisal checklist. ; |
| Cote | General critical appraisal | Côté L, Turgeon J. Appraising qualitative research articles in medicine and medical education. Med Teach. 2005;27(1):71-5. doi:10.1080/01421590400016308. |
| Cowley | Minor adaptation of existing tool | Cowley D. Prostheses for primary total hip replacement. A critical appraisal of the literature. Int J Technol Assess Health Care. 1995;11(4):770-8. doi:10.1017/s026646230000920x. |
| CRED | Not targeted at evidence synthesis | MOERMOND C. CRED:CRITERIA FOR REPORTING AND EVALUATING ECOTOXICITY DATA. Environmental Toxicology and Chemistry. ;35(5):1297-1309. doi:10.1002/etc.3259. |
| Critical appraisal checklist for qualitative research studies | General critical appraisal | Treloar C, Champness S, Simpson P, Higginbotham N. Critical appraisal checklist for qualitative research studies. Indian J Pediatr. 2000;67(5):347-51. doi:10.1007/bf02820685. |
| Critical Review Form – Qualitative Studies | General critical appraisal | Letts L. Critical Review Form – Qualitative Studies (Version 2.0) Letts. ; |
| Crowe | General critical appraisal | Crowe M, Sheppard L. A general critical appraisal tool: an evaluation of construct validity. Int J Nurs Stud. 2011;48(12):1505-16. doi:10.1016/j.ijnurstu.2011.06.004. |
| de Oliveira | Developed specifically for the review; not targeted at wider research community | de Oliveira I, Dardennes R, Amorim E, et al. Is there a relationship between antipsychotic blood levels and their clinical efficacy? An analysis of studies design and methodology. Fundam Clin Pharmacol. 1995;9(5):488-502. doi:10.1111/j.1472-8206.1995.tb00524.x. |
| EBM tools | General critical appraisal | CEBM Tools. www.cebm.ox.ac.uk/resources/ebm-tools/critical-appraisal-tools. ; |
| ECR-P | Not validity assessment | Danopoulos E, Aston J, Shah A, Schneider C. Evidence Communication Rules for Policy (ECR-P) critical appraisal tool. Syst Rev. 2025;14(1):10. doi:10.1186/s13643-025-02757-8. |
| ESM-Q | Assesses validity of measure rather than study validity | Eisele G, Hiekkaranta A, Kunkels Y, et al. ESM-Q: A consensus-based quality assessment tool for experience sampling method items. Behav Res Methods. 2025;57(4):124. doi:10.3758/s13428-025-02626-1. |
| Evans | Developed specifically for the review; not targeted at wider research community. | Evans M, Pollock A. A score system for evaluating random control clinical trials of prophylaxis of abdominal surgical wound infection. Br J Surg. 1985;72(4):256-60. doi:10.1002/bjs.1800720403. |
| Fast | Developed specifically for the review; not targeted at wider research community | Fast I, Nashed C, Lotscher J, Askin N, De Visser H, McGavock J. The effectiveness of new urban trail infrastructure on physical activity and active transportation: a systematic review and meta-analysis of natural experiments. Int J Behav Nutr Phys Act. 2025;22(1):36. doi:10.1186/s12966-025-01729-4. |
| Forchuk | Not targeted at evidence synthesis | Forchuk C, Roberts J. How to critique qualitative research articles. Can J Nurs Res. 1993;25(4):47-55; quiz 56. |
| Francis | Assesses validity of measure rather than study validity | Francis D, McPheeters M, Noud M, Penson D, Feurer I. Checklist to operationalize measurement characteristics of patient-reported outcome measures. Syst Rev. 2016;5(1):129. doi:10.1186/s13643-016-0307-4. |
| Goodman | Reporting guideline | Goodman S, Berlin J, Fletcher S, Fletcher R. Manuscript quality before and after peer review and editing at Annals of Internal Medicine. Ann Intern Med. 1994;121(1):11-21. doi:10.7326/0003-4819-121-1-199407010-00003. |
| GRADE | Not validity assessment – confidence in body of evidence (like GRADE) | GRADE guidelines: 3. Rating the quality of evidence. ; |
| ICEMAN | Not validity assessment – single concept | Schandelmaier S, Briel M, Varadhan R, et al. Development of the Instrument to assess the Credibility of Effect Modification Analyses (ICEMAN) in randomized controlled trials and meta-analyses. CMAJ. 2020;192(32):E901-E906. doi:10.1503/cmaj.200077. |
| Individual Participant Data Integrity Tool | Not validity assessment | Hunter K, Aberoumand M, Libesman S, et al. The Individual Participant Data Integrity Tool for assessing the integrity of randomised trials. Res Synth Methods. 2024;doi:10.1002/jrsm.1738. |
| Irwig | Not validity assessment | Irwig L, Tosteson A, Gatsonis C, et al. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med. 1994;120(8):667-76. doi:10.7326/0003-4819-120-8-199404150-00008. |
| Kay | Developed specifically for the review; not targeted at wider research community. | Kay E, Locker D. Is dental health education effective? A systematic review of current evidence. Community Dent Oral Epidemiol. 1996;24(4):231-5. doi:10.1111/j.1600-0528.1996.tb00850.x. |
| Kneale | General critical appraisal | Kneale J, Santy J. Critiquing qualitative research. Journal of Orthopaedic Nursing. 1999;3(1):24-32. doi:10.1016/s1361-3111(99)80083-1. |
| Koes | Minor adaptation of existing tool | Koes B, Assendelft W, van der Heijden G, Bouter L, Knipschild P. Spinal manipulation and mobilisation for back and neck pain: a blinded review. BMJ. 1991;303(6813):1298-303. doi:10.1136/bmj.303.6813.1298. |
| Kreulen | Developed specifically for the review; not targeted at wider research community. | Kreulen C, Creugers N, Meijering A. Meta-analysis of anterior veneer restorations in clinical studies. J Dent. 1998;26(4):345-53. doi:10.1016/s0300-5712(97)00023-7. |
| Kuper | General critical appraisal | Kuper A, Lingard L, Levinson W. Critically appraising qualitative research. BMJ. 2008;337:a1035. doi:10.1136/bmj.a1035. |
| Kwakkel | Developed specifically for the review; not targeted at wider research community | Kwakkel G, Wagenaar R, Koelman T, Lankhorst G, Koetsier J. Effects of intensity of rehabilitation after stroke. A research synthesis. Stroke. 1997;28(8):1550-6. doi:10.1161/01.str.28.8.1550. |
| Linde | Developed specifically for the review; not targeted at wider research community | Linde K, Clausius N, Ramirez G, et al. Are the clinical effects of homeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet. 1997;350(9081):834-43. doi:10.1016/s0140-6736(97)02293-9. |
| Long | General critical appraisal | LONG A, GODFREY M. An evaluation tool to assess the quality of qualitative research studies. International Journal of Social Research Methodology. 2004;7(2):181-196. doi:10.1080/1364557032000045302. |
| Lowe | Not targeted at evidence synthesis | Lowe P, Jakimowicz S, Levett-Jones T, Baldwin A, Stern C. Using a hybrid Delphi/nominal group technique to develop a tool for appraising the quality of mixed-method grounded theory research. Nurse Res. 2024;doi:10.7748/nr.2024.e1947. |
| MacMillan | Minor adaptation of existing tool | MacMillan H, MacMillan J, Offord D, Griffith L, MacMillan A. Primary prevention of child physical abuse and neglect: a critical review. Part I. J Child Psychol Psychiatry. 1994;35(5):835-56. doi:10.1111/j.1469-7610.1994.tb02298.x. |
| MARQ | Not validity assessment -reporting bias | Singh J. Development of the Metareview Assessment of Reporting Quality (MARQ) Checklist. ; |
| Meader | Not validity assessment | Meader N, King K, Llewellyn A, et al. A checklist designed to aid consistency and reproducibility of GRADE assessments: development and pilot validation. Syst Rev. 2014;3:82. doi:10.1186/2046-4053-3-82. |
| Pavia | Developed specifically for the review; not targeted at wider research community | Pavia M, Pileggi C, Nobile C, Angelillo I. Association between fruit and vegetable consumption and oral cancer: a meta-analysis of observational studies. Am J Clin Nutr. 2006;83(5):1126-34. doi:10.1093/ajcn/83.5.1126. |
| Poynard | Not targeted at evidence synthesis | Poynard T. [Evaluation of the methodological quality of randomized therapeutic trials]. Presse Med. 1988;17(7):315-8. |
| PRECIS-2 | Not validity assessment: Guide to designing trials | Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe K, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350(may08 1):h2147-h2147. doi:10.1136/bmj.h2147. |
| R-AMSTAR | Minor adaptation of existing tool | Kung J, Chiappelli F, Cajulis O, et al. From Systematic Reviews to Clinical Recommendations for Evidence-Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance. Open Dent J. 2010;4:84-91. doi:10.2174/1874210601004020084. |
| Reid | Not validity assessment – single concept | Reid E, Tejani A, Huan L, et al. Managing the incidence of selective reporting bias: a survey of Cochrane review groups. Syst Rev. 2015;4:85. doi:10.1186/s13643-015-0070-y. |
| Reisch | Not targeted at evidence synthesis | Reisch J, Tyson J, Mize S. Aid to the evaluation of therapeutic studies. Pediatrics. 1989;84(5):815-27. |
| RoB tool adaptation | Minor adaptation of existing tool | Tonin F, Lopes L, Rotta I, et al. Usability and sensitivity of the risk of bias assessment tool for randomized controlled trials of pharmacist interventions. Int J Clin Pharm. 2019;41(3):785-792. doi:10.1007/s11096-019-00818-2. |
| ROBFEAD | Assesses validity of analysis rather than study validity | Mathur V, Duggal I, Atif M, et al. Development and validation of risk of bias tool for the use of finite element analysis in dentistry (ROBFEAD). Comput Methods Biomech Biomed Engin. 2023;26(15):1822-1833. doi:10.1080/10255842.2022.2148465. |
| ROB-ME | Not validity assessment – single concept | Page M, Sterne J, Boutron I, et al. ROB-ME: a tool for assessing risk of bias due to missing evidence in systematic reviews with meta-analysis. BMJ. 2023;383:e076754. doi:10.1136/bmj-2023-076754. |
| ROB-MEN | Not validity assessment – single concept | Chiocchia V, Nikolakopoulou A, Higgins J, et al. ROB-MEN: a tool to assess risk of bias due to missing evidence in network meta-analysis. BMC Med. 2021;19(1):304. doi:10.1186/s12916-021-02166-3. |
| Roever | General critical appraisal | Roever L. Critical Appraisal of a Questionnaire Study. Evidence Based Medicine and Practice. 2015;1(s1). doi:10.4172/2471-9919.1000e110. |
| Saini | Not validity assessment – single concept | Saini P, Loke Y, Gamble C, Altman D, Williamson P, Kirkham J. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349:g6501. doi:10.1136/bmj.g6501. |
| Salanti | Not validity assessment – confidence in body of evidence (like GRADE) | Salanti G, Del Giovane C, Chaimani A, Caldwell D, Higgins J. Evaluating the quality of evidence from a network meta-analysis. PLoS One. 2014;9(7):e99682. doi:10.1371/journal.pone.0099682. |
| Scientific publication score | Not validity assessment | Bettin D, Maurer T, Schlatt F, Bettin S. The scientific publication score – a new tool for summarizing evidence and data quality criteria of biomedical publications. J Bone Jt Infect. 2022;7(6):269-278. doi:10.5194/jbji-7-269-2022. |
| SIGN checklists | General critical appraisal | SIGN checklists. www.sign.ac.uk/using-our-guidelines/methodology/checklists/. 2014; |
| Solomon | General critical appraisal | Solomon D, Bates D, Panush R, Katz J. Costs, outcomes, and patient satisfaction by provider type for patients with rheumatic and musculoskeletal conditions: a critical review of the literature and proposed methodologic standards. Ann Intern Med. 1997;127(1):52-60. doi:10.7326/0003-4819-127-1-199707010-00009. |
| SPAC checklist | Reporting guideline | Kamioka H, Kawamura Y, Tsutani K, et al. A checklist to assess the quality of reports on spa therapy and balneotherapy trials was developed using the Delphi consensus method: the SPAC checklist. Complement Ther Med. 2013;21(4):324-32. doi:10.1016/j.ctim.2013.05.002. |
| Stiles | Not targeted at evidence synthesis | Stiles W. Evaluating qualitative research. Evidence-Based Mental Health. 1999;2(4):99-101. doi:10.1136/ebmh.2.4.99. |
| Strawbridge | Not validity assessment | Strawbridge R, Sharma D, Kisely S, Cristea I, Young A, Kaufman K. Enhancing the quality of systematic reviews and meta-analyses. BJPsych Open. 2025;11(6):e266. doi:10.1192/bjo.2025.10876. |
| TARGET Statement | Reporting guideline | Cashin A, Hansford H, Hernán M, et al. Transparent Reporting of Observational Studies Emulating a Target Trial-The TARGET Statement. JAMA. 2025;doi:10.1001/jama.2025.13350. |
| Taylor | Developed specifically for the review; not targeted at wider research community | Taylor B, Dempster M, Donnelly M. Grading Gems: Appraising the Quality of Research for Social Work and Social Care. British Journal of Social Work. 2006;37(2):335-354. doi:10.1093/bjsw/bch361. |
| Vickers | Developed specifically for the review; not targeted at wider research community | Vickers A. Can acupuncture have specific effects on health? A systematic review of acupuncture antiemesis trials. J R Soc Med. 1996;89(6):303-11. doi:10.1177/014107689608900602. |
| Viswanathan | Minor adaptation of existing tool | Viswanathan M, Berkman N, Dryden D, Hartling L. Assessing Risk of Bias and Confounding in Observational Studies of Interventions or Exposures: Further Development of the RTI Item Bank. 2013; |