Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Appendix B Background Discussion Document: Selected Guidelines for Transparent Reporting SELECTED GUIDELINES FOR TRANSPARENT REPORTING The purpose of this document is to help inform workshop discussions on improving the harmonization of guidelines for transparent reporting across journals and funding agencies so that biomedical researchers pro- pose and report data in a consistent manner. This discussion document was compiled based on criteria described in the Transparency and Open- ness Promotion (TOP) guidelines;1 the National Academies of Sciences, Engineering, and Medicine report on Reproducibility and Replicability in Science;2 and the National Institutes of Health (NIH) policy on Enhancing Reproducibility through Rigor and Transparency.3 Each of the guidelines summarized below has a different scope and purpose. Rather than a comprehensive comparison of the several guidelines, this document indicates the criteria related to transparent reporting that are covered by the various guidelines. It is intended as a background for the workshop discussion. 1 Available at https://cos.io/top (accessed January 12, 2020). 2 Available at https://www.nap.edu/catalog/25303/reproducibility-and-replicability-in- science (accessed January 12, 2020). 3 Available at https://grants.nih.gov/policy/reproducibility/index.htm (accessed Janu- ary 12, 2020). 105 PREPUBLICATION COPYâUncorrected Proofs
106 ENHANCING SCIENTIFIC REPRODUCIBILITY BRIEF DESCRIPTIONS OF GUIDELINES SUMMARIZED â¢ The Animal Research: Reporting In Vivo Experiments (ARRIVE) guidelines recommend criteria for the reporting of primary research using animals. The guidelines were based on the Consoli- dated Standards of Reporting Trials (CONSORT) guidelines, but cover diverse study types. They were developed by the National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC3Rs), and were first published in PLOS Biology in 2010. The ARRIVE guidelines are currently being revised; a preprint of the revised ARRIVE guidelines and the accompanying Explana- tion and Elaboration document are available on BioRxiv, respec- tively at https://www.biorxiv.org/content/10.1101/703181v1 and at https://www.biorxiv.org/content/10.1101/703355v1. â¢ The CONSORT statement recommends information to include when reporting a randomized trial; was developed by an inter- national group of trialists, methodologists, and medical journal editors; and was first published in JAMA in 1996 and last revised in 2010 and published in multiple journals. For more information, see http://www.consort-statement.org. â¢ The DRAFT materials, design, analysis, and reporting (MDAR) checklist for authors represents a generic set of minimum require- ments applicable to all reporting studies in the life sciences for the explicit purpose of increasing transparent reporting and reproduc- ibility, developed by the MDAR working group specifically seek- ing common reporting points from across multiple journals. The checklist is being pilot tested by volunteer journals, and therefore has not been published at the time of this writing. The statement of task is available at https://osf.io/preprints/metaarxiv/9sm4x. â¢ NIH policies: Â° âData Sharingâ policy, developed by NIH, to encourage data generated with NIH funding to be âmade as widely and freely available as possible while safeguarding the privacy of partici- pants, and protecting confidential and proprietary data.â The policy requires a data sharing plan for final research data gen- erated on grants of $500,000 or more, and was implemented in 2003. For more information, see https://grants.nih.gov/grants/ policy/data_sharing. Â° Dissemination of NIH-Funded Clinical Trial Informationâ â policy, developed by NIH and implemented in 2017, mandates that all clinical trials funded in part or in whole by NIH must be registered at ClinicalTrials.gov. The policy also requires that summary results be posted to ClinicalTrials.gov. For more infor- PREPUBLICATION COPYâUncorrected Proofs
APPENDIX B 107 mation, see https://grants.nih.gov/grants/guide/notice-files/ not-od-16-149.html. Â° âEnhancing Reproducibility through Rigor and Transparencyâ policy, developed by NIH, to clarify expectations for grant- ees and reviewers in describing or assessing proposed studies in applications and progress reports, announced in 2015 and implemented in 2016. For more information, see https://grants. nih.gov/policy/reproducibility/index.htm. â¢ The Preferred Reporting Items for Systematic Reviews and Meta- Analyses (PRISMA) statement recommends an evidence-based minimum set of reporting elements for systematic reviews and meta-analyses; was developed by an international group; and was first published in 2009 in multiple journals (PLOS Medicine, Annals of Internal Medicine, BMJ, Journal of Clinical Epidemiology, and Open Medicine). For more information, see http://www.prisma- statement.org. â¢ The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) statement, developed by an international collabo- ration of trialists, methodologists, journal editors, and ethicists, recommends minimum content to include in clinical trial protocols, from study enrollment through closeout, first published in the Annals of Internal Medicine and BMJ in 2013. For more information, see: https://www.spirit-statement.org. â¢ The TOP guidelines describe eight modular standards of transpar- ency that journals can select from to introduce policy and best practices at their publication; was developed by the Center for Open Science with input from journals, funders, and professional societies; and was first published in Science in 2015. See https:// cos.io/top for information about TOP, including a summary table and links to complete policy language. PREPUBLICATION COPYâUncorrected Proofs
108 ENHANCING SCIENTIFIC REPRODUCIBILITY Legend ARRIVE Criterion covered: Dark boxes Primary CONSORT Criterion partially covered: Gray boxes Research in Randomized Criterion not covered: White boxes Animals Trials STUDY CHARACTERISTICS Code availability2 Data availability2,3 Data citation2,3 STUDY METHODS Analytical methods: attrition, statistical precision, statistical power2,3 Plan for analytical decisions/preregistration2,3 Animal use/sex as a biologic variable4 Details of in-laboratory study replication3 Details of study methods, computation, and associated parameters2,3 Ethics2,5 Information on computational environment (e.g., operating system, library dependencies)3 Materials availability discussed2,3 Material authentication required4 Methods and protocols2,3,4 Sample definition2 RESULTS AND DISCUSSION Adherence to community standards2 Discussion of uncertainty3 Discussion on generality constraints3 Discuss/assess rigor of prior research4 Dual use research of concern* 1. NIH policies represented include Data Sharing Policy, Dissemination of NIH-Funded Clinical Trial Information, and Rigor and Transparency. 2. Based on criteria described in the Transparency and Openness Promotion (TOP) guide- lines, https://cos.io/top. 3. Based on criteria described in the National Academies report Reproducibility and Replicabil- ity in Science. PREPUBLICATION COPYâUncorrected Proofs
APPENDIX B 109 DRAFT MDAR NIH Policies1 TOP Guidelines Compilation of Preclinical Modular Multiple Life and Clinical PRISMA SPIRIT Clinical Publishing Science Journals Research Meta-analyses Trial Protocols Standards 4. Based on criteria described in the NIH policy on Enhancing Reproducibility through Rigor and Transparency. 5. Covered by multiple NIH policies and offices, including Human Subjects Research poli- cies and the NIH Office of Laboratory Animal Welfare. * Covered by U.S. government Policy for Institutional Oversight of Life Sciences Dual Use Research of Concern. PREPUBLICATION COPYâUncorrected Proofs
PREPUBLICATION COPYâUncorrected Proofs