References
Anglemyer, A.T., D. Krauth, and L. Bero. 2015. Industry sponsorship and publication bias among animal studies evaluating the effects of statins on atherosclerosis and bone outcomes: A meta-analysis. BMC Medical Research Methodology 15:12. 10.1186/s12874-015-0008-z.
Arzuaga, X., M.T. Smith, C.F. Gibbons, N.E. Skakkebæk, E.E. Yost, B.E.J. Beverly, A.K. Hotchkiss, R. Hauser, R.L. Pagani, S.M. Schrader, L. Zeise, and G. S. Prins. 2019. Proposed key characteristics of male reproductive toxicants as an approach for organizing and evaluating mechanistic evidence in human health hazard assessments. Environmental Health Perspectives 127:6 CID: 065001. https://doi.org/10.1289/EHP5045.
Balshem, H., M. Helfand, H.J. Schünemann, A.D. Oxman, R. Kunz, J. Brozek, G.E. Vist, Y. Falck-Ytter, J. Meerpohl, and S. Norris. 2011. GRADE guidelines: 3. Rating the quality of evidence. Journal of Clinical Epidemiology 64(4):401-406.
Becker, R.A., D.A. Dreier, M.K. Manibusan, L.A.T. Cox, T.W. Simon, and J.S. Bus. 2017. How well can carcinogenicity be predicted by high throughput “characteristics of carcinogens” mechanistic data? Regulatory Toxicology and Pharmacology 90:185-196. doi: 10.1016/j.yrtph.2017.08.021. Epub 2017 Sep 1.PMID: 28866267.
Bero, L., A. Anglemyer, H. Vesterinen, and D. Krauth. 2015. The relationship between study sponsorship, risks of bias, and research outcomes in atrazine exposure studies conducted in non-human animals: Systematic review and meta-analysis. Environmental International 92-93:597-604. http://dx.doi.org/10.1016/j.envint.2015.10.011.
Bero L, Chartres N, Diong J, Fabbri A, Ghersi D, Lam J, Lau A, McDonald S, Mintzes B, Sutton P, Turton JL. The risk of bias in observational studies of exposures (ROBINS-E) tool: concerns arising from application to observational studies of exposures. Systematic reviews. 2018 Dec;7(1):1-1.
Blessinger, T., A. Davis, W.A. Chiu, J. Stanek, G.M. Woodall, J. Gift, K.A. Thayer, and D. Bussard. 2020. Application of a unified probabilistic framework to the dose-response assessment of acrolein. Environment International 143:105953. https://doi.org/10.1016/j.envint.2020.105953.
Chartres, N., A. Fabbri, and L.A. Bero. 2016. Association of industry sponsorship with outcomes of nutrition studies: A systematic review and meta-analysis. JAMA International Medicine 176(12):1769-1777. 10.1001/jamainternmed.2016.6721.
Chiu, W.A., and W. Slob. 2015. A unified probabilistic framework for dose–response assessment of human health effects. Environmental Health Perspectives 123(12):1241-1254. https://doi.org/10.1289/ehp.1409385.
Chiu, W.A., D.A. Axelrad, C. Dalaijamts, C. Dockins, K. Shao, A.J. Shapiro, and G. Paoli. 2018. Beyond the RfD: Broad application of a probabilistic approach to improve chemical dose-response assessments for noncancer effects. Environmental Health Perspectives 126:067009. http://dx.doi.org/10.1289/EHP3368.
Downes, M.J., M.L. Brennan, H.C. Williams, and R.S. Dean. 2016. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open 6(12):e011458.
EPA (U.S. Environmental Protection Agency). 2002. A Review of the Reference Dose and Reference Concentration Processes. EPA/630/P-02/002F. U.S. Environmental Protection Agency, Risk Assessment Forum, Washington, DC. https://www.epa.gov/sites/production/files/2014-12/documents/rfd-final.pdf.
EPA. 2005. Guidelines for Carcinogen Risk Assessment. EPA/630/P-03/001B. U.S. Environmental Protection Agency, Risk Assessment Forum, Washington, DC. https://www.epa.gov/sites/production/files/2013-09/documents/cancer_guidelines_final_3-25-05.pdf.
EPA. 2018. An Umbrella Quality Assurance Project Plan (QAPP) for PBPK Models. ORD QAPP ID No: B-0030740-QP-1-1. https://hero.epa.gov/hero/index.cfm/reference/details/reference_id/4326432.
EPA. 2019a. Systematic Review Protocol for the PFBA, PFHxA, PFHxS, PFNA, and PFDA IRIS Assessments. EPA/635/R-19/049. https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=345065#tab-3.
EPA. 2019b. Systematic Review Protocol for the Polychlorinated Biphenyls (PCBs) Noncancer IRIS Assessment (Preliminary Assessment Materials). EPA/635/R-19/201. https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=237359.
EPA. 2020a. ORD Staff Handbook for Developing IRIS Assessments. Version 1.0, EPA/600/R-20/137. Center for Public Health and Environmental Assessment, Office of Research and Development, U.S. Environmental Protection Agency, Washington, DC.
EPA. 2020b. IRIS Assessment Plan for Oral Exposure to Vanadium and Compounds (Scoping and Problem Formulation Materials). EPA/635/R-20/112. U.S. Environmental Protection Agency, Washington, DC. https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=348792.
EPA. 2020c. Systematic Review Protocol for the Methylmercury IRIS Assessment (Preliminary Assessment Materials). EPA/635/R-19/243. https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=345309#tab-3.
EPA. 2021a. Vanadium Systematic Review Protocol released for public comment April 2021. Systematic Review Protocol for the Vanadium and Compounds (Oral Exposure) IRIS Assessment (Preliminary Assessment Materials). EPA/635/R-21/047. U.S. Environmental Protection Agency, Washington, DC. https://cfpub.epa.gov/ncea/risk/recordisplay.cfm?deid=351421.
EPA. 2021b. Systematic Review Protocol for the Inorganic Mercury Salts IRIS Assessment (Preliminary Assessment Materials). EPA/635/R-20/239. U.S. Environmental Protection Agency, Washington, DC. https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=349284.
EFSA (European Food Safety Authority), U. Gundert-Remy, J. Bodin, C. Bosetti, R. FitzGerald, A. Hanberg, U. Hass, C. Hooijmans, A.A. Roney, C. Rousselle, H. van Loveren, D. Wölfle, F. Barizzone, C. Croera, C. Putzu, and A.F. Castoldi. 2017. Bisphenol A (BPA) Hazard Assessment Protocol. 10.5281/zenodo.1116881.
Friedman, L., and M. Friedman. 2016. Financial conflicts of interest and study results in environmental and occupational health research. Journal of Occupational and Environmental Medicine 58(3):238-247. 10.1097/jom.0000000000000671.
Goodman, J., and H. Lynch. 2017. Improving the International Agency for Research on Cancer’s consideration of mechanistic evidence. Toxicology and Applied Pharmacology 319:39-46. 10.1016/j.taap.2017.01.020. Epub 2017 Feb 3.PMID: 28162991.
Guyatt, G.H., A.D. Oxman, R. Kunz, J. Woodcock, J. Brozek, M. Helfand, P. Alonso-Coello, P. Glasziou, R. Jaeschke, and E.A. Akl. 2011. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. Journal of Clinical Epidemiology 64(12):1294-1302.
Guyton, K.Z., I. Rusyn, W.A. Chiu, D.E. Corpet, M. van den Berg, M.K. Ross, D.C. Christiani, F.A. Beland, and M.T. Smith. 2018. Application of the key characteristics of carcinogens in cancer hazard identification. Carcinogenesis 39(4):614-622. 10.1093/carcin/bgy031.PMID:29562322.
Haddaway, N.R., and S. Crowe. 2018. Stakeholder Engagement in Environmental Evidence Synthesis. Mistra Council for Evidence-Based Environmental Management (EviEM). https://play.google.com/store/books/details?id=13AkxQEACAAJ.
Higgins, J.P.T., and J. Thomas. 2019. Cochrane Handbook for Systematic Reviews of Interventions. Second Edition. Hoboken NJ: Wiley Blackwell.
Hill, A.B. 1965. The environment and disease: Association or causation? Proceedings of the Royal Society of Medicine 58:295-300.
Holman, B., L. Bero, B. Mintzes. 2019. Industry Scholarship bias. Catalogue of Bias. https://catalogofbias.org/biases/industry-sponsorship-bias/.
Hooijmans, C.R., R.B.M. de Vries, M. Ritskes-Hoitinga, M.M. Rovers, M.M. Leeflang, J. IntHout, K.E. Wever, L. Hooft, H. de Beer, T. Kuijpers, M.R. Macleod, E.S. Sena, G. Ter Riet, R.L. Morgan, K.A. Thayer, A.A. Rooney, G.H. Guyatt, H.J. Schünemann, and M.W. Langendam. 2018. Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies. PLoS One 13(1):e0187271.
Huss, A., M. Egger, K. Hug, K. Huwiler-Müntener, and M. Röösli. 2007. Source of funding and results of studies of health effects of mobile phone use: Systematic review of experimental studies. Environmental Health Perspectives 115(1):1-4. 10.1289/ehp.9149.
IARC (International Agency for Research on Cancer). 2019. Preamble to the IARC Monographs (amended January 2019). https://monographs.iarc.who.int/wp-content/uploads/2019/07/Preamble-2019.pdf.
Igelström E, Campbell M, Craig P, Katikireddi SV. Cochrane’s risk-of-bias tool for non-randomised studies (ROBINS-I) is frequently misapplied: a methodological systematic review: ROBINS-I frequently misapplied: systematic review. Journal of Clinical Epidemiology. 2021 Aug 23.
IOM (Institute of Medicine). 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. https://doi.org/10.17226/13059.
James, K.L., N.P. Randall, and N.R. Haddaway. 2016. A methodology for systematic mapping in environmental sciences. Environmental Evidence 5(1). 10.1186/s13750-016-0059-6.
Keshava, C., J.A. Davis, J. Stanek, K.A. Thayer, A. Galizia, N. Keshava, J. Gift, S.V. Vulimiri, G. Woodall, C. Gigot, K. Garcia, A. Greenhalgh, B. Schulz, S. Volkoff, K. Camargo, and A.S. Persad. 2020. Application of systematic evidence mapping to assess the impact of new research when updating health reference values: A case example using acrolein. Environment International 143:105956. 10.1016/j.envint.2020.105956.
La Merrill, M.A., L.N. Vandenberg, M.T. Smith, W. Goodson, P. Browne, H.B. Patisaul, K.Z. Guyton, A. Kortenkamp, V.J. Cogliano, T.J. Woodruff, L. Rieswijk, H. Sone, K.S. Korach, A.C. Gore, L. Zeise, and R.T. Zoeller. 2020. Consensus on the key characteristics of endocrine-disrupting chemicals as a basis for hazard identification. Nature Reviews Endocrinology 16:45-57. https://doi.org/10.1038/s41574-019-0273-8.
Lind, L., J.A. Araujo, A. Barchowsky, S. Belcher, B.R. Berridge, N. Chiamvimonvat, W.A. Chiu, V.J. Cogliano, S. Elmore, A.K. Farraj, A.V. Gomes, C.M. McHale, K.B. Meyer-Tamaki, N.G. Posnack, H.M. Vargas, X. Yang, L. Zeise, C. Zhou, and M.T. Smith. 2021. Key characteristics of cardiovascular toxicants. Environmental Health Perspectives 129(9):95001. 10.1289/ehp9321.
Luderer, U., B. Eskenazi, R. Hauser, K.S. Korach, C.M. McHale, F. Moran, L. Rieswijk, G. Solomon, O. Udagawa, L. Zhang, M. Zlatnik, L. Zeise, and M.T. Smith. 2019. Proposed key characteristics of female reproductive toxicants as an approach for organizing and evaluating mechanistic data in hazard assessment. Environmental Health Perspectives 127(7): 075001-1–075001-14. https://doi.org/10.1289/EHP4971.
Lundh, A., J. Lexchin, B. Mintzes, J.B. Schroll, and L. Bero. 2017. Industry sponsorship and research outcome. Cochrane Database of Systematic Reviews 2:Mr000033. 10.1002/14651858.MR000033.pub3.
Lundh, A., K. Rasmussen, L. Østengaard, I. Boutron, L.A. Stewart, and A. Hróbjartsson. 2019. Systematic review finds that appraisal tools for medical research studies address conflicts of interest superficially. Journal of Clinical Epidemiology 120:104-115.
Michaels D. 2006. Manufactured uncertainty: protecting public health in the age of contested science and product defense. Ann NY Acad Sci. 1076:149-62. 10.1196/annals.1371.058.
Minozzi S, M. Cinquini, S. Gianola, G. Castellini, C. Gerardi, R. Banzi. 2019. Risk of bias in nonrandomized studies of interventions showed low inter-rater reliability and challenges in its application. Journal of Clinical Epidemiology 112:28-35.
Moga, C., B. Guo, D. Schopflocher, and C. Harstall. 2012. Development of a Quality Appraisal Tool for Case Series Studies Using a Modified Delphi Technique. Edmonton, AB: Institute of Health Economics. https://www.ihe.ca/advanced-search/development-of-a-quality-appraisal-tool-for-case-series-studies-using-a-modified-delphi-technique.
Morgan, R., J. Sterne, J. Higgins, K. Thayer, H. Schunemann, A. Rooney, and K. Taylor. 2017. A new instrument to assess Risk of Bias in Non-randomised Studies of Exposures (ROBINS-E): Application to studies of environmental exposure. Abstracts of the Global Evidence Summit, Cape Town, South Africa. Cochrane Database of Systematic Reviews (9 Suppl 1). https://doi.org/10.1002/14651858.CD201702.
NASEM (National Academies of Sciences, Engineering, and Medicine). 2017a. Application of Systematic Review Methods in an Overall Strategy for Evaluating Low-Dose Toxicity from Endocrine Active Chemicals. Washington, DC: The National Academies Press. https://doi.org/10.17226/24758.
NASEM. 2017b. Using 21st Century Science to Improve Risk-Related Evaluations. Washington, DC: The National Academies Press. https://doi.org/10.17226/24635.
NASEM. 2018. Progress Toward Transforming the Integrated Risk Information System (IRIS) Program: A 2018 Evaluation. Washington, DC: The National Academies Press. https://doi.org/10.17226/25086.
NASEM. 2021. The Use of Systematic Review in EPA’s Toxic Substances Control Act Risk Evaluations. Washington, DC: The National Academies Press. https://doi.org/10.17226/25952.
Nosek, B.A., and D. Lakens. 2014. Registered reports: A method to increase the credibility of published results. Social Psychology 45(3):137–141. 10.1027/1864-9335/a000192.
NRC (National Research Council). 1994. Science and Judgment in Risk Assessment. Washington, DC: The National Academies Press. https://doi.org/10.17226/2125.
NRC. 2009. Science and Decisions: Advancing Risk Assessment. Washington, DC: The National Academies Press. https://doi.org/10.17226/12209.
NRC. 2011. Review of the Environmental Protection Agency’s Draft IRIS Assessment of Formaldehyde. Washington, DC: The National Academies Press. https://doi.org/10.17226/13142.
NRC. 2014. Review of EPA’s Integrated Risk Information System (IRIS) Process. Washington, DC: The National Academies Press. https://doi.org/10.17226/18764.
NTP (National Toxicology Program) 2018a. Report on Carcinogens Monograph on Antimony Trioxide. Research Triangle Park, NC: U.S. Department of Health and Human Services, Public Health Service.
NTP. 2018b. Report on Carcinogens Monograph on Haloacetic Acids Found as Water Disinfection By-Products. Research Triangle Park, NC: U.S. Department of Health and Human Services, Public Health Service.
NTP. 2019. Handbook for Conducting a Literature-Based Health Assessment Using OHAT Approach for Systematic Review and Evidence Integration. U.S Department of Health and Human Services; Office of Health Assessment and Translation. https://ntp.niehs.nih.gov/whatwestudy/assessments/noncancer/handbook/index.html.
Radke, E.G., E.E. Yost, N. Roth, S. Sathyanarayana, and P. Whaley. 2020. Application of US EPA IRIS systematic review methods to the health effects of phthalates: Lessons learned and path forward. Environment International 145:105820. 10.1016/j.envint.2020.105820.
Rezende, L.F.M., J.P. Rey-López, T.H. Sá, N. Chartres, A. Fabbri, L. Powell, E. Stamatakis, and L. Bero. 2018. Reporting bias in the literature on the associations of health-related behaviors and statins with cardiovascular disease and all-cause mortality. PLoS Biology 16(6):e2005761. https://doi.org/10.1371/journal.pbio.2005761.
Rusyn, I., X. Arzuaga, R.C. Cattley, J.C. Corton, S.S. Ferguson, P. Godoy, K.Z. Guyton, N. Kaplowitz, S.R. Khetani, R.A. Roberts, R.A. Roth, and M.T. Smith. 2021. Key characteristics of human hepatotoxicants as a basis for identification and characterization of the causes of liver toxicity. Hepatology. https://doi.org/10.1002/hep.31999.
Samet, J.M., W.A. Chiu, V. Cogliano, J. Jinot, D. Kriebel, R.M. Lunn, F.A. Beland, L. Bero, P. Browne, L. Fritschi, J. Kanno, D.W. Lachenmeier, Q. Lan, G. Lasfargues, F. Le Curieux, S. Peters, P. Shubat, H. Sone, M.C. White, J. Williamson, M. Yakubovskaya, J. Siemiatycki, P.A. White, K.Z. Guyton, M.K. Schubauer-Berigan, A.L. Hall, Y. Grosse, V. Bouvard, L. Benbrahim-Tallaa, F. El Ghissassi, B. Lauby-Secretan, B. Armstrong, R. Saracci, J. Zavadil, K. Straif, and C.P. Wild. 2020. The IARC Monographs: Updated procedures for modern and transparent evidence synthesis in cancer hazard identification. Journal of the National Cancer Institute 112(1):30-37. 10.1093/jnci/djz169.
Schaefer H.R., J.L. Myers. 2017. Guidelines for performing systematic reviews in the development of toxicity factors. Regulatory Toxicology and Pharmacology 91:124-41.
SIGN (Scottish Intercollegiate Guidelines Network). 2011. A Guideline Developer’s Handbook. https://www.sign.ac.uk/assets/sign50_2011.pdf.
Smith, M.T., K.Z. Guyton, C.F. Gibbons, J.M. Fritz, C.J. Portier, I. Rusyn, D.M. DeMarini, J.C. Caldwell, R.J. Kavlock, P.F. Lambert, S.S. Hecht, J.R. Bucher, B.W. Stewart, R.A. Baan, V.J. Cogliano, and K. Straif. 2016. Key characteristics of carcinogens as a basis for organizing data on mechanisms of carcinogenesis. Environmental Health Perspectives 124(6):713-721. 10.1289/ehp.1509912. Epub 2015 Nov 24. PMID: 26600562; PMCID: PMC4892922.
Smith C.J., T.A. Perfetti, A.W. Hayes, S.C. Berry, J.E. Trosko, J.A. King, J.I. Goodman, C.G. Begley, A. Dayan. 2021. Categorizing the characteristics of human carcinogens: a need for specificity. Arch Toxicol. 95(8):2883-2889. doi: 10.1007/s00204-021-03109-w. Epub 2021 Jun 20. PMID: 34148101.
Sterne, J.A.C., M.A. Hernán, B.C. Reeves, J. Savović, N.D. Berkman, M. Viswanathan, D. Henry, D.G. Altman, M.T. Ansari, I. Boutron, J.R. Carpenter, A.W. Chan, R. Churchill, J.J. Deeks, A. Hróbjartsson, J. Kirkham, P. Jüni, Y.K. Loke, T.D. Pigott, C.R. Ramsay, D. Regidor, H.R. Rothstein, L. Sandhu, P.L. Santaguida, H.J. Schünemann, B. Shea, I. Shrier, P. Tugwell, L. Turner, J.C. Valentine, H. Waddington, E. Waters, G.A. Wells, P.F. Whiting, and J.P.T. Higgins. 2016. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. British Medical Journal 355:i4919.
Thayer, K. 2021. Perspectives on EPA’s IRIS Assessment Handbook. Presented to the Committee to Review EPA’s IRIS Assessment Handbook, April 16.
van der Naald, M., S. Wenker, P.A. Doevendans, K.E. Wever, and S.A.J. Chamuleau. 2020. Publication rate in preclinical research: A plea for preregistration. BMJ Open Science 4:e100051. 10.1136/bmjos-2019-100051.
Walker, V.R., A.L. Boyles, K.E. Pelch, S.D. Holmgren, A.J. Shapiro, C.R. Blystone, M.J. Devito, R.R. Newbold, R. Blain, P. Hartman, K.A. Thayer, and A.A. Rooney. 2018. Human and animal evidence of potential transgenerational inheritance of health effects: An evidence map and state-of-the-science evaluation. Environment International 115: 48-69. 10.1016/j.envint.2017.12.032.
Wells, E. 2017. Evidence regarding the impact of conflicts of interest on environmental and occupational health research. Current Environmental Health Reports 4:109-118. 10.1007/s40572-017-0139-y.
Whaley P., E. Aiassa, C. Beausoleil, A. Beronius, G. Bilotta, A. Boobis, R. de Vries, A. Hanberg, S. Hoffmann, N. Hunt, C.F. Kwiatkowsk, J. Lam, S. Lipworth, O. Martin, N. Randall, L. Rhomberg, A. A. Rooney, H. J. Schünemann, D. Wikoff, T. Wolffe, C. Halsall. Recommendations for the conduct of systematic reviews in toxicology and environmental health research (COSTER). Environment International 143:105926. https://doi.org/10.1016/j.envint.2020.105926.
WHO & IPCS (World Health Organization & International Programme on Chemical Safety). 2018. Guidance Document on Evaluating and Expressing Uncertainty in Hazard Characterization, 2nd ed. World Health Organization. https://apps.who.int/iris/handle/10665/259858. License: CC BY-NC-SA 3.0 IGO.
Wolffe, T.A.M., P. Whaley, C. Halsall, A.A. Rooney, and V.R. Walker. 2019. Systematic evidence maps as a novel tool to support evidence-based decision-making in chemicals policy and risk management. Environment International 130:104871. https://doi.org/10.1016/j.envint.2019.05.065.
Woodruff, T.J., P. Sutton, and The Navigation Guide Work Group. 2011. An evidence-based medicine methodology to bridge the gap between clinical and environmental health sciences. Health Affairs 30(5):931-937.
Woodruff, T.J., and P. Sutton. 2014. The Navigation Guide systematic review methodology: A rigorous and transparent method for translating environmental health science into better health outcomes. Environmental Health Perspectives 122(10):1007-1014.
