National Academies Press: OpenBook

Finding What Works in Health Care: Standards for Systematic Reviews (2011)

Chapter: Appendix C: Workshop Agenda and Questions to Panelists

« Previous: Appendix B: Glossary
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×

C
Workshop Agenda and Questions to Panelists

January 14, 2010


Keck Center of The National Academies

500 Fifth Street, N.W., Room 100

Washington, DC


Workshop Objective: To learn how various stakeholders use and develop systematic reviews (SRs), including expert developers of SRs, professional specialty societies, payers, and consumer advocates.

8:00

Breakfast served

8:30

Welcome and Introductory Remarks

Alfred O. Berg, Chair, Institute of Medicine Committee

8:45

Systematic Review Experts Panel

Kalipso Chalkidou, Director, NICE International, National Institute for Health and Clinical Excellence

Naomi Aronson, Executive Director, Technology Evaluation Center, Blue Cross and Blue Shield Association

David B. Wilson, Crime and Justice Group Cochair, Steering Committee, The Campbell Collaboration

Moderator: Kay Dickersin, Professor of Epidemiology, Johns Hopkins Bloomberg School of Public Health

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×

9:45

Professional Specialty Societies Panel

Virginia Moyer, Section Head, Academic General Pediatrics, Baylor College of Medicine

Sandra Zelman Lewis, Assistant Vice President, Health & Science Policy, American College of Chest Physicians

Rebekah Gee, Assistant Professor of Clinical Medicine, Department of Obstetrics and Gynecology, Tulane University

Moderator: Harold C. Sox, Editor Emeritus, Annals of Internal Medicine

10:45

Break

11:00

The Payer Perspective Panel

Louis B. Jacques, Director, Coverage & Analysis Group, Office of Clinical Standards & Quality, Centers for Medicare & Medicaid Services

Alan Rosenberg, Vice President of Technology Assessment, WellPoint Health Networks

Edmund Pezalla, National Medical Director and Chief Clinical Officer, Aetna Pharmacy Management

Moderator: Paul Wallace, Medical Director, The Permanente Federation, Kaiser Permanente

12:00

Lunch

12:30

Consumer Panel

Gail Shearer, Former Director, Consumer Reports Best Buy Drugs, and Former Director, Health Policy Analysis, Consumers Union

David Shern, President and Chief Executive Officer, Mental Health America

Carol Sakala, Director of Programs, Childbirth Connection

Moderator: Katie Maslow, Director, Policy Development, Alzheimer’s Association

1:30

Adjourn

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×

Questions for the Panelists

Systematic Review Experts Panel

  • How do you develop your review questions?

    • To what extent is the user involved in developing the research question?

  • How do you determine the inclusion criteria for studies in your evidence synthesis?

    • Do you incorporate observational and other nonran­domized data? If yes, what are the parameters for their use?

    • Do you incorporate unpublished and grey literature? Please explain.

    • How do you protect against publication and report­ing (outcome) bias? What have been the challenges (if any)?

  • Do you use any specific instruments or methods to ensure the quality of your SRs?

  • What are the greatest challenges in producing SRs that meaningfully support users’ decisions?

  • How do your “customers” use your reviews?

  • How are your reviews funded? Do you accept industry funding? How do you identify and address potential con­flicts of interest (COIs)?

  • This Institute of Medicine (IOM) committee is charged with recommending standards for SRs of comparative effective­ness research (CER). Are there steps in your SR process that could be standardized?

  • What would be the implications if the IOM were to rec­ommend a standard grading scheme for characterizing the strength of evidence?

Professional Specialty Societies Panel

  • Does your organization produce its own SRs?

    • If yes, have you developed or adopted standards or guidance for the process? Please describe.

    • If no, who produces your SRs? To what extent does your organization participate in the review?

  • What are the greatest challenges in using SRs to develop clinical practice guidelines (CPGs)?

  • How are your SRs funded? Do you accept industry funding? How do you identify and address potential COIs?

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
  • Do you use any specific instruments or methods to ensure the quality of your SRs?

  • This IOM committee is charged with recommending stan­dards for SRs of CER. Are there steps in your SR process that could be standardized?

  • What would be the implications for your organization if the IOM were to recommend a standard grading scheme for characterizing the strength of evidence?

Payer Perspective Panel

  • Does your organization produce its own SRs?

    • If yes, have you developed or adopted standards or guidance for the process? Please explain.

    • If no, who produces your SRs? Does your organization participate in the review? Please explain.

  • Do you incorporate observational and other nonrandom­ized data in your evidence syntheses? If yes, what are the parameters for their use?

  • How do use SRs to make coverage decisions?

  • What are the greatest challenges in using SRs to inform coverage decisions?

  • This IOM committee is charged with recommending stan­dards for SRs of CER. Are there steps in the SR process that could be standardized?

  • What would be the implications for your organization if the IOM were to recommend a standard grading scheme for characterizing the strength of evidence?

Consumer Panel

  • What should be the role of the patient/consumer in the SR process?

  • Who should be considered a consumer (e.g., members or representatives of organized groups; patients with personal experiences with a disease; any member of the public, care­givers, and parents)?

  • What lessons can be learned from existing models of con­sumer involvement? Based on your personal experience, where do you think that involving consumers made a real difference to the process and to the results? What aspects of consumer involvement are working well and what aspects are not working well?

  • Do consumers need training/education to participate mean­ingfully in the SR process?

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
  • This IOM committee is charged with recommending standards for SRs of CER. Should the consumer role in SR be standardized?

  • What would be the implications for consumers if the IOM were to recommend a standard grading scheme for characterizing the strength of evidence?

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×

This page intentionally left blank.

Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 243
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 244
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 245
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 246
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 247
Suggested Citation:"Appendix C: Workshop Agenda and Questions to Panelists." Institute of Medicine. 2011. Finding What Works in Health Care: Standards for Systematic Reviews. Washington, DC: The National Academies Press. doi: 10.17226/13059.
×
Page 248
Next: Appendix D: Expert Guidance for Chapter 2: Standards for Initiating a Systematic Review »
Finding What Works in Health Care: Standards for Systematic Reviews Get This Book
×
Buy Paperback | $61.00 Buy Ebook | $48.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Healthcare decision makers in search of reliable information that compares health interventions increasingly turn to systematic reviews for the best summary of the evidence. Systematic reviews identify, select, assess, and synthesize the findings of similar but separate studies, and can help clarify what is known and not known about the potential benefits and harms of drugs, devices, and other healthcare services. Systematic reviews can be helpful for clinicians who want to integrate research findings into their daily practices, for patients to make well-informed choices about their own care, for professional medical societies and other organizations that develop clinical practice guidelines.

Too often systematic reviews are of uncertain or poor quality. There are no universally accepted standards for developing systematic reviews leading to variability in how conflicts of interest and biases are handled, how evidence is appraised, and the overall scientific rigor of the process.

In Finding What Works in Health Care the Institute of Medicine (IOM) recommends 21 standards for developing high-quality systematic reviews of comparative effectiveness research. The standards address the entire systematic review process from the initial steps of formulating the topic and building the review team to producing a detailed final report that synthesizes what the evidence shows and where knowledge gaps remain.

Finding What Works in Health Care also proposes a framework for improving the quality of the science underpinning systematic reviews. This book will serve as a vital resource for both sponsors and producers of systematic reviews of comparative effectiveness research.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!