National Academies Press: OpenBook
« Previous: IMPLICATIONS FOR JOURNALS OF SEX-SPECIFIC REPORTING POLICIES OF JOURNALS
Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×

 

LOOKING FORWARD8

In the final session of the workshop, members of the workshop planning committee and others reflected on the recurring themes of the meeting. Clayton noted the intersecting roles of journal editors, government funding agencies, industry, basic researchers, and others in advancing the understanding of sex differences in health through careful study design, data-sharing, subgroup analysis, and sex-specific reporting of results.

Anthony pointed out that major goals of biomedical research are the translation of findings into clinical practice and informing the development of health policy. FDA’s mandate, for example, is to ensure that the medical products that it regulates are safe and effective in the appropriate populations. In that regard, profound sex-based differences that affect health and disease in both males and females at the cellular, molecular, and physiologic levels should be considered. Adler pointed out that, despite progress over the last decade, there is still a need for more and better data on sex differences. The focus of the workshop was on how to bring information on sex differences in health to light and specifically how journal editors, through editorial policies, could influence how research is reported.

BOX 2
Summary of Suggestions by Individual Editors

Preclinical Studies

  • The sex of the animals studied should be reported.
  • If only one sex of an animal was studied, this should be indicated in the title of the article.
  • In most cases, the sex of origin of cells used should be reported (excluding, for example, immortalized cell lines, which are highly transformed and for which the sex of the original cells may not be relevant).
  • Both male and female animals should be studied when appropriate; and, when it is possible, both sexes should be studied in the same experiment.

____________________________

8The topics highlighted in this section are based on closing remarks of members of the workshop planning committee and the session chairs and on the open discussions throughout the workshop. They should not be construed as reflecting any group consensus or endorsement by the IOM.

Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×

Clinical-Study Design1

  • Studies should be designed with stratified randomization by sex; stratified analyses should not just be conducted post hoc. Simply mandating post hoc subgroup analyses today, on a study that was started 10 years ago, is not necessarily valid, because it will probably violate the randomization.
  • Studies should be designed with adequate statistical power for subgroup analyses and to test for interactions.
  • In the absence of adequate power, raw data should be archived by sex for future pooling and meta-analysis.
  • One possible criterion for requiring the analysis and reporting of sex-specific results should include an a priori reasonable likelihood that sex-based associations might exist.

Clinical-Study Reporting

  • The title and abstract should indicate whether a study involved only men or only women.
  • If the study design allows identification of sex differences, journals should require authors to present these results.
  • If there is an inability to identify sex differences, this should be reported in the discussion of the limitations of the study.

Researchers should be allowed to report inconclusive or descriptive sex-specific findings as raw data in electronic-only appendixes to meet NIH and FDA policies. As above, this will make the data available to researchers for conducting meta-analyses.

The Role of Editorial Policy

Levine reiterated earlier discussions that developing and implementing editorial policies regarding the analysis and interpretation of information that has already been obtained is fairly straightforward. Journal editors can set standards in their instructions for authors regarding what information is expected to be included in a manuscript.

More challenging and perhaps controversial is the development and implementation of editorial policies that ultimately influence how experiments are designed and conducted, including being appropriately powered to allow comparison between the sexes. Workshop participants expressed varied opinions regarding the extent to which a journal policy should stipulate what analyses authors must include. Some participants

Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×

also discussed how any clinical-journal editorial policy that affects study design may need to be phased in over a long period, inasmuch as clinical studies that are already under way may be years away from completion and publication.

Levine reminded participants that several editors stressed that the design and analysis of studies are not likely to change simply because editors change reporting requirements. Journals can encourage change by making very clear what they consider to be the standards for sex-specific reporting, but there needs to be a culture shift within science. In that regard, there is a key role for federal agencies and other funders in shaping research culture to embrace consideration of sex differences as part of sound study design. For example, when reviewing grant proposals, NIH and other funders could consider whether criteria for sex-specific analysis are met (for example, whether a study includes both males and females, is powered for valid subgroup analysis, or justifies the study of only one sex).

Adler pointed to earlier discussions that there are clearly other subgroups that may be relevant to consider, such as race and ethnicity. However, issues of sample size are more challenging with multiple groups and there is much greater evidence of the biological effects of sex than of race. The need for research that will allow for a better understanding of racial and ethnic differences in health and treatment effects does not diminish the need for sex-specific analyses, nor is it tied to it.

Levine discussed the issue, raised earlier by participants, of consideration of sex in studies that use animals, because these studies help to elucidate mechanisms and inform drug-development studies in humans. It was suggested that editorial policies for basic-science journals be “more of a carrot policy than a stick policy.” That is, the value added in the review process by a stated policy of sex-specific reporting should be stressed, and reviewers should be advised to consider the inclusion of sex-specific information as a desirable attribute of a manuscript. The currency of scientific work is publication, and it was suggested that this approach will feed back to the design of experiments as researchers begin to understand that manuscripts that include sex-specific information and analyses, or a clear justification for studying only one sex, will be reviewed more favorably.

Levine also mentioned, as noted earlier by some participants, that there is no editorial body of basic-science journal editors comparable with the ICMJE for clinical journals.

Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×

 

Statistical Power for Subgroup Analysis

Anthony summarized earlier discussions pointing out that for clinical studies, issues of statistical power are paramount. But in a resource-limited research environment, larger samples do not constitute a feasible solution for enabling valid subgroup analysis. Instead, new study designs and advanced statistical methods may help reap the most reward from patient participation in clinical trials. It was suggested that when there is insufficient power to analyze sex differences within a study, it may be possible to combine data from various studies and conduct meta-analysis or apply advanced statistical methods, such as the use of Bayesian inference. Golub also cautioned about the potential for type II errors by publishing comparisons by sex that do not show a significant difference. If a study is not adequately powered to look for such differences, then a study showing no differences is meaningless.

Summary of Participants’ Suggestions for Advancing Sex-Specific Reporting

Adler discussed four themes that she thought reflected the suggestions for advancing sex-specific reporting discussed by others over the course of the day.

First, Adler noted the earlier discussions related to identifying the sex of populations in journal publications, including listing the sex of origin of cells and tissues, the sex of animals in basic and preclinical research, and the sex of participants in observational research and in clinical trials. If only one sex is studied, noting that in the title of the paper would be helpful. Adler suggested that having summary data, similar to what Golub presented, published annually would be helpful.

Second, she reiterated the advantages of sharing sex-identified raw data, noting that if a study is not sufficiently powered for subgroup analysis, sex-identified raw data could be made available, either as a supplement or on a website, to facilitate meta-analyses (with the necessary caution to avoid overinterpretation of the raw data).

Third, referring back to the discussion of using a “carrot policy” by giving “extra credit” in review to manuscripts that include sex-specific information, Adler pointed out that editors could make it clear that including sex-specific information will enhance a paper’s chances of publication.

Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×
Page 36
Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×
Page 37
Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×
Page 38
Suggested Citation:"LOOKING FORWARD." Institute of Medicine. 2012. Sex-Specific Reporting of Scientific Research: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/13307.
×
Page 39
Next: CLOSING REMARKS »
Sex-Specific Reporting of Scientific Research: A Workshop Summary Get This Book
×
Buy Paperback | $21.00 Buy Ebook | $16.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The number of women participating in clinical trials has increased during the last two decades, but women are still underrepresented in clinical trials in general. Some of the overall increase can be attributed to the greater number of women-only trials (of therapies for diseases that affect only women). Even when women are included in clinical trials, the results are often not analyzed separately by sex.

On August 30, 2011, the Institute of Medicine (IOM) Board on Population Health and Public Health Practice hosted the workshop Sex-Specific Reporting of Scientific Research. The workshop explored the need for sex-specific reporting of scientific results; potential barriers and unintended consequences of sex-specific reporting of scientific results; experiences of journals that have implemented sex-specific requirements, including the challenges and benefits of such editorial policies; and steps to facilitate the reporting of sex-specific results. Presenters and participants included current and former editors of scientific journals, researchers, and scientists and policymakers from government, industry, and nonprofit organizations. Presentations and discussions highlighted the importance to both women and men of having sex-specific data, the problems with sample size and financial constraints for conducting the research, the appropriateness of sex-specific analyses, and the limitations of journal policies to change experimental designs.

Sex-Specific Reporting of Scientific Research summarizes the presentations and discussions by the expert panelists during the IOM workshop. The workshop's first session focused on why sex-specific reporting is important. Panelists highlighted historical and current events that have hindered or helped to advance the study of women. In the next session, panelists in academe discussed the challenges of collecting, analyzing, and reporting sex-specific data from the researcher's perspective. That was followed by two panels of leading journal editors who shared their experiences in developing and implementing editorial policies and the implications of sex-specific reporting policies for journals.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!