Skip to main content
NIH Intramural Research Program, Our Research Changes Lives

Navigation controls

  • Search
  • Menu

Social follow links

  • Podcast
  • Instagram
  • Twitter
  • YouTube
  • LinkedIn

Main navigation

  • About Us
    • What Is the IRP?
    • History
    • Honors
      • Nobel Prize
      • Lasker Award
      • Breakthrough Prize
      • Presidential Early Career Award for Scientists and Engineers (PECASE)
      • Presidential Medal of Freedom
      • National Medal of Science
      • Searle Scholars
      • The National Academy of Sciences
      • The National Academy of Medicine
      • The National Academy of Engineering
      • The American Academy of Arts and Sciences
      • National Medal of Technology & Innovation
      • Samuel J. Heyman Service to America Medals
      • Crafoord Prize
      • Fellows of the Royal Society
      • Canada Gairdner Awards
    • Organization & Leadership
    • Our Programs
      • NCI
      • NEI
      • NHGRI
      • NHLBI
      • NIA
      • NIAAA
      • NIAID
      • NIAMS
      • NIBIB
      • NICHD
      • NIDA
      • NIDCD
      • NIDCR
      • NIDDK
      • NIEHS
      • NIMH
      • NIMHD
      • NINDS
      • NINR
      • NLM
      • CC
      • NCATS
      • NCCIH
    • Research Campus Locations
    • Contact Information
  • Our Research
    • Scientific Focus Areas
      • Biomedical Engineering & Biophysics
      • Cancer Biology
      • Cell Biology
      • Chemical Biology
      • Chromosome Biology
      • Clinical Research
      • Computational Biology
      • Developmental Biology
      • Epidemiology
      • Genetics & Genomics
      • Health Disparities
      • Immunology
      • Microbiology & Infectious Diseases
      • Molecular Biology & Biochemistry
      • Molecular Pharmacology
      • Neuroscience
      • RNA Biology
      • Social & Behavioral Sciences
      • Stem Cell Biology
      • Structural Biology
      • Systems Biology
      • Virology
    • Principal Investigators
      • View by Investigator Name
      • View by Scientific Focus Area
    • Accomplishments
      • View All Accomplishments by Date
      • View All Health Topics
      • The Body
      • Health & Wellness
      • Conditions & Diseases
      • Procedures
    • Accelerating Science
      • Investing in Cutting-Edge Animal Models
      • Creating Cell-Based Therapies
      • Advancing Computational and Structural Biology
      • Combating Drug Resistance
      • Developing Novel Imaging Techniques
      • Charting the Pathways of Inflammation
      • Zooming in on the Microbiome
      • Uncovering New Opportunities for Natural Products
      • Stimulating Neuroscience Research
      • Pursuing Precision Medicine
      • Unlocking the Potential of RNA Biology and Therapeutics
      • Producing Novel Vaccines
    • Research in Action
      • View All Stories
      • Too Much of a Good Thing
      • Turning Face Perception on Its Head
      • Safeguarding a Second Chance at Life
      • A Biological Betrayal
    • Trans-IRP Research Resources
      • Supercomputing
    • IRP Review Process
    • Commercializing Inventions
  • NIH Clinical Center
    • Clinical Center Facilities
    • Advancing Translational Science
    • Clinical Trials
      • Get Involved with Clinical Research
      • Physician Resources
  • News & Events
    • In the News
    • I am Intramural Blog
    • Speaking of Science Podcast
    • SciBites Video Shorts
    • The NIH Catalyst Newsletter
    • Events
  • Careers
    • Faculty-Level Scientific Careers
    • Trans-NIH Scientific Recruitments
      • Stadtman Tenure-Track Investigators
        • Science, the Stadtman Way
        • Earl Stadtman Investigator Frequently Asked Questions
      • Lasker Clinical Research Scholars
      • Independent Research Scholar
    • Scientific & Clinical Careers
    • Administrative Careers
  • Research Training
    • Program Information
    • Training Opportunities
    • NIH Work/Life Resources
The NIH Catalyst: A Publication About NIH Intramural Research

National Institutes of Health • Office of the Director | Volume 22 Issue 4 • July–August 2014

From the Deputy Director for Intramural Research

Enhancing Reproducibility of Research Findings

BY MICHAEL GOTTESMAN, DDIR

MIchael Gottesman

One of the signal characteristics of experimental research is that it is self-correcting: Other scientists may confirm the findings, apply more sophisticated approaches to enhance and extend the results, or demonstrate that the results or conclusions are flawed. There has been a growing concern, however, that more than a small minority of published preclinical studies using animal models cannot be easily replicated. Even studies of basic cell and structural biology, which depend on complex data sets that rely on technology-intense interpretation, may not be yielding valid conclusions.

The NIH, as the primary funder of biomedical research, has an obligation to ensure that as high a percentage as possible of published research results stands the test of time. In general, irreproducibility is not due to scientific misconduct or deliberate falsification, fabrication, or fraud. What we are talking is a complex array of other factors that may result in an inability of scientists to reproduce the work of other scientists.

The primary tool that NIH has is its ability to educate researchers about what can go wrong and how to avoid common pitfalls. In preclinical animal research, the list of possible problems is long, from poor statistical design to uncontrolled environmental influences. The NIH intramural program has been asked to help pilot a computer-based training module that outlines the kinds of problems that can beset animal studies. We will start by asking our fellows to beta test the current training module that was developed by Shai Silberberg (extramural program director in the National Institute of Neurological Disorders and Stroke) and then participate in focus groups to help us determine how to make this module more effective and user-friendly. Eventually we also expect to have, as part of the overall training in research integrity, a sophisticated course in experimental design. Our scientific directors have given strong support to training that improves the integrity and reproducibility of our science, and we trust that all of our staff will benefit from exposure to this training experience.

Another area that concerns me is the possibility for errors in interpreting data obtained from advanced technologies such as high-resolution structural models from nuclear magnetic resonance, crystallographic, mass spectroscopic, and cryoelectron microscopy data; high-resolution cell imaging and cell-based fluorescence resonance energy transfer and fluorescence-activated cell-sorting analyses; and studies using specialized cell lines and antibodies.

Intramural NIH is very fortunate to have world-class experts in these technologies; I have assembled a committee that will help educate us about them. We are planning a one-day workshop at NIH—“New Advances in Structural and Cell-based Analyses: Potential and Pitfalls”—that should attract our trainees and staff to hear about the latest advances and the kinds of reproducibility problems that can arise. The workshop will also include our extramural academic and industrial colleagues and representatives from journals and professional societies, all of whom share concerns about data reproducibility. The goals are to educate researchers about what these techniques can accomplish; provide a cautionary note to scientists who are inexperienced in using these techniques but who plan to use them; and educate others who are reading results in the literature. A white paper and videos of the presentations will be made available for our staff and our extramural colleagues.

NIH Principal Deputy Director Larry Tabak has taken the lead in assembling a toolkit of approaches to enhance reproducibility and transparency of research findings. NIH institutes and centers are undertaking multiple pilots, including efforts to study and try to reduce factors that may motivate careless publication including “perverse incentives” (the promise of promotion, tenure, and, in rare instances, cash rewards to researchers who publish in certain journals) related to publication and funding.

Another way that NIH is addressing the problem is by altering the format of the “biographical sketch” that grant applicants must complete. The proposed format will emphasize the significance of advances resulting from the work and reflect individual contributions to successful research projects.

We are hoping that intramural NIH can help pilot important educational materials as they become available and lead the way in promoting reproducibility in research results. As always, your suggestions about how best to achieve these important goals would be welcome.


You might also be interested in reading a recent Nature article—“NIH Plans to Enhance Reproducibility”—that was co-authored by NIH Director Francis Collins and Lawrence Tabak (Nature 505:612–613, 2014).

This page was last updated on Wednesday, April 27, 2022

  • Issue Overview
  • Features
    • NIH Microscopy Lights Up Dulles Airport
    • Human Motor Control
    • NIH’s First Intramural Early Independent Scientists
    • New Software Program Evaluates Potential for Metastasis
    • Extending Organ Survival
    • FelCom: Getting the Most Out of Your NIH Training Experience
  • Departments
    • From the Deputy Director for Intramural Research
    • Colleagues: Recently Tenured
    • Research Briefs
    • News You Can Use
    • The Training Page
    • From the Annals of NIH History
    • News Briefs
    • The SIG Beat
    • Announcements
  • Issue Contents
  • Download this issue as a PDF

Catalyst menu

  • Current Issue
  • Previous Issues
  • About The NIH Catalyst
  • Contact The NIH Catalyst
  • Share Your Story
  • NIH Abbreviations

Catalyst links

  • Follow The NIH Catalyst

Subscribe Today!

Subscribe to The NIH Catalyst Newsletter and receive email updates.

Subscribe

Get IRP Updates

Subscribe

  • Email
  • Print
  • Share Twitter Facebook LinkedIn

Main navigation

  • About Us
    • What Is the IRP?
    • History
    • Honors
    • Organization & Leadership
    • Our Programs
    • Research Campus Locations
    • Contact Information
  • Our Research
    • Scientific Focus Areas
    • Principal Investigators
    • Accomplishments
    • Accelerating Science
    • Research in Action
    • Trans-IRP Research Resources
    • IRP Review Process
    • Commercializing Inventions
  • NIH Clinical Center
    • Clinical Center Facilities
    • Advancing Translational Science
    • Clinical Trials
  • News & Events
    • In the News
    • I am Intramural Blog
    • Speaking of Science Podcast
    • SciBites Video Shorts
    • The NIH Catalyst Newsletter
    • Events
  • Careers
    • Faculty-Level Scientific Careers
    • Trans-NIH Scientific Recruitments
    • Scientific & Clinical Careers
    • Administrative Careers
  • Research Training
    • Program Information
    • Training Opportunities
    • NIH Work/Life Resources
  • Department of Health and Human Services
  • National Institutes of Health
  • USA.gov

Footer

  • Home
  • Contact Us
  • IRP Brand Materials
  • HHS Vulnerability Disclosure
  • Web Policies & Notices
  • Site Map
  • Search