Robust research needs many lines of evidence

MR Munafò, G Davey Smith - 2018 - nature.com
MR Munafò, G Davey Smith
2018nature.com
Several studies across many fields estimate that only around 40% of published findings can
be replicated reliably. Various funders and communities are promoting ways for
independent teams to routinely replicate the findings of others.These efforts are laudable,
but insufficient. If a study is skewed and replications recapitulate that approach, findings will
be consistently incorrect or biased. Consider a commonly used assay in which the
production of a fluorescent protein is used to monitor cell activity. If the compounds used to …
Several studies across many fields estimate that only around 40% of published findings can be replicated reliably. Various funders and communities are promoting ways for independent teams to routinely replicate the findings of others.
These efforts are laudable, but insufficient. If a study is skewed and replications recapitulate that approach, findings will be consistently incorrect or biased. Consider a commonly used assay in which the production of a fluorescent protein is used to monitor cell activity. If the compounds used to manipulate cell activity are also fluorescent, as has happened 1, reliably repeatable results will not yield robust conclusions.
nature.com