Sci Simple

New Science Research Articles Everyday

# Health Sciences # Epidemiology

The Push for Transparency in Epidemiological Research

Epidemiological studies are striving for clearer practices and data sharing.

Timo Roettger, Adrian Dahl Askelund, Viktoria Birkenæs, Ludvig Daae Bjørndal, Agata Bochynska, Bernt Damian Glaser, Tamara Kalandadze, Max Korbmacher, Ivana Malovic, Julien Mayor, Pravesh Parekh, Daniel S. Quintana, Laurie J. Hannigan

― 7 min read


Boosting Credibility in Boosting Credibility in Health Research for reliable public health outcomes. Transparency in studies is essential
Table of Contents

Epidemiological Research is the study of how diseases and disorders emerge and spread over time. Imagine tracking a virus as it travels from person to person or understanding why certain health issues are more common in specific populations. This area of research helps us make sense of public health, informing everything from vaccination strategies to health policy.

One well-known study in this field is the Norwegian Mother, Father and Child Cohort Study, also known as MoBa. Established around 25 years ago, this study follows approximately 100,000 mothers, their children, and their partners. A wealth of information has been gathered, touching on various topics such as fertility, brain development, and childhood health. Researchers use this Data to gain insights into numerous important health questions.

The Complexity of Data Analysis

Epidemiological data sets, like MoBa, are not simple. They contain numerous variables—think of them as different pieces of a puzzle—and provide many avenues to explore. When researchers analyze these data sets, they face many choices about how to interpret the information. This flexibility can lead to different outcomes based on how each researcher approaches the data.

The many choices researchers make can be beneficial. It allows for unique perspectives and can lead to new ideas or discoveries. However, this flexibility can also be a double-edged sword. Different choices can yield different interpretations, potentially leading to confusion or conflicting results. Some studies have shown that when independent analysts look at the same data set with different methods, they can draw vastly different conclusions.

For instance, in a recent examination, researchers looking at the same epidemiological findings yielded results that didn’t match due to differing analytical paths taken. This shows the importance of clear methods in research to avoid misleading interpretations.

The Importance of Transparent Science

In response to these challenges, a movement known as “Open Science” has emerged. This aims to make research more open and transparent, allowing the public and the scientific community to evaluate findings critically. Some key practices include posting research plans in advance, sharing data and analysis scripts, and making study materials accessible.

Transparency in research is crucial. It enhances the credibility of findings and assists other researchers in verifying results. When researchers clearly document their methods and share them, it reduces confusion and increases trust in the outcomes.

Some practices help specifically tackle the flexibility researchers face. By preregistering Analyses—essentially stating upfront what will be examined—researchers can help mitigate issues that arise from post hoc (after-the-fact) decisions. This practice also helps highlight any changes made in analysis later, which can be important for understanding how conclusions were reached.

Embracing transparent practices can speed up research progress. By sharing materials and data, scientists can collaborate more effectively, learn from each other’s findings, and reduce duplication of efforts. In turn, this makes research more efficient and sustainable.

The Current State of Transparent Practices

Despite the push for transparency, many studies still fall short. Assessments have shown that in fields like biomedicine, social sciences, and psychology, the use of transparent practices remains low. This situation holds in epidemiological studies as well, where challenges related to privacy and sensitivity of data can hinder sharing.

For example, epidemiological studies often contain personal information that participants may not wish to share broadly. This presents an issue for researchers who want to share their findings while respecting the privacy of their subjects.

The goal of current discussions and investigations is to improve the adoption of these practices, especially in analyses of cohort data like MoBa. By identifying obstacles and providing straightforward solutions, researchers can be guided towards more transparent methods.

Assessing Transparency in MoBa Studies

To better understand the state of transparent practices in the MoBa study, researchers analyzed various published papers that made use of the data. They looked for practices considered best for open research, such as preregistration of analyses, sharing of data, and providing detailed descriptions of methods.

The findings revealed a mix of results. Less than 1% of the sampled articles reported preregistering their analyses, which is surprising given how useful this practice can be. Furthermore, the sharing of additional data or analysis protocols was also very low. However, a positive trend was seen in more recent publications, indicating that researchers are starting to catch on to the importance of these practices.

When looking at robustness checks—tests that help confirm if the results hold under different assumptions—about one-third of the articles included some form of sensitivity analysis. This is a good sign, as it shows researchers are beginning to evaluate their conclusions carefully.

Making Science More Transparent

To help researchers improve their practices, clear examples and templates can be invaluable. A hypothetical example can show how a researcher might conduct and report an analysis transparently. In this case, researchers interested in studying the effects of age and breastfeeding duration on childhood height could outline their plans in advance, including the key variables they would analyze.

During the analysis, if the data diverged from expectations, they could report any changes in their approach, thus maintaining transparency. They would document every deviation in a clear table, showing their thought process and decisions. Such attention to detail can ensure that other researchers can follow along and replicate the findings if needed.

Addressing these emotional moments, researchers could share their analytic code in an organized fashion, possibly using online platforms to ensure easy access. A readme file can help guide users through the various documents, offering clarity on what each part does.

Moreover, since sharing original data from MoBa is restricted due to privacy concerns, researchers could opt to create synthetic data. This involves generating data that mimic the statistical properties of the original data but do not contain any identifiable information. By doing this, they can share their work without risking participants’ confidentiality.

The Benefits of Transparent Practices

By adopting open and transparent practices, researchers can boost the credibility of their work and ensure that their findings can be trusted and verified. This is especially crucial in fields like epidemiology, where conclusions can significantly impact public health decisions and policies.

Transparency also helps researchers collaborate, leading to a faster and more innovative research process. When everyone has access to the same resources and methods, collective knowledge grows, and solutions to health challenges can emerge more rapidly.

In the grand scheme, the goal of epidemiological research is to help improve health outcomes for individuals and communities. When researchers communicate their findings clearly and transparently, it creates a bridge between research and practical application, ultimately benefiting patients and their families.

Challenges and Moving Forward

While the path to increased transparency is encouraging, it’s important to recognize that challenges will remain. Issues like privacy, the complexity of data, and the varying adoption of practices across disciplines can slow progress.

To further support the movement towards transparency, stakeholders such as universities, funding agencies, and scientific journals need to invest in the infrastructure that encourages these practices. This can include providing training for researchers on how to preregister their work or develop transparent sharing practices.

By incentivizing transparency, whether through funding opportunities or editorial policies, the scientific community can reinforce the importance of these practices. Keeping the conversation going is vital in ensuring that the message remains clear: transparent research benefits everyone in the long run.

Looking Ahead

As we continue to evaluate the state of epidemiological research, we see promising signs of change. The growing awareness of the importance of transparent practices is evident in the increasing rates of adoption. While many barriers still exist, the collaborative efforts can pave the way for a more open and credible research environment.

As researchers move forward, the hope is that transparency will become the norm rather than the exception. By embracing these best practices, they can make significant contributions to advancing public health and improving lives.

In conclusion, transparent practices in epidemiological research may still be in their infancy, but with effort and commitment, they have the potential to transform the way we study health and disease. Now, if only we could transparently figure out why people keep forgetting where they parked their cars!

Original Source

Title: Transparency in epidemiological analyses of cohort data - A case study of the Norwegian Mother, Father, and Child cohort study (MoBa)

Abstract: BackgroundEpidemiological research is central to our understanding of health and disease. Secondary analysis of cohort data is an important tool in epidemiological research, but is vulnerable to practices that can reduce the validity and robustness of results. As such, adopting measures to increase the transparency and reproducibility of secondary data analysis is paramount to ensuring the robustness and usefulness of findings. The uptake of such practices has not yet been systematically assessed. MethodsUsing the Norwegian Mother, Father and Child Cohort study (MoBa; Magnus et al., 2006, 2016) as a case study, we assessed the prevalence of the following reproducible practices in publications between 2007-2023: preregistering secondary analyses, sharing of synthetic data, additional materials, and analysis scripts, conducting robustness checks, directly replicating previously published studies, declaring conflicts of interest and publishing publicly available versions of the paper. ResultsPreregistering secondary data analysis was only found in 0.4% of articles. No articles used synthetic data sets. Sharing practices of additional data (2.3%), additional materials (3.4%) and analysis scripts (4.2%) were rare. Several practices, including data and analysis sharing, preregistration and robustness checks became more frequent over time. Based on these assessments, we present a practical example for how researchers might improve transparency and reproducibility of their research. ConclusionsThe present assessment demonstrates that some reproducible practices are more common than others, with some practices being virtually absent. In line with a broader shift towards open science, we observed an increasing use of reproducible research practices in recent years. Nonetheless, the large amount of analytical flexibility offered by cohorts such as MoBa places additional responsibility on researchers to adopt such practices with urgency, to both ensure the robustness of their findings and earn the confidence of those using them. A particular focus in future efforts should be put on practices that help mitigating bias due to researcher degrees of freedom - namely, preregistration, transparent sharing of analysis scripts, and robustness checks. We demonstrate by example that challenges in implementing reproducible research practices in analysis of secondary cohort data - even including those associated with data sharing - can be meaningfully overcome.

Authors: Timo Roettger, Adrian Dahl Askelund, Viktoria Birkenæs, Ludvig Daae Bjørndal, Agata Bochynska, Bernt Damian Glaser, Tamara Kalandadze, Max Korbmacher, Ivana Malovic, Julien Mayor, Pravesh Parekh, Daniel S. Quintana, Laurie J. Hannigan

Last Update: 2024-12-06 00:00:00

Language: English

Source URL: https://www.medrxiv.org/content/10.1101/2024.12.05.24318481

Source PDF: https://www.medrxiv.org/content/10.1101/2024.12.05.24318481.full.pdf

Licence: https://creativecommons.org/licenses/by-nc/4.0/

Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.

Thank you to medrxiv for use of its open access interoperability.

Similar Articles