10 Things for Curating Reproducible and FAIR Research
By Limor Peer
CURE-FAIR WG |
|
Group co-chairs: Limor Peer, Florio Arguillas, Thu-Mai Christian, Tom Honeyman, Mandy Gooch |
|
Recommendation title: 10 Things for Curating Reproducible and FAIR Research |
|
Authors: Lead Authors: Florio Arguillas, Thu-Mai Christian, Mandy Gooch, Tom Honeyman, Limor Peer (CURE-FAIR WG co-chairs) Contributors: Erin Clary, Christopher Erdmann, Ana Van Gulick, Daniel S. Katz, Katherine E. Koziar, Wanda Marsolek, Peter McQuilton, Qian Zhang, and members of the CURE-FAIR WG
|
|
Impact: The "10 Things for Curating Reproducible and FAIR Research" offer a framework for implementing effective curation workflows for achieving greater FAIR-ness and long-term usability of research data and code. Adoption of the guidelines for curating reproducible and FAIR research will improve the prospects for a reproducible scholarly record. The "10 CURE-FAIR Things" provide guidance for better practices for those entrusted with stewardship of the scholarly record, including repository managers, curators, and preservation and archival experts; the scholarly community, including researchers who generate and use data and code; policy-setting institutions, including research organizations, publishers, and funders; as well as others involved in the production, dissemination, and preservation of research. The document focuses primarily on research compendia produced by quantitative data-driven social science. It serves as a starting point for the development of curatorial guidelines to extend beyond the specific concerns of the social sciences community and other domains and disciplines that use similar methods, and to the particular curatorial concerns and requirements of an archives or publisher. |
|
DOI: 10.15497/RDA00074 |
|
Citation: Arguillas, F., Christian, T.-M., Gooch, M., Honeyman, T., & Peer, L. (2022). 10 Things for Curating Reproducible and FAIR Research (Version 1.1). Research Data Alliance. https://doi.org/10.15497/RDA00074 |
This document, "10 Things for Curating Reproducible and FAIR Research," describes the key issues of curating reproducible and FAIR research (CURE-FAIR). It lists standards-based guidelines for ten practices, focusing primarily on research compendia produced by quantitative data-driven social science.
The "10 CURE-FAIR Things" are intended primarily for data curators and information professionals who are charged with publication and archival of FAIR and computationally reproducible research. Often the first reusers of the research compendium, they have the opportunity to verify that a computation can be executed and that it can reproduce prespecified results. Secondarily, the "10 CURE-FAIR Things" will be of interest to researchers, publishers, editors, reviewers, and others who have a stake in creating, using, sharing, publishing, or preserving reproducible research.
The "10 CURE-FAIR Things" are:
- Completeness: The research compendium contains all of the objects needed to reproduce a predefined outcome.
- Organization: It is easy to understand and keep track of the various objects in the research compendium and their relationship over time.
- Economy: Fewer extraneous objects in the compendium mean fewer things that can break and require less maintenance over time.
- Transparency: The research compendium provides full disclosure of the research process that produced the scientific claim.
- Documentation: Information describing compendium objects is provided in enough detail to enable independent understanding and use of the compendium.
- Access: It is clear who can use what, how, and under what conditions, with open access preferred.
- Provenance: The origin of the components of the research compendium and how each has changed over time is evident.
- Metadata: Information about the research compendium and its components is embedded in a standardized, machine-readable code.
- Automation: As much as possible, the computational workflow is script- or workflow-based so that the workflow can be re-executed using minimal actions.
- Review: A series of managed activities needed to ensure continued access to and functionality of the research compendium and its components for as long as necessary.
Maintenance: This output will be hosted on Github and maintained by the Odum Institute
Version: 1.1
| Attachment | Size |
|---|---|
 10 Things for Curating Reproducible and FAIR Research v1.1.pdf | 363.9 KB |
| DRAFT v4--FAIR Curation for Reproducibility Things-2.pdf | 341.24 KB |
| Attachment | Size |
|---|---|
| 10 Things for Curating Reproducible and FAIR Research.pdf | 958.05 KB |
- Log in to post comments
- 6836 reads
Author: Lars Vilhuber
Date: 14 Apr, 2022
Great work. I've added a few comments in the original Google Doc. https://docs.google.com/document/d/1xNQtSlsCw_eyCim-iKd13x_g-hy9FYdgPKPr...
Author: Mandy Gooch
Date: 02 Jun, 2022
Hello Lars,
Thank you very much for your comments on this output. We accidentally left the draft version open in google and have since closed it, therefore, we have addressed your comments below:
One way to aid automation is to hold the execution environment as fixed. Fixing the execution environment (hardware, operating system, software and dependencies) increases the likelihood that code that ran in the same environment will run again without issue in the future.
A common approach to making it easier to rerun code is to do the computation on a cloud based service or platform. Examples of this approach include WHOLETALE, Code Ocean, or MyBinder. Many of these are services built on top of JupyterHub or RStudio which encapsulate the compute environment in a container. Integrations of similar functionality are also starting to become available within journals, notably the reproducible article from eLife, which brings the reproduction of results as close as possible to the published article."
Thank you again for your comments and review of this draft. We appreciate your contributions!
Best,
CURE-FAIR Co-Chairs
Author: Tobias Schweizer
Date: 19 Sep, 2022
Hi there,
This sounds very interesting but it's kind of late for me (Europe). Do you plan on making this webinar accessible as a video? I'd very much appreciate that.
Best,
Tobias
Author: Tobias Schweizer
Date: 19 Sep, 2022
Hi there,
This sounds very interesting but it's kind of late for me (Europe). Do you plan on making this webinar accessible as a video? I'd very much appreciate that.
Best,
Tobias