Open Science Commitment
The Reach & Touch Lab commits to the following principles of open scientific conduct (see our accompanying blog post for some explanations and comments).
- For all new studies that we start as of January 2016, we will publish the data and a description of the analysis and/or the analysis scripts necessary to replicate the analyses we report in our publications.
- Conducting data acquisition and analysis with open data in mind will be a part of our standard study workflow. Accordingly, we document unusable raw data (e.g., due to artifacts, subject non-compliance, etc.), comment code, and organize code and data early on in the analysis process.
- Complying with open data and analysis requirements will be a focus of graduate supervision and mentoring in the lab. This includes making sure that all researchers in the lab receive the training necessary to make them confident in publishing data and code, and that we will continually teach each other in the methods we use. Complying with Open Science principles requires effort and work hours. PI and PostDocs of the lab commit to providing the necessary support and time.
- For earlier studies, for which we have not provided data publicly, we will make data available upon request. In the case of studies that were conducted with collaborators, however, data sharing will require the collaborators’ consent.
- For each new study, we will consider whether preregistration is sensible and reasonable. This will regularly be the case once a project passes preliminary testing. If reasonable, we will preregister our study on an appropriate third-party website such as the OSF, or at a journal that supports preregistration.
- For preregistration, we will state our hypotheses, the research design, the data collection stopping rule, and the planned analyses (as suggested in point 10 here).
- We will discuss with collaborators whether these Open Science principles can be implemented into our running collaborations.
- We will actively advocate the implementation of Open Science principles at the outset of our future collaborations.
Full disclosure and Open Access publishing
- We will add an open data statement in publications for which we provide data and scripts.
- We will provide the following full disclosure statement in our methods sections (adjusted from the 21-word rule suggested in point 3 here): “We report how we determined our sample size, all experimental manipulations, all exclusions of data (if any), and all evaluated measures of the study.” If necessary, this statement is adjusted to ensure that it is accurate.
- We will preferably publish in Open Access journals. When we publish closed access, we will provide the last submitted version as a preprint.
- In reviews, we will ask that the submitting authors comply with the “21-word rule“.
- Once our lab fully complies with the Open Science principles we’ve laid out here, we will join the Peer Reviewer Openness Initiative. This initiative asks scientists to make reviewing contingent upon authors of submitted articles sharing data and analysis scripts.
- This isn’t where Open Science ends. There are further suggestions about how science can be conducted responsibly and openly. The Reach & Touch Lab will continue to follow and take part in discussions about Open Science and implement new guidelines when they appear relevant and doable.