Open Science Transparency Check-tool for open science transparency

Example

The tool checks if a paper mentions a time-stamped preregistration of the study's analysis plan on a third-party registry such as OSF, ensuring that the analysis plan was established before the data collection to avoid biases.

Scenario

For example, while reviewing a clinical trial paper, Open Science Transparency Check might find a statement like 'This trial was preregistered on ClinicalTrials.gov (NCT12345678).' If such a statement is present, the tool will score it accordingly.

Example

It assesses whether the paper includes a rationale for the chosen sample size, such as an a priori power analysis, which helps justify the statistical power of the study.

Scenario

In a neuroscience study, the tool would search for statements like 'We conducted an a priori power analysis using G*Power, which indicated that a sample size of 85 participants would be sufficient to detect a medium effect size with 80% power.'

Example

The tool evaluates whether the paper makes the processed data, analysis code, and any relevant materials publicly available in a repository like OSF, GitHub, or Zenodo.

Scenario

For a social science study, Open Science Transparency Check would look for clear data sharing statements such as 'All data and analysis code are available at https://osf.io/abcd1234/' and score it accordingly.