Peer review of data papers: Does it achieve expectations for facilitating data sharing and reuse?

Abstract

Data papers, published as peer-reviewed articles that provide descriptive information about specific datasets, are a potential solution to promote data sharing and reuse. Although peer review determines what data papers get published, does the peer review process operate in line with the goal of data papers for facilitating data sharing and reuse? This article presents a qualitative study of open peer review reports of data papers in Earth System Science Data. We examine to what extent the review practices of data papers align with identifying the most valuable datasets and promoting data reuse. We conclude that peer reviewers adopted a variety of criteria to evaluate data papers, but it is still challenging to identify the most valuable datasets. Finally, we propose three recommendations for data publishers to improve their review policies and practices so that the process could be more standardised and utilised to support effective data sharing and reuse.