English
Related papers

Related papers: Peer Reviewing Revisited: Assessing Research with …

200 papers

The rapid advancement of large language models (LLMs) has inspired researchers to integrate them extensively into the academic workflow, potentially reshaping how research is practiced and reviewed. While previous studies highlight the…

Computation and Language · Computer Science 2025-10-15 Rui Li , Jia-Chen Gu , Po-Nien Kung , Heming Xia , Junfeng liu , Xiangwen Kong , Zhifang Sui , Nanyun Peng

Peer reviewing is a central component in the scientific publishing process. We present the first public dataset of scientific peer reviews available for research purposes (PeerRead v1) providing an opportunity to study this important…

Computation and Language · Computer Science 2018-04-26 Dongyeop Kang , Waleed Ammar , Bhavana Dalvi , Madeleine van Zuylen , Sebastian Kohlmeier , Eduard Hovy , Roy Schwartz

Peer reviewing is a central process in modern research and essential for ensuring high quality and reliability of published work. At the same time, it is a time-consuming process and increasing interest in emerging fields often results in a…

Computers and Society · Computer Science 2020-12-15 Michael Fromm , Evgeniy Faerman , Max Berrendorf , Siddharth Bhargava , Ruoxia Qi , Yao Zhang , Lukas Dennert , Sophia Selle , Yang Mao , Thomas Seidl

The number of scientific articles produced every year is growing rapidly. Providing quality control over them is crucial for scientists and, ultimately, for the public good. In modern science, this process is largely delegated to peer…

Peer review is a widely accepted mechanism for research evaluation, playing a pivotal role in academic publishing. However, criticisms have long been leveled at this mechanism, mostly because of its poor efficiency and low reproducibility.…

Artificial Intelligence · Computer Science 2023-07-18 Jialiang Lin , Jiaxin Song , Zhangping Zhou , Yidong Chen , Xiaodong Shi

We propose an academic publishing system where research papers are stored in a network of data centres owned by university libraries and research institutions, and are interfaced with the academic community through a website. In our system,…

Peer review is the cornerstone of scientific publishing, yet it suffers from inconsistencies, reviewer subjectivity, and scalability challenges. We introduce ReviewerToo, a modular framework for studying and deploying AI-assisted peer…

Artificial Intelligence · Computer Science 2025-10-13 Gaurav Sahu , Hugo Larochelle , Laurent Charlin , Christopher Pal

Traditional closed peer review systems, which have played a central role in scientific publishing, are often slow, costly, non-transparent, stochastic, and possibly subject to biases - factors that can impede scientific progress and…

Social and Information Networks · Computer Science 2025-10-03 Andrii Zahorodnii , Jasper J. F. van den Bosch , Ian Charest , Christopher Summerfield , Ila R. Fiete

Peer review aims to detect flaws and deficiencies in the design and interpretation of studies, and ensure the clarity and quality of their presentation. However, it has been questioned whether peer review fulfils this function. Studies have…

Digital Libraries · Computer Science 2021-10-18 Dimity Stephen

The number of researchers, articles, journals, conferences, funding opportunities, and other such scholarly resources continues to grow every year and at an increasing rate. Many services have emerged to support scholars in navigating…

Digital Libraries · Computer Science 2009-05-12 Marko A. Rodriguez , David W. Allen , Joshua Shinavier , Gary Ebersole

Despite peer-reviewing being an essential component of academia since the 1600s, it has repeatedly received criticisms for lack of transparency and consistency. We posit that recent work in machine learning and explainable AI provide tools…

Computation and Language · Computer Science 2021-04-16 Panagiotis Fytas , Georgios Rizos , Lucia Specia

This article challenges the assumption that journals and peer review are essential for developing,evaluating and disseminating scientific and other academic knowledge. It suggests a more flexible ecosystem, and examines some of the…

Digital Libraries · Computer Science 2024-02-16 Michael Wood

The peer review process for scientific publications faces significant challenges due to the increasing volume of submissions and inherent reviewer biases. While artificial intelligence offers the potential to facilitate the process, it also…

Computers and Society · Computer Science 2025-07-22 Ildar Baimuratov , Elena Lisanyuk , Dmitry Prokudin

Peer review is a key component of the publishing process in most fields of science. The increasing submission rates put a strain on reviewing quality and efficiency, motivating the development of applications to support the reviewing and…

Computation and Language · Computer Science 2022-06-01 Ilia Kuznetsov , Jan Buchmann , Max Eichler , Iryna Gurevych

An increasing number of scientific publications are created in open and transparent peer review models: a submission is published first, and then reviewers are invited, or a submission is reviewed in a closed environment but then these…

Information Retrieval · Computer Science 2018-12-05 Afshin Sadeghi , Sarven Capadisli , Johannes Wilm , Christoph Lange , Philipp Mayr

Peer-review plays a critical role in the scientific writing and publication ecosystem. To assess the efficiency and efficacy of the reviewing process, one essential element is to understand and evaluate the reviews themselves. In this work,…

Computation and Language · Computer Science 2019-03-26 Xinyu Hua , Mitko Nikolov , Nikhil Badugu , Lu Wang

Peer review and citation metrics are two means of gauging the value of scientific research, but the lack of publicly available peer review data makes the comparison of these methods difficult. Mathematics can serve as a useful laboratory…

Digital Libraries · Computer Science 2020-12-17 Lawrence Smolinsky , Daniel S. Sage , Aaron J. Lercher , Aaron Cao

Keeping up with the research literature plays an important role in the workflow of scientists - allowing them to understand a field, formulate the problems they focus on, and develop the solutions that they contribute, which in turn shape…

Information Retrieval · Computer Science 2023-01-11 Sheshera Mysore , Mahmood Jasim , Haoru Song , Sarah Akbar , Andre Kenneth Chase Randall , Narges Mahyar

Over the last century, we observe a steady and exponentially growth of scientific publications globally. The overwhelming amount of available literature makes a holistic analysis of the research within a field and between fields based on…

Social and Information Networks · Computer Science 2022-03-09 Diego Kozlowski , Jennifer Dusdal , Jun Pang , Andreas Zilian

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…