English
Related papers

Related papers: Peer Reviewing Revisited: Assessing Research with …

200 papers

The creation of systematic literature reviews (SLR) is critical for analyzing the landscape of a research field and guiding future research directions. However, retrieving and filtering the literature corpus for an SLR is highly…

Machine Learning · Computer Science 2026-02-18 Lucas Joos , Daniel A. Keim , Maximilian T. Fischer

Authoring survey or review articles still requires significant tedious manual effort, despite many advancements in research knowledge management having the potential to improve efficiency, reproducibility, and reuse. However, these…

Digital Libraries · Computer Science 2024-10-23 Tim Wittenborg , Oliver Karras , Sören Auer

Peer review is a critical process for ensuring the integrity of published scientific research. Confidence in this process is predicated on the assumption that experts in the relevant domain give careful consideration to the merits of…

Computation and Language · Computer Science 2026-02-09 Sungduk Yu , Man Luo , Avinash Madasu , Vasudev Lal , Phillip Howard

Scientific article recommender systems are playing an increasingly important role for researchers in retrieving scientific articles of interest in the coming era of big scholarly data. Most existing studies have designed unified methods for…

Social and Information Networks · Computer Science 2020-08-12 Feng Xia , Haifeng Liu , Ivan Lee , Longbing Cao

How can we distinguish whether a peer review was written by a human or generated by an AI model? We argue that, in this setting, authorship should not be attributed solely from the textual features of a review, but also from the ideas,…

Computation and Language · Computer Science 2026-05-22 André V. Duarte , Brian Tufts , Aditya Oke , Fei Fang , Arlindo L. Oliveira , Lei Li

Systematic reviews, which entail the extraction of data from large numbers of scientific documents, are an ideal avenue for the application of machine learning. They are vital to many fields of science and philanthropy, but are very…

Computation and Language · Computer Science 2020-10-12 Seraphina Goldfarb-Tarrant , Alexander Robertson , Jasmina Lazic , Theodora Tsouloufi , Louise Donnison , Karen Smyth

Since a number of journals specifically focus on the review and publication of data sets, reviewing their policies seems an appropriate place to start in assessing what existing practice looks like in the 'real world' of reviewing and…

Digital Libraries · Computer Science 2017-04-10 Todd A Carpenter

Peer review is the primary mechanism for evaluating scientific contributions, yet prior studies have mostly examined paper features or external metadata in isolation. The emergence of open platforms such as OpenReview has transformed peer…

Computers and Society · Computer Science 2026-01-30 Sangkeun Jung , Goun Pyeon , Inbum Heo , Hyungjin Ahn

Scientific information expresses human understanding of nature. This knowledge is largely disseminated in different forms of text, including scientific papers, news articles, and discourse among people on social media. While important for…

Computation and Language · Computer Science 2025-07-01 Dustin Wright

The way science is currently practiced shows conclusions but hides how they were reached. Researchers work privately, polish their results, publish a finished paper, and defend it. Errors are punished by retraction rather than corrected by…

Digital Libraries · Computer Science 2026-04-14 Sergey V. Samsonau

Systematic scientometric reviews, empowered by scientometric and visual analytic techniques, offer opportunities to improve the timeliness, accessibility, and reproducibility of conventional systematic reviews. While increasingly accessible…

Digital Libraries · Computer Science 2020-12-24 Chaomei Chen , Min Song

We propose a tool for experts finding applied to academic data generated by the start-up DSRT in the context of its application Peerus. A user may submit the title, the abstract and optionnally the authors and the journal of publication of…

Information Retrieval · Computer Science 2018-07-11 Robin Brochier , Adrien Guille , Julien Velcin , Benjamin Rothan , Di Cioccio

In peer review, reviewers are usually asked to provide scores for the papers. The scores are then used by Area Chairs or Program Chairs in various ways in the decision-making process. The scores are usually elicited in a quantized form to…

Information Retrieval · Computer Science 2022-04-13 Yusha Liu , Yichong Xu , Nihar B. Shah , Aarti Singh

The advancement of various fields of science depends on the actions of individual scientists via the peer review process. The referees' work patterns and stochastic nature of decision making both relate to the particular features of…

Physics and Society · Physics 2013-04-19 T. Hartonen , M. J. Alava

Over the recent years, there has been a growing interest in developing new research evaluation methods that could go beyond the traditional citation-based metrics. This interest is motivated on one side by the wider availability or even…

Digital Libraries · Computer Science 2016-11-17 Drahomira Herrmannova , Petr Knoth

In this paper we present a phenomenological approach to describe a complex system: scientific research impact through Citation Mining. The novel concept of Citation Mining, a combination of citation bibliometrics and text mining, is used…

Physics and Society · Physics 2007-05-23 J. A del Rio , R. N. Kostoff , E. O. Garcia , A. M. Ramirez , J. A. Humenik

With the rapid growth of academic publications, peer review has become an essential yet time-consuming responsibility within the research community. Large Language Models (LLMs) have increasingly been adopted to assist in the generation of…

Computation and Language · Computer Science 2025-10-09 Xian Gao , Jiacheng Ruan , Zongyun Zhang , Jingsheng Gao , Ting Liu , Yuzhuo Fu

The reproduction and replication of research results has become a major issue for a number of scientific disciplines. In computer science and related computational disciplines such as systems biology, the challenges closely revolve around…

Software Engineering · Computer Science 2017-07-31 Tom Crick , Benjamin A. Hall , Samin Ishtiaq

Peer review is at the heart of modern science. As submission numbers rise and research communities grow, the decline in review quality is a popular narrative and a common concern. Yet, is it true? Review quality is difficult to measure, and…

Computation and Language · Computer Science 2026-01-22 Ilia Kuznetsov , Rohan Nayak , Alla Rozovskaya , Iryna Gurevych