English
Related papers

Related papers: In praise of the referee

200 papers

Scientific evaluation is a determinant of how scientists, institutions and funders behave, and as such is a key element in the making of science. In this article, we propose an alternative to the current norm of evaluating research with…

Digital Libraries · Computer Science 2017-01-30 Michaël Bon , Michael Taylor , Gary S. McDowell

An alive publication is a new genre for presenting the results of scientific research, which means that scientific work is published online and then constantly developing and improving by its author. Serious errors and typos are no longer…

Digital Libraries · Computer Science 2023-04-10 Mikhail Mikhailovich Gorbunov-Posadov

Assigning qualified, unbiased and interested reviewers to paper submissions is vital for maintaining the integrity and quality of the academic publishing system and providing valuable reviews to authors. However, matching thousands of…

Information Retrieval · Computer Science 2022-11-09 Omer Anjum , Alok Kamatar , Toby Liang , Jinjun Xiong , Wen-mei Hwu

Today's peer review process for scientific articles is unnecessarily opaque and offers few incentives to referees. Likewise, the publishing process is unnecessarily inefficient and its results are only rarely made freely available to the…

Other Computer Science · Computer Science 2010-12-01 Axel Boldt

Bibliometric analysis has firmly conquered its place as an instrument for evaluation and international comparison of performance levels. Consequently, differences in coverage by standard bibliometric databases installed a dichotomy between…

Digital Libraries · Computer Science 2013-07-26 Nadine Rons , Arlette De Bruyn

Globally, recommendation services have become important due to the fact that they support e-commerce applications and different research communities. Recommender systems have a large number of applications in many fields including economic,…

Information Retrieval · Computer Science 2020-09-01 Xiaomei Bai , Mengyang Wang , Ivan Lee , Zhuo Yang , Xiangjie Kong , Feng Xia

Peer review aims to detect flaws and deficiencies in the design and interpretation of studies, and ensure the clarity and quality of their presentation. However, it has been questioned whether peer review fulfils this function. Studies have…

Digital Libraries · Computer Science 2021-10-18 Dimity Stephen

Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for…

General Economics · Economics 2023-05-12 Siddarth Srinivasan , Jamie Morgenstern

The peer-review process, in its present form, has been repeatedly criticized. Of the many critiques ranging from publication delays to referee bias, this paper will focus specifically on the issue of how submitted manuscripts are…

Digital Libraries · Computer Science 2021-08-23 Marko A. Rodriguez , Johan Bollen , Herbert Van de Sompel

Peer review is a process designed to produce a fair assessment of research quality before the publication of scholarly work in a journal. Demographics, nepotism, and seniority have been all shown to affect reviewer behavior suggesting the…

Digital Libraries · Computer Science 2018-11-07 Lucie Tvrznikova

Social and technical trends have significantly changed methods for evaluating and disseminating computing research. Traditional venues for reviewing and publishing, such as conferences and journals, worked effectively in the past. Recently,…

Computers and Society · Computer Science 2020-07-03 Benjamin Zorn , Tom Conte , Keith Marzullo , Suresh Venkatasubramanian

In this letter we propose the development of guidelines by the main editors associations as well as protocols within online journal management systems for keeping track of rejected manuscripts that are resubmitted as well as for the…

Digital Libraries · Computer Science 2013-09-11 Nicolas Robinson-Garcia , Daniel Torres-Salinas , J. M. Campanario , Emilio Delgado López-Cózar

It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk…

Physics and Society · Physics 2016-07-12 Simone Righi , Károly Takács

AI is reshaping academic research, yet its role in peer review remains polarising and contentious. Advocates see its potential to reduce reviewer burden and improve quality, while critics warn of risks to fairness, accountability, and…

Human-Computer Interaction · Computer Science 2026-02-17 Shiping Chen , Shu Zhong , Duncan P. Brumby , Anna L. Cox

Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their…

Digital Libraries · Computer Science 2019-10-09 Cristina-Iulia Bucur , Tobias Kuhn , Davide Ceolin

Evaluating and comparing the academic performance of a journal, a researcher or a single paper has long remained a critical, necessary but also controversial issue. Most of existing metrics invalidate comparison across different fields of…

Digital Libraries · Computer Science 2014-12-30 Tiancheng Li

Peer review is a laborious, yet essential, part of academic publishing with crucial impact on the scientific endeavor. The current lack of incentives and transparency harms the credibility of this process. Researchers are neither rewarded…

Computer Science and Game Theory · Computer Science 2024-04-30 Andreas Finke , Thomas Hensel

Peer review is a cornerstone of modern scientific endeavor. However, there is growing consensus that several limitations of the current peer review system, from lack of incentives to reviewers to lack of transparency, risks to undermine its…

Digital Libraries · Computer Science 2020-08-21 Andrea Mambrini , Andrea Baronchelli , Michele Starnini , Daniele Marinazzo , Manlio De Domenico

Since a number of journals specifically focus on the review and publication of data sets, reviewing their policies seems an appropriate place to start in assessing what existing practice looks like in the 'real world' of reviewing and…

Digital Libraries · Computer Science 2017-04-10 Todd A Carpenter

Citations play an important role in researchers' careers as a key factor in evaluation of scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective reviewers to try obtaining a more positive evaluation for…

Digital Libraries · Computer Science 2023-07-19 Ivan Stelmakh , Charvi Rastogi , Ryan Liu , Shuchi Chawla , Federico Echenique , Nihar B. Shah