English
Related papers

Related papers: Hidden Actions and Hidden Information in Peer Revi…

200 papers

Large language models (LLMs) have grown in their usage to provide support for question answering across numerous disciplines. The models on their own have already shown promise for answering basic questions, however fail quickly where…

Information Retrieval · Computer Science 2025-04-15 David Brett , Anniek Myatt

It is often difficult to hand-specify what the correct reward function is for a task, so researchers have instead aimed to learn reward functions from human behavior or feedback. The types of behavior interpreted as evidence of the reward…

Machine Learning · Computer Science 2020-12-14 Hong Jun Jeon , Smitha Milli , Anca D. Dragan

The whole world is changed rapidly and using the current technologies Internet becomes an essential need for everyone. Web is used in every field. Most of the people use web for a common purpose like online shopping, chatting etc. During an…

Information Retrieval · Computer Science 2014-08-19 Richa Sharma , Shweta Nigam , Rekha Jain

Scientific writing builds upon already published papers. Manual identification of publications to read, cite or consider as related papers relies on a researcher's ability to identify fitting keywords or initial papers from which a…

Digital Libraries · Computer Science 2022-09-08 Christin Katharina Kreutz , Ralf Schenkel

What are the value and form of optimal persuasion when information can be generated only slowly? We study this question in a dynamic model in which a 'sender' provides public information over time subject to a graduality constraint, and a…

Theoretical Economics · Economics 2023-04-19 Matteo Escudé , Ludvig Sinander

Motivated by online platforms such as job markets, we study an agent choosing from a list of candidates, each with a hidden quality that determines match value. The agent observes only a noisy ranking of the candidates plus a binary signal…

Computer Science and Game Theory · Computer Science 2026-02-26 Kate Donahue , Nicole Immorlica , Brendan Lucier

A simulation model based on parallel systems is established, aiming to explore the relation between the number of submissions and the overall standard of academic journals within a similar discipline under peer review. The model can…

Digital Libraries · Computer Science 2019-08-22 Zong-Yuan Tan , Ning Cai , Jian Zhou , Sheng-Guo Zhang

Scientific publishing is the means by which we communicate and share scientific knowledge, but this process currently often lacks transparency and machine-interpretable representations. Scientific articles are published in long…

Digital Libraries · Computer Science 2020-06-12 Cristina-Iulia Bucur , Tobias Kuhn , Davide Ceolin

Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the…

Machine Learning · Computer Science 2024-06-07 Florian Karl , Lukas Malte Kemeter , Gabriel Dax , Paulina Sierak

Advances in information technology reduce barriers to information propagation, but at the same time they also induce the information overload problem. For the making of various decisions, mere digestion of the relevant information has…

Disordered Systems and Neural Networks · Physics 2009-11-11 Yi-Kuo Yu , Yi-Cheng Zhang , Paolo Laureti , Lionel Moret

Assigning qualified, unbiased and interested reviewers to paper submissions is vital for maintaining the integrity and quality of the academic publishing system and providing valuable reviews to authors. However, matching thousands of…

Information Retrieval · Computer Science 2022-11-09 Omer Anjum , Alok Kamatar , Toby Liang , Jinjun Xiong , Wen-mei Hwu

In the extensive recommender systems literature, novelty and diversity have been identified as key properties of useful recommendations. However, these properties have received limited attention in the specific sub-field of research paper…

Information Retrieval · Computer Science 2024-11-06 Eoghan Cunningham , Derek Greene , Barry Smyth

Misinformation is a challenging problem. This paper provides the first systematic interdisciplinary investigation of technical and non-technical interventions against misinformation. It combines interviews and a survey to understand which…

Human-Computer Interaction · Computer Science 2025-01-15 Hendrik Heuer

AI is reshaping academic research, yet its role in peer review remains polarising and contentious. Advocates see its potential to reduce reviewer burden and improve quality, while critics warn of risks to fairness, accountability, and…

Human-Computer Interaction · Computer Science 2026-02-17 Shiping Chen , Shu Zhong , Duncan P. Brumby , Anna L. Cox

Peer review often involves reviewers submitting their independent reviews, followed by a discussion among reviewers of each paper. A question among policymakers is whether the reviewers of a paper should be anonymous to each other during…

Computers and Society · Computer Science 2024-03-05 Charvi Rastogi , Xiangchen Song , Zhijing Jin , Ivan Stelmakh , Hal Daumé , Kun Zhang , Nihar B. Shah

Recent successes in the Machine Learning community have led to a steep increase in the number of papers submitted to conferences. This increase made more prominent some of the issues that affect the current review process used by these…

Machine Learning · Computer Science 2021-06-03 Alessio Russo

We consider the issue of biases in scholarly research, specifically, in peer review. There is a long standing debate on whether exposing author identities to reviewers induces biases against certain groups, and our focus is on designing…

Methodology · Statistics 2020-01-01 Ivan Stelmakh , Nihar B. Shah , Aarti Singh

We propose and analyze a family of information processing systems, where a finite set of experts or servers are employed to extract information about a stream of incoming jobs. Each job is associated with a hidden label drawn from some…

Probability · Mathematics 2016-05-31 Laurent Massoulie , Kuang Xu

This study examines whether there is any evidence of bias in two areas of common critique of open, non-anonymous peer review - and used in the post-publication, peer review system operated by the open-access scholarly publishing platform…

Digital Libraries · Computer Science 2019-11-11 Mike Thelwall , Verena Weigert , Liz Allen , Zena Nyakoojo , Eleanor-Rose Papas

The author's productivity is assessed based on publications, which requires a lot of motivation and time. Manuscripts get through several steps before being accepted and published. The purpose of this paper is to understand the time gap…

Digital Libraries · Computer Science 2022-10-25 Priyanka Sinha , Subaveerapandiyan A