English
Related papers

Related papers: Making Paper Reviewing Robust to Bid Manipulation …

200 papers

Peer review is essential for maintaining academic quality, but the increasing volume of submissions places a significant burden on reviewers. Large language models (LLMs) offer potential assistance in this process, yet their susceptibility…

Computation and Language · Computer Science 2025-10-10 Tzu-Ling Lin , Wei-Chih Chen , Teng-Fang Hsiao , Hou-I Liu , Ya-Hsin Yeh , Yu Kai Chan , Wen-Sheng Lien , Po-Yen Kuo , Philip S. Yu , Hong-Han Shuai

Recent successes in the Machine Learning community have led to a steep increase in the number of papers submitted to conferences. This increase made more prominent some of the issues that affect the current review process used by these…

Machine Learning · Computer Science 2021-06-03 Alessio Russo

Modern machine learning and computer science conferences are experiencing a surge in the number of submissions that challenges the quality of peer review as the number of competent reviewers is growing at a much slower rate. To curb this…

Digital Libraries · Computer Science 2020-12-01 Ivan Stelmakh , Nihar B. Shah , Aarti Singh , Hal Daumé

This paper proposes an architecture and assignment management model of a conference management system that performs a precise and accurate automatic assignment of reviewers to papers. The system relies on taxonomy of keywords to describe…

Digital Libraries · Computer Science 2011-12-01 Yordan Kalmukov

The conference peer review process involves three constituencies with different objectives: authors want their papers accepted at prestigious venues (and quickly), conferences want to present a program with many high-quality and few…

Computer Science and Game Theory · Computer Science 2025-09-30 Yichi Zhang , Fang-Yi Yu , Grant Schoenebeck , David Kempe

The implicit policy of maintaining relatively stable acceptance rates at top AI conferences, despite exponentially growing submissions, introduces a critical structural vulnerability. This position paper characterizes a new systemic threat…

Computation and Language · Computer Science 2026-05-12 Rong Shan , Te Gao , Hang Zheng , Yunjia Xi , Jiachen Zhu , Zeyu Zheng , Yong Yu , Weinan Zhang , Jianghao Lin

As the adoption of machine learning models increases, ensuring robust models against adversarial attacks is increasingly important. With unsupervised machine learning gaining more attention, ensuring it is robust against attacks is vital.…

Machine Learning · Computer Science 2023-06-02 Mathias Lundteigen Mohus , Jinyue Li

Appropriate reviewer assignment significantly impacts the quality of proposal evaluation, as accurate and fair reviews are contingent on their assignment to relevant reviewers. The crucial task of assigning reviewers to submitted proposals…

Digital Libraries · Computer Science 2023-04-05 Meltem Aksoy , Seda Yanik , Mehmet Fatih Amasyali

Information has exploded on the Internet and mobile with the advent of the big data era. In particular, recommendation systems are widely used to help consumers who struggle to select the best products among such a large amount of…

Information Retrieval · Computer Science 2022-10-17 Mirae Kim , Simon Woo

Peer review is widely regarded as essential for advancing scientific research. However, reviewers may be biased by authors' prestige or other characteristics. Double-blind peer review, in which the authors' identities are masked from the…

Computers and Society · Computer Science 2021-10-13 Mengyi Sun , Jainabou Barry Danfa , Misha Teplitskiy

Citations play an important role in researchers' careers as a key factor in evaluation of scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective reviewers to try obtaining a more positive evaluation for…

Digital Libraries · Computer Science 2023-07-19 Ivan Stelmakh , Charvi Rastogi , Ryan Liu , Shuchi Chawla , Federico Echenique , Nihar B. Shah

Peer review is a key activity intended to preserve the quality and integrity of scientific publications. However, in practice it is far from perfect. We aim at understanding how reviewers, including those who have won awards for reviewing,…

Software Engineering · Computer Science 2021-06-21 Neil A. Ernst , Jeffrey C. Carver , Daniel Mendez , Marco Torchiano

With the rapid growth of information, recommender systems have become integral for providing personalized suggestions and overcoming information overload. However, their practical deployment often encounters ``dirty'' data, where noise or…

Information Retrieval · Computer Science 2025-04-02 Kaike Zhang , Qi Cao , Fei Sun , Yunfan Wu , Shuchang Tao , Huawei Shen , Xueqi Cheng

At the heart of many scientific conferences is the problem of matching submitted papers to suitable reviewers. Arriving at a good assignment is a major and important challenge for any conference organizer. In this paper we propose a…

Information Retrieval · Computer Science 2012-02-20 Laurent Charlin , Richard S. Zemel , Craig Boutilier

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

Machine Learning · Computer Science 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Automated reviewer recommendation for scientific conferences currently relies on the assumption that the program committee has the necessary expertise to handle all submissions. However, topical discrepancies between received submissions…

Digital Libraries · Computer Science 2022-01-27 Christin Katharina Kreutz , Krisztian Balog , Ralf Schenkel

Mainstream machine learning conferences have seen a dramatic increase in the number of participants, along with a growing range of perspectives, in recent years. Members of the machine learning community are likely to overhear allegations…

Machine Learning · Computer Science 2020-10-28 David Tran , Alex Valtchanov , Keshav Ganapathy , Raymond Feng , Eric Slud , Micah Goldblum , Tom Goldstein

A number of applications involve sequential arrival of users, and require showing each user an ordering of items. A prime example (which forms the focus of this paper) is the bidding process in conference peer review where reviewers enter…

Artificial Intelligence · Computer Science 2020-08-03 Tanner Fiez , Nihar B. Shah , Lillian Ratliff

Text-aware recommender systems incorporate rich textual features, such as titles and descriptions, to generate item recommendations for users. The use of textual features helps mitigate cold-start problems, and thus, such recommender…

Information Retrieval · Computer Science 2024-08-02 Sejoon Oh , Gaurav Verma , Srijan Kumar

In computer science, conferences and journals conduct peer review in order to decide what to publish. Many have pointed out the inherent weaknesses in peer review, including those of bias, quality, and accountability. Many have suggested…

Digital Libraries · Computer Science 2012-09-14 Amit K. Chopra