English
Related papers

Related papers: PeerPrism: Peer Evaluation Expertise vs Review-wri…

200 papers

The widespread use of Large Language Models (LLMs) raises critical concerns regarding the unauthorized inclusion of copyrighted content in training data. Existing detection frameworks, such as DE-COP, are computationally intensive, and…

Artificial Intelligence · Computer Science 2026-03-20 David Szczecina , Senan Gaffori , Edmond Li

Attributing authorship in the era of large language models (LLMs) is increasingly challenging as machine-generated prose rivals human writing. We benchmark two complementary attribution mechanisms , fixed Style Embeddings and an…

Computation and Language · Computer Science 2026-03-18 Misam Abbas

Journals and conferences worry that peer reviews assisted by artificial intelligence (AI), in particular, large language models (LLMs), may negatively influence the validity and fairness of the peer-review system, a cornerstone of modern…

Computers and Society · Computer Science 2024-05-06 Giuseppe Russo Latona , Manoel Horta Ribeiro , Tim R. Davidson , Veniamin Veselovsky , Robert West

Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limited to static review…

Computation and Language · Computer Science 2024-06-11 Cheng Tan , Dongxin Lyu , Siyuan Li , Zhangyang Gao , Jingxuan Wei , Siqi Ma , Zicheng Liu , Stan Z. Li

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

Information Retrieval · Computer Science 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

The integrity of peer review is fundamental to scientific progress, but the rise of large language models (LLMs) has introduced concerns that some reviewers may rely on these tools to generate reviews rather than writing them independently.…

Digital Libraries · Computer Science 2026-03-13 Vishisht Rao , Aounon Kumar , Himabindu Lakkaraju , Nihar B. Shah

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework provides a rigorous foundation for evidence synthesis, yet the manual processes of data extraction and literature screening remain time-consuming and…

Digital Libraries · Computer Science 2026-03-23 Samar Shailendra , Rajan Kadel , Aakanksha Sharma , Islam Mohammad Tahidul , Urvashi Rahul Saxena

The widespread use of human-like text from Large Language Models (LLMs) necessitates the development of robust detection systems. However, progress is limited by a critical lack of suitable training data; existing datasets are often…

Computation and Language · Computer Science 2025-09-26 Irina Tolstykh , Aleksandra Tsybina , Sergey Yakubson , Maksim Kuprashevich

Writing is a foundational literacy skill that underpins effective communication, fosters critical thinking, facilitates learning across disciplines, and enables individuals to organize and articulate complex ideas. Consequently, writing…

Computation and Language · Computer Science 2026-03-05 Jiangang Hao

Critical peer review of scientific manuscripts presents a significant challenge for Large Language Models (LLMs), partly due to data limitations and the complexity of expert reasoning. This report introduces Persistent Workflow Prompting…

Artificial Intelligence · Computer Science 2025-07-10 Evgeny Markhasin

This study explores the potential of Large Language Models (LLMs), specifically GPT-4, to enhance objectivity in organizational task performance evaluations. Through comparative analyses across two studies, including various task…

Computation and Language · Computer Science 2024-08-13 Ning Li , Huaikang Zhou , Mingze Xu

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific practice. The demand for…

Artificial Intelligence · Computer Science 2026-02-17 Yifan Ding , Yuhui Shi , Zhiyan Li , Zilong Wang , Yifeng Gao , Yajun Yang , Mengjie Yang , Yixiu Liang , Xipeng Qiu , Xuanjing Huang , Xingjun Ma , Yu-Gang Jiang , Guoyu Wang

LLM-based applications are helping people write, and LLM-generated text is making its way into social media, journalism, and our classrooms. However, the differences between LLM-generated and human written text remain unclear. To explore…

Computation and Language · Computer Science 2025-03-05 Tuhin Chakrabarty , Philippe Laban , Chien-Sheng Wu

With the rapid and continuous increase in academic publications, identifying high-quality research has become an increasingly pressing challenge. While recent methods leveraging Large Language Models (LLMs) for automated paper evaluation…

Information Retrieval · Computer Science 2025-11-17 Wuqiang Zheng , Yiyan Xu , Xinyu Lin , Chongming Gao , Wenjie Wang , Fuli Feng

Scientific discovery begins with ideas, yet evaluating early-stage research concepts is a subtle and subjective human judgment. As large language models (LLMs) are increasingly tasked with generating scientific hypotheses, most systems…

Human-Computer Interaction · Computer Science 2026-03-26 Lingyu Zhang , Mitchell Wang , Boyuan Chen

The rise of large language models (LLMs) has created an urgent need to distinguish between human-written and LLM-generated text to ensure authenticity and societal trust. Existing detectors typically provide a binary classification for an…

Computation and Language · Computer Science 2026-05-06 Mengchu Li , Jin Zhu , Jinglai Li , Chengchun Shi

Evaluating large language models (LLMs) is fundamental, particularly in the context of practical applications. Conventional evaluation methods, typically designed primarily for LLM development, yield numerical scores that ignore the user…

Computation and Language · Computer Science 2024-04-12 Yongqiang Ma , Lizhi Qing , Jiawei Liu , Yangyang Kang , Yue Zhang , Wei Lu , Xiaozhong Liu , Qikai Cheng

As human-AI collaboration becomes increasingly prevalent in educational contexts, understanding and measuring the extent and nature of such interactions pose significant challenges. This research investigates the use of authorship…

Computation and Language · Computer Science 2025-09-09 Eduardo Araujo Oliveira , Madhavi Mohoni , Sonsoles López-Pernas , Mohammed Saqr

The escalating volume of academic research, coupled with a shortage of qualified reviewers, necessitates innovative approaches to peer review. In this work, we propose: 1. ReviewEval, a comprehensive evaluation framework for AI-generated…

Computation and Language · Computer Science 2025-05-27 Madhav Krishan Garg , Tejash Prasad , Tanmay Singhal , Chhavi Kirtani , Murari Mandal , Dhruv Kumar

The exponential growth of financial research has rendered traditional systematic literature reviews (SLRs) increasingly impractical, as manual screening and narrative synthesis struggle to keep pace with the scale and complexity of modern…

Computational Finance · Quantitative Finance 2026-04-17 Wei Wei , Jin Zheng , Zining Wang , Weibin Feng