English
Related papers

Related papers: PeerPrism: Peer Evaluation Expertise vs Review-wri…

200 papers

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Recent Large Language Models (LLMs) have shown the ability to generate content that is difficult or impossible to distinguish from human writing. We investigate the ability of differently-sized LLMs to replicate human writing style in…

Computation and Language · Computer Science 2024-05-06 Tolga Buz , Benjamin Frost , Nikola Genchev , Moritz Schneider , Lucie-Aimée Kaffee , Gerard de Melo

As large language models (LLMs) become more advanced, it is increasingly difficult to distinguish between human-written and AI-generated text. This paper draws a conceptual parallel between quantum uncertainty and the limits of authorship…

Computation and Language · Computer Science 2025-09-16 Aadil Gani Ganie

Large-scale Language Models (LLMs) have revolutionized human-AI interaction and achieved significant success in the generation of novel ideas. However, current assessments of idea generation overlook crucial factors such as knowledge…

Artificial Intelligence · Computer Science 2025-05-27 Yansheng Qiu , Haoquan Zhang , Zhaopan Xu , Ming Li , Diping Song , Zheng Wang , Kaipeng Zhang

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Novelty is a crucial criterion in the peer review process for evaluating academic papers. Traditionally, it's judged by experts or measure by unique reference combinations. Both methods have limitations: experts have limited knowledge, and…

Computation and Language · Computer Science 2025-07-17 Wenqing Wu , Chengzhi Zhang , Yi Zhao

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

Computation and Language · Computer Science 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

Significant progress has been made on text generation by pre-trained language models (PLMs), yet distinguishing between human and machine-generated text poses an escalating challenge. This paper offers an in-depth evaluation of three…

Computation and Language · Computer Science 2024-05-16 Muhammad Farid Adilazuarda

The potential of artificial intelligence (AI)-based large language models (LLMs) holds considerable promise in revolutionizing education, research, and practice. However, distinguishing between human-written and AI-generated text has become…

Computation and Language · Computer Science 2023-11-14 Kadhim Hayawi , Sakib Shahriar , Sujith Samuel Mathew

The rapid development of large language models (LLMs), like ChatGPT, has resulted in the widespread presence of LLM-generated content on social media platforms, raising concerns about misinformation, data biases, and privacy violations,…

Computation and Language · Computer Science 2025-02-07 Zihao Cheng , Li Zhou , Feng Jiang , Benyou Wang , Haizhou Li

Large language models (LLMs) present significant risks when used to generate non-factual content and spread disinformation at scale. Detecting such LLM-generated content is crucial, yet current detectors often struggle to generalize in…

Computation and Language · Computer Science 2025-02-18 Ran Li , Wei Hao , Weiliang Zhao , Junfeng Yang , Chengzhi Mao

Peer review is the cornerstone of academic publishing, yet the process is increasingly strained by rising submission volumes, reviewer overload, and expertise mismatches. Large language models (LLMs) are now being used as "reviewer aids,"…

Computers and Society · Computer Science 2025-09-15 Changjia Zhu , Junjie Xiong , Renkai Ma , Zhicong Lu , Yao Liu , Lingyao Li

The integration of large language models (LLMs) into peer review raises a concern beyond authorship and detection: the potential cascading automation of the entire editorial process. As reviews become partially or fully machine-generated,…

Artificial Intelligence · Computer Science 2026-04-10 Alin-Gabriel Văduva , Simona-Vasilica Oprea , Adela Bâra

The adoption of large language models (LLMs) is transforming the peer review process, from assisting reviewers in writing detailed evaluations to generating entire reviews automatically. While these capabilities offer new opportunities,…

Computers and Society · Computer Science 2026-04-29 Sai Suresh Macharla Vasu , Ivaxi Sheth , Hui-Po Wang , Ruta Binkyte , Mario Fritz

Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across a wide range of styles and genres. However, such capabilities are prone to potential misuse, such as fake…

Computation and Language · Computer Science 2025-05-20 Harika Abburi , Sanmitra Bhattacharya , Edward Bowen , Nirmala Pudota

Large Language Models (LLMs) have transformed how people interact with artificial intelligence (AI) systems, achieving state-of-the-art results in various tasks, including scientific discovery and hypothesis generation. However, the lack of…

Computation and Language · Computer Science 2024-11-06 Sikun Guo , Amir Hassan Shariatmadari , Guangzhi Xiong , Albert Huang , Eric Xie , Stefan Bekiranov , Aidong Zhang

Editors and reviewers are expected to ensure that manuscripts cite relevant, accurate, current, and ethically appropriate literature, yet manuscript-level citation auditing remains largely manual, fragmented, and difficult to scale.…

Large Language Models (LLMs) often struggle with creative generation, and multi-agent frameworks that improve reasoning through interaction can paradoxically hinder creativity by inducing content homogenization. We introduce LLM Review, a…

Computation and Language · Computer Science 2026-01-14 Weiyue Li , Mingxiao Song , Zhenda Shen , Dachuan Zhao , Yunfan Long , Yi Li , Yongce Li , Ruyi Yang , Mengyu Wang

Large language models (LLMs) are increasingly used as epistemic partners in everyday reasoning, yet their errors remain predominantly analyzed through predictive metrics rather than through their interpretive effects on human judgment. This…

Human-Computer Interaction · Computer Science 2025-12-19 Claudia Vale Oliveira , Nelson Zagalo , Filipe Silva , Anabela Brandao , Syeda Faryal Hussain Khurrum , Joaquim Santos

Large Language Models (LLMs) are increasingly utilized in scientific research assessment, particularly in automated paper review. However, existing LLM-based review systems face significant challenges, including limited domain expertise,…

Computation and Language · Computer Science 2025-03-12 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang