English
Related papers

Related papers: Reporting and Reviewing LLM-Integrated Systems in …

200 papers

Human feedback on conversations with language language models (LLMs) is central to how these systems learn about the world, improve their capabilities, and are steered toward desirable and safe behaviors. However, this feedback is mostly…

Modern AI systems are being deployed in complex domains such as medicine, science, and law, where it is important that they not only produce correct answers, but also represent and update uncertain beliefs about the world as new evidence…

Machine Learning · Computer Science 2026-05-28 Chacha Chen , Matthew Jörke , Adam Goliński , Masha Fedzechkina , Guillermo Sapiro , Sinead Williamson , Nicholas Foti

Has the style of scientific communication changed due to the growing use of large language models in the writing process? We address this question in the domain of Natural Language Processing by leveraging two data resources we create: a…

Computation and Language · Computer Science 2026-05-20 Filip Miletić , Neele Falk

Can AI be cognitively biased in automated information judgment tasks? Despite recent progresses in measuring and mitigating social and algorithmic biases in AI and large language models (LLMs), it is not clear to what extent LLMs behave…

Information Retrieval · Computer Science 2024-11-26 Jiqun Liu , Jiangen He

The Industry 5.0 transition highlights EU efforts to design intelligent devices that can work alongside humans to enhance human capabilities, and such vision aligns with user preferences and needs to feel safe while collaborating with such…

Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached as an automated recommendation problem…

Computation and Language · Computer Science 2022-05-04 Terne Sasha Thorn Jakobsen , Anna Rogers

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

This study presents a cross-national quantitative analysis of how university students in the United States and Bangladesh interact with Large Language Models (LLMs). Based on an online survey of 318 students, results show that LLMs enhance…

Computers and Society · Computer Science 2025-07-09 Shahin Hossain , Shapla Khanam , Samaa Haniya , Nesma Ragab Nasr

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

Computation and Language · Computer Science 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing…

Artificial Intelligence · Computer Science 2024-12-25 Dan Shi , Tianhao Shen , Yufei Huang , Zhigen Li , Yongqi Leng , Renren Jin , Chuang Liu , Xinwei Wu , Zishan Guo , Linhao Yu , Ling Shi , Bojian Jiang , Deyi Xiong

The convergence of LLM-powered research assistants and AI-based peer review systems creates a critical vulnerability: fully automated publication loops where AI-generated research is evaluated by AI reviewers without human oversight. We…

Cryptography and Security · Computer Science 2025-10-22 Fengqing Jiang , Yichen Feng , Yuetai Li , Luyao Niu , Basel Alomair , Radha Poovendran

Large language models (LLMs) are being increasingly incorporated into scientific workflows. However, we have yet to fully grasp the implications of this integration. How should the advent of large language models affect the practice of…

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

Computation and Language · Computer Science 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

LLM-based applications are helping people write, and LLM-generated text is making its way into social media, journalism, and our classrooms. However, the differences between LLM-generated and human written text remain unclear. To explore…

Computation and Language · Computer Science 2025-03-05 Tuhin Chakrabarty , Philippe Laban , Chien-Sheng Wu

Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limited to static review…

Computation and Language · Computer Science 2024-06-11 Cheng Tan , Dongxin Lyu , Siyuan Li , Zhangyang Gao , Jingxuan Wei , Siqi Ma , Zicheng Liu , Stan Z. Li

Academic paper review typically requires substantial time, expertise, and human resources. Large Language Models (LLMs) present a promising method for automating the review process due to their extensive training data, broad knowledge base,…

Computers and Society · Computer Science 2025-06-24 Chuanlei Li , Xu Hu , Minghui Xu , Kun Li , Yue Zhang , Xiuzhen Cheng

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

Digital Libraries · Computer Science 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

Large Language Models (LLMs) were used to assist four Commonwealth Scientific and Industrial Research Organisation (CSIRO) researchers to perform systematic literature reviews (SLR). We evaluate the performance of LLMs for SLR tasks in…

Computation and Language · Computer Science 2025-03-24 Lachlan McGinness , Peter Baumgartner

The use of Large Language Models (LLMs) has drawn growing interest within the scientific community. LLMs can handle large volumes of textual data and support methods for evidence synthesis. Although recent studies highlight the potential of…

Software Engineering · Computer Science 2026-02-12 Cauã Ferreira Barros , Marcos Kalinowski , Mohamad Kassab , Valdemar Vicente Graciano Neto

This paper examines if large language models (LLMs) can help people write constructive comments on divisive social issues due to the difficulty of expressing constructive disagreement online. Through controlled experiments with 600…

Human-Computer Interaction · Computer Science 2025-07-31 Farhana Shahid , Maximilian Dittgen , Mor Naaman , Aditya Vashistha