English
Related papers

Related papers: Multi-Agent LLMs for Generating Research Limitatio…

200 papers

Peer review is fundamental to scientific research, but the growing volume of publications has intensified the challenges of this expertise-intensive process. While LLMs show promise in various scientific tasks, their potential to assist…

Computation and Language · Computer Science 2025-07-04 Zhijian Xu , Yilun Zhao , Manasi Patwardhan , Lovekesh Vig , Arman Cohan

The automation of scientific research through large language models (LLMs) presents significant opportunities but faces critical challenges in knowledge synthesis and quality assurance. We introduce Feedback-Refined Agent Methodology…

Computation and Language · Computer Science 2025-11-18 Chengzhang Yu , Yiming Zhang , Zhixin Liu , Zenghui Ding , Yining Sun , Zhanpeng Jin

Large language models (LLMs) have proven effective in artificial intelligence, where the multi-agent system (MAS) holds considerable promise for healthcare development by achieving the collaboration of LLMs. However, the absence of a…

Artificial Intelligence · Computer Science 2026-05-13 Zhihao Peng , Liuxin Bao , Yixuan Yuan

Decision conferences are structured, collaborative meetings that bring together experts from various fields to address complex issues and reach a consensus on recommendations for future actions or policies. These conferences often rely on…

Computation and Language · Computer Science 2025-07-14 Selina Heller , Mohamed Ibrahim , David Antony Selby , Sebastian Vollmer

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Large Language Model (LLM)-based multi-agent systems are increasingly applied to automate computational workflows in science and engineering. However, how inter-agent dynamics influence reasoning quality and verification reliability remains…

Artificial Intelligence · Computer Science 2025-11-07 Chuan Tian , Yilei Zhang

Objective: To demonstrate the capabilities of Large Language Models (LLMs) as autonomous agents to reproduce findings of published research studies using the same or similar dataset. Materials and Methods: We used the "Quick Access" dataset…

Computation and Language · Computer Science 2025-06-02 Nic Dobbins , Christelle Xiong , Kristine Lan , Meliha Yetisgen

In this study, we leverage LLM to enhance the semantic analysis and develop similarity metrics for texts, addressing the limitations of traditional unsupervised NLP metrics like ROUGE and BLEU. We develop a framework where LLMs such as…

Computation and Language · Computer Science 2024-02-22 Shaochen Xu , Zihao Wu , Huaqin Zhao , Peng Shu , Zhengliang Liu , Wenxiong Liao , Sheng Li , Andrea Sikora , Tianming Liu , Xiang Li

Critique ability, a meta-cognitive capability of humans, presents significant challenges for LLMs to improve. Recent works primarily rely on supervised fine-tuning (SFT) using critiques generated by a single LLM like GPT-4. However, these…

Computation and Language · Computer Science 2024-10-22 Tian Lan , Wenwei Zhang , Chengqi Lyu , Shuaibin Li , Chen Xu , Heyan Huang , Dahua Lin , Xian-Ling Mao , Kai Chen

Attributing answers to source documents is an approach used to enhance the verifiability of a model's output in retrieval augmented generation (RAG). Prior work has mainly focused on improving and evaluating the attribution quality of large…

Computation and Language · Computer Science 2025-07-15 Amin Abolghasemi , Leif Azzopardi , Seyyed Hadi Hashemi , Maarten de Rijke , Suzan Verberne

Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected…

Computation and Language · Computer Science 2024-11-12 Chang Gao , Haiyun Jiang , Deng Cai , Shuming Shi , Wai Lam

Multi-agent systems, which consist of multiple AI models interacting within a shared environment, are increasingly used for persona-based interactions. However, if not carefully designed, these systems can reinforce implicit biases in large…

Computation and Language · Computer Science 2025-07-03 Imran Mirza , Cole Huang , Ishwara Vasista , Rohan Patil , Asli Akalin , Sean O'Brien , Kevin Zhu

Reliable evaluation of large language model (LLM)-generated summaries remains an open challenge, particularly across heterogeneous domains and document lengths. We conduct a comprehensive meta-evaluation of 14 automatic summarization…

Computation and Language · Computer Science 2026-04-29 Huyen Nguyen , Haoxuan Zhang , Yang Zhang , Junhua Ding , Haihua Chen

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

Computation and Language · Computer Science 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large language model agents are becoming increasingly capable at web-centric tasks such as information retrieval, complex reasoning. These emerging capabilities have given rise to surge research interests in developing LLM agent for…

Computation and Language · Computer Science 2026-04-02 Yu Li , Lehui Li , Lin Chen , Qingmin Liao , Fengli Xu , Yong Li

Large Language Models (LLMs) have transformed the field of artificial intelligence by unlocking the era of generative applications. Built on top of generative AI capabilities, Agentic AI represents a major shift toward autonomous,…

Artificial Intelligence · Computer Science 2025-08-27 Karanbir Singh , Deepak Muppiri , William Ngu

Large Language Models (LLMs) have demonstrated impressive zero shot performance on a wide range of NLP tasks, demonstrating the ability to reason and apply commonsense. A relevant application is to use them for creating high quality…

Computation and Language · Computer Science 2024-07-11 Vinay Samuel , Houda Aynaou , Arijit Ghosh Chowdhury , Karthik Venkat Ramanan , Aman Chadha

Students benefit from math problems contextualized to their interests. Large language models (LLMs) offer promise for efficient personalization at scale. However, LLM-generated personalized problems may often have problems such as…

Computers and Society · Computer Science 2026-04-08 Fareya Ikram , Nischal Ashok Kumar , Junyang Lu , Hunter McNichols , Candace Walkington , Neil Heffernan , Andrew S. Lan

This survey explores the development of meta-thinking capabilities in Large Language Models (LLMs) from a Multi-Agent Reinforcement Learning (MARL) perspective. Meta-thinking self-reflection, assessment, and control of thinking processes is…

Artificial Intelligence · Computer Science 2025-04-22 Ahsan Bilal , Muhammad Ahmed Mohsin , Muhammad Umer , Muhammad Awais Khan Bangash , Muhammad Ali Jamshed