English
Related papers

Related papers: Leveraging LLM Inconsistency to Boost Pass@k Perfo…

200 papers

Multi-agent frameworks with Large Language Models (LLMs) have become promising tools for generating general-purpose programming languages using test-driven development, allowing developers to create more accurate and robust code. However,…

Quantum Physics · Physics 2025-07-04 Charlie Campbell , Hao Mark Chen , Wayne Luk , Hongxiang Fan

Fine-tuning large language models (LLMs) using diverse datasets is crucial for enhancing their overall performance across various domains. In practical scenarios, existing methods based on modeling the mixture proportions of data…

Computation and Language · Computer Science 2025-10-31 Zhenqing Ling , Daoyuan Chen , Liuyi Yao , Qianli Shen , Yaliang Li , Ying Shen

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

Information Retrieval · Computer Science 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Large language models (LLMs) have made rapid advancements in code generation for popular languages such as Python and C++. Many of these recent gains can be attributed to the use of ``agents'' that wrap domain-relevant tools alongside LLMs.…

Hardware Architecture · Computer Science 2026-03-31 Patrick Yubeaton , Siddharth Garg , Chinmay Hegde

Developers spend much time finding information that is relevant to their questions. Stack Overflow has been the leading resource, and with the advent of Large Language Models (LLMs), generative models such as ChatGPT are used frequently.…

Artificial Intelligence · Computer Science 2024-06-21 Davit Abrahamyan , Fatemeh H. Fard

Large Language Models (LLMs) are transforming human decision-making by acting as cognitive collaborators. Yet, this promise comes with a paradox: while LLMs can improve accuracy, they may also erode independent reasoning, promote…

Cryptography and Security · Computer Science 2025-09-09 Irdin Pekaric , Philipp Zech , Tom Mattson

Retrieval-augmented generation (RAG) has shown impressive capability in providing reliable answer predictions and addressing hallucination problems. A typical RAG implementation uses powerful retrieval models to extract external information…

Information Retrieval · Computer Science 2024-11-19 Ziwei Liu , Liang Zhang , Qian Li , Jianghua Wu , Guangxu Zhu

Large Language Models (LLMs) have transformed the field of artificial intelligence by unlocking the era of generative applications. Built on top of generative AI capabilities, Agentic AI represents a major shift toward autonomous,…

Artificial Intelligence · Computer Science 2025-08-27 Karanbir Singh , Deepak Muppiri , William Ngu

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

The remarkable capabilities of Large Language Model (LLM)-driven agents have enabled sophisticated systems to tackle complex, multi-step tasks, but their escalating costs threaten scalability and accessibility. This work presents the first…

Q-learning excels in learning from feedback within sequential decision-making tasks but often requires extensive sampling to achieve significant improvements. While reward shaping can enhance learning efficiency, non-potential-based methods…

Machine Learning · Computer Science 2024-05-27 Xiefeng Wu

Large language models (LLMs) have exhibited remarkable capabilities across diverse open-domain tasks, yet their application in specialized domains such as civil engineering remains largely unexplored. This paper starts bridging this gap by…

Computation and Language · Computer Science 2025-07-08 Jiachen Liu , Ziheng Geng , Ran Cao , Lu Cheng , Paolo Bocchini , Minghui Cheng

Agent faults pose a significant threat to the performance of multi-agent reinforcement learning (MARL) algorithms, introducing two key challenges. First, agents often struggle to extract critical information from the chaotic state space…

Machine Learning · Computer Science 2024-12-03 Yuchen Shi , Huaxin Pei , Liang Feng , Yi Zhang , Danya Yao

Building helpful and harmless large language models (LLMs) requires effective model alignment approach based on human instructions and feedback, which necessitates high-quality human-labeled data. Constructing such datasets is often…

Computation and Language · Computer Science 2025-05-07 Junlin Wang , Roy Xie , Shang Zhu , Jue Wang , Ben Athiwaratkun , Bhuwan Dhingra , Shuaiwen Leon Song , Ce Zhang , James Zou

Low sample efficiency is an enduring challenge of reinforcement learning (RL). With the advent of versatile large language models (LLMs), recent works impart common-sense knowledge to accelerate policy learning for RL processes. However, we…

Computation and Language · Computer Science 2024-07-08 Fuxiang Zhang , Junyou Li , Yi-Chen Li , Zongzhang Zhang , Yang Yu , Deheng Ye

Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have…

Multiagent Systems · Computer Science 2024-09-24 Asher Sprigler , Alexander Drobek , Keagan Weinstock , Wendpanga Tapsoba , Gavin Childress , Andy Dao , Lucas Gral

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

Software quality assurance activities become increasingly difficult as software systems become more and more complex and continuously grow in size. Moreover, testing becomes even more expensive when dealing with large-scale systems. Thus,…

Software Engineering · Computer Science 2023-10-27 Xhulja Shahini , Domenic Bubel , Andreas Metzger