English
Related papers

Related papers: Helpful Agent Meets Deceptive Judge: Understanding…

200 papers

LLM-as-Judge has emerged as a scalable alternative to human evaluation, enabling large language models (LLMs) to provide reward signals in trainings. While recent work has explored multi-agent extensions such as multi-agent debate and…

Artificial Intelligence · Computer Science 2025-09-19 Chiyu Ma , Enpei Zhang , Yilun Zhao , Wenjun Liu , Yaning Jia , Peijun Qing , Lin Shi , Arman Cohan , Yujun Yan , Soroush Vosoughi

The deployment of Large Language Models (LLMs) as tool-using agents causes their alignment training to manifest in new ways. Recent work finds that language models can use tools in ways that contradict the interests or explicit instructions…

Machine Learning · Computer Science 2026-04-24 Kushal Agrawal , Frank Xiao , Guido Bergman , Asa Cooper Stickland

In the age of large language models (LLMs), autonomous agents have emerged as a powerful paradigm for achieving general intelligence. These agents dynamically leverage tools, memory, and reasoning capabilities to accomplish user-defined…

Artificial Intelligence · Computer Science 2025-08-05 Chaojia Yu , Zihan Cheng , Hanwen Cui , Yishuo Gao , Zexu Luo , Yijin Wang , Hangbin Zheng , Yong Zhao

The rise of multi-agent systems powered by large language models (LLMs) and specialized reasoning agents exposes fundamental limitations in today's data management architectures. Traditional databases and data fabrics were designed for…

Multiagent Systems · Computer Science 2025-12-11 Ioana Giurgiu , Michael E. Nidd

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks, but optimizing LLM-based agentic systems remains challenging due to the vast search space of agent configurations, prompting strategies, and…

Machine Learning · Computer Science 2026-03-02 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability to cascading…

Judgmental forecasting is the task of making predictions about future events based on human judgment. This task can be seen as a form of claim verification, where the claim corresponds to a future event and the task is to assess the…

Artificial Intelligence · Computer Science 2026-02-12 Deniz Gorur , Antonio Rago , Francesca Toni

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Optimizing LLM-based agentic workflows is challenging for scaling AI capabilities. Current methods rely on coarse, end-to-end evaluation signals and lack fine-grained signals on where to refine, often resulting in inefficient or low-impact…

Artificial Intelligence · Computer Science 2026-02-03 Zihan Ma , Zhikai Zhao , Chuanbo Hua , Federico Berto , Jinkyoo Park

We introduce AgenticSimLaw, a role-structured, multi-agent debate framework that provides transparent and controllable test-time reasoning for high-stakes tabular decision-making tasks. Unlike black-box approaches, our courtroom-style…

Artificial Intelligence · Computer Science 2026-01-30 Jon Chun , Kathrine Elkins , Yong Suk Lee

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

Computation and Language · Computer Science 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Eliciting reasoning has emerged as a powerful technique for improving the performance of large language models (LLMs) on complex tasks by inducing thinking. However, their effectiveness in realistic user-engaged agent scenarios remains…

Computation and Language · Computer Science 2026-02-10 Jiatong Li , Changdae Oh , Hyeong Kyu Choi , Jindong Wang , Sharon Li

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Automation platforms such as GitHub Actions and n8n are increasingly adopting so-called agentic workflows, which integrate Large Language Model (LLM) agents for tasks such as code review and data synchronization. While bringing convenience…

Cryptography and Security · Computer Science 2026-05-13 Neil Fendley , Zhengyu Liu , Aonan Guan , Jiacheng Zhong , Yinzhi Cao

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

The pursuit of real-time agentic interaction has driven interest in Diffusion-based Large Language Models (dLLMs) as alternatives to auto-regressive backbones, promising to break the sequential latency bottleneck. However, does such…

Computation and Language · Computer Science 2026-04-27 Qingyu Lu , Liang Ding , Kanjian Zhang , Jinxia Zhang , Dacheng Tao

Security analysts are overwhelmed by the volume of alerts and the low context provided by many detection systems. Early-stage investigations typically require manual correlation across multiple log sources, a task that is usually…

Cryptography and Security · Computer Science 2026-04-29 Even Eilertsen , Vasileios Mavroeidis , Gudmund Grov

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

Artificial Intelligence · Computer Science 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

Large Language Models (LLMs) and other foundation models are increasingly used as the core of AI agents. In agentic workflows, these agents plan tasks, interact with humans and peers, and influence scientific outcomes across federated and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-21 Renan Souza , Amal Gueroudji , Stephen DeWitt , Daniel Rosendo , Tirthankar Ghosal , Robert Ross , Prasanna Balaprakash , Rafael Ferreira da Silva

Background: There is great interest in agentic LLMs, large language models that act as agents. Objectives: We review the growing body of work in this area and provide a research agenda. Methods: Agentic LLMs are LLMs that (1) reason, (2)…

Artificial Intelligence · Computer Science 2026-01-01 Aske Plaat , Max van Duijn , Niki van Stein , Mike Preuss , Peter van der Putten , Kees Joost Batenburg