English
Related papers

Related papers: General Modular Harness for LLM Agents in Multi-Tu…

200 papers

Effectively processing long contexts remains a fundamental yet unsolved challenge for large language models (LLMs). Existing single-LLM-based methods primarily reduce the context window or optimize the attention mechanism, but they often…

Computation and Language · Computer Science 2026-04-22 Yichen Jiang , Jiakang Yuan , Chongjun Tu , Peng Ye , Tao Chen

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

Computation and Language · Computer Science 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo

Large language model (LLM) agents demonstrate strong performance in short-text contexts but often underperform in extended dialogues due to inefficient memory management. Existing approaches face a fundamental trade-off between efficiency…

Artificial Intelligence · Computer Science 2026-05-04 Xiaochen Zhao , Kaikai Wang , Xiaowen Zhang , Chen Yao , Aili Wang

Recent progress in computer vision has produced a wide range of powerful specialized models for detection, segmentation, counting, and other visual tasks. However, these models are usually optimized for isolated task formulations, making it…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yaowu Fan , Tao Han , Dazhao Du , Andy J. Ma , Jia Wan

Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that require extensive collaboration. However, despite the…

Artificial Intelligence · Computer Science 2023-09-20 Ran Gong , Qiuyuan Huang , Xiaojian Ma , Hoi Vo , Zane Durante , Yusuke Noda , Zilong Zheng , Song-Chun Zhu , Demetri Terzopoulos , Li Fei-Fei , Jianfeng Gao

Driven by the rapid advancements of Large Language Models (LLMs), LLM-based agents have emerged as powerful intelligent systems capable of human-like cognition, reasoning, and interaction. These agents are increasingly being deployed across…

Existing modular Reinforcement Learning (RL) architectures are generally based on reusable components, also allowing for "plug-and-play" integration. However, these modules are homogeneous in nature - in fact, they essentially provide…

Machine Learning · Computer Science 2024-11-01 Lorenz Wolf , Mirco Musolesi

This paper studies the next major bottleneck in agentic AI as system scaling, not only model scaling: the design of auditable, persistent, modular, and verifiable architectures around foundation models. We refer to this shift as scaling the…

Artificial Intelligence · Computer Science 2026-05-26 Shangding Gu

Human Activity Recognition (HAR) has been an active area of research, with applications ranging from healthcare to smart environments. The recent advancements in Large Language Models (LLMs) have opened new possibilities to leverage their…

Machine Learning · Computer Science 2025-12-24 Md Shakhrul Iman Siam , Ishtiaque Ahmed Showmik , Guanqun Song , Ting Zhu

Human Activity Recognition (HAR) is a core task in pervasive computing systems, where models must operate under strict computational constraints while remaining robust to heterogeneous and evolving deployment conditions. Recent advances…

Machine Learning · Computer Science 2026-05-13 Aleksandr Bredikhin , Philippe Lalanda , German Vega

Large language models (LLMs) excel at many NLP tasks but struggle to sustain long-term interactions due to limited attention over extended dialogue histories. Retrieval-augmented generation (RAG) mitigates this issue but lacks reliable…

Computation and Language · Computer Science 2026-01-23 Chunliang Chen , Ming Guan , Xiao Lin , Jiaxu Li , Luxi Lin , Qiyi Wang , Xiangyu Chen , Jixiang Luo , Changzhi Sun , Dell Zhang , Xuelong Li

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

Artificial Intelligence · Computer Science 2025-05-28 Heng Tan , Hua Yan , Yu Yang

The advent of large language models (LLMs) has catalyzed a transformative shift in artificial intelligence, paving the way for advanced intelligent agents capable of sophisticated reasoning, robust perception, and versatile action across…

The Game Reasoning Arena library provides a framework for evaluating the decision making abilities of large language models (LLMs) through strategic board games implemented in Google OpenSpiel library. The framework enables systematic…

Artificial Intelligence · Computer Science 2025-08-19 Lucia Cipolina-Kun , Marianna Nezhurina , Jenia Jitsev

Research on large language model (LLM) security is shifting from "will the model leak training data" to a more consequential question: can an agent with persistent, long-term memory be continuously shaped, cross-session poisoned, accessed…

Cryptography and Security · Computer Science 2026-04-21 Zehao Lin , Chunyu Li , Kai Chen

With the growing demand for intelligent in-vehicle experiences, vehicle-based agents are evolving from simple assistants to long-term companions. This evolution requires agents to continuously model multi-user preferences and make reliable…

Artificial Intelligence · Computer Science 2026-03-26 Yuhao Chen , Yi Xu , Xinyun Ding , Xiang Fang , Shuochen Liu , Luxi Lin , Qingyu Zhang , Ya Li , Quan Liu , Tong Xu

Intelligent agents need to remember salient information to reason in partially-observed environments. For example, agents with a first-person view should remember the positions of relevant objects even if they go out of view. Similarly, to…

Artificial Intelligence · Computer Science 2022-10-25 Jurgis Pasukonis , Timothy Lillicrap , Danijar Hafner

Large language models (LLMs) are increasingly grounded in sensor data to perceive and reason about human physiology and the physical world. However, accurately interpreting heterogeneous multimodal sensor data remains a fundamental…

Artificial Intelligence · Computer Science 2026-01-13 Hyungjun Yoon , Mohammad Malekzadeh , Sung-Ju Lee , Fahim Kawsar , Lorena Qendro

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang