English
Related papers

Related papers: M2A: Multimodal Memory Agent with Dual-Layer Hybri…

200 papers

Modern enterprise environments demand intelligent systems capable of handling complex, dynamic, and multi-faceted tasks with high levels of autonomy and adaptability. However, traditional single-purpose AI systems often lack sufficient…

Computation and Language · Computer Science 2025-08-26 Siyi Wu , Zeyu Wang , Xinyuan Song , Zhengpeng Zhou , Lifan Sun , Tianyu Shi

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

Computation and Language · Computer Science 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

In this paper, we propose a novel factored agent architecture designed to overcome the limitations of traditional single-agent systems in agentic AI. Our approach decomposes the agent into two specialized components: (1) a large language…

Artificial Intelligence · Computer Science 2025-04-03 Nicholas Roth , Christopher Hidey , Lucas Spangher , William F. Arnold , Chang Ye , Nick Masiewicki , Jinoo Baek , Peter Grabowski , Eugene Ie

Agents represent one of the most emerging applications of Large Language Models (LLMs) and Generative AI, with their effectiveness hinging on multimodal capabilities to navigate complex user environments. Conversational Health Agents…

Computation and Language · Computer Science 2024-05-09 Mahyar Abbasian , Iman Azimi , Mohammad Feli , Amir M. Rahmani , Ramesh Jain

Mental health challenges are rising globally, while traditional support services face limited availability and high costs. Large language models offer potential for conversational support, but often lack personalization, empathy, and…

Human-Computer Interaction · Computer Science 2026-04-24 Truong Le Minh Toan , Dieu Bang Mach , Tan Duy Le , Nguyen Tan Viet Tuyen

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

Computation and Language · Computer Science 2026-05-27 Huachuan Qiu , Zhenzhong Lan

Mental health assessment is crucial for early intervention and effective treatment, yet traditional clinician-based approaches are limited by the shortage of qualified professionals. Recent advances in artificial intelligence have sparked…

Computation and Language · Computer Science 2025-08-18 Jinpeng Hu , Ao Wang , Qianqian Xie , Hui Ma , Zhuo Li , Dan Guo

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and…

Artificial Intelligence · Computer Science 2026-05-19 Taewoon Kim , Michael Cochez , Vincent François-Lavet , Mark Neerincx , Piek Vossen

Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained…

Large language model (LLM) agents increasingly rely on accumulated memory to solve long-horizon decision-making tasks. However, most existing approaches store memory in fixed representations and reuse it at a single or implicit level of…

Artificial Intelligence · Computer Science 2026-01-13 Sirui Liang , Pengfei Cao , Jian Zhao , Wenhao Teng , Xiangwen Liao , Jun Zhao , Kang Liu

Agent memory has been touted as a dimension of growth for LLM-based applications, enabling agents that can accumulate experience, adapt across sessions, and move beyond single-shot question answering. The current generation of agent memory…

Computation and Language · Computer Science 2025-12-16 Chris Latimer , Nicoló Boschi , Andrew Neeser , Chris Bartholomew , Gaurav Srivastava , Xuan Wang , Naren Ramakrishnan

Automatic furniture layout is long desired for convenient interior design. Leveraging the remarkable visual reasoning capabilities of multimodal large language models (MLLMs), recent methods address layout generation in a static manner,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Can Wang , Hongliang Zhong , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Large language models (LLMs) are rapidly evolving from passive engines of text generation into agentic entities that can plan, remember, invoke external tools, and co-operate with one another. This perspective paper investigates how such…

Information Retrieval · Computer Science 2025-07-11 Reza Yousefi Maragheh , Yashar Deldjoo

One of the key factors influencing the reasoning capabilities of LLM-based agents is their ability to leverage long-term memory. Integrating long-term memory mechanisms allows agents to make informed decisions grounded in historical…

Computation and Language · Computer Science 2025-10-14 Haoran Sun , Zekun Zhang , Shaoning Zeng

Existing agent memory systems universally follow what we term a Memory-as-Tool paradigm where a single query triggers one-shot retrieval of flat passage lists, suffering from passive invocation, reasoning-retrieval decoupling, and…

Artificial Intelligence · Computer Science 2026-05-28 Zihan Li , Xingyu Fan , Feifei Li , Wenhui Que

While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to the lack of availability of large-scale, open chatlogs. To…

Computation and Language · Computer Science 2018-02-01 Amrita Saha , Mitesh Khapra , Karthik Sankaranarayanan

Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill…

Computation and Language · Computer Science 2025-12-23 Guibin Zhang , Haotian Ren , Chong Zhan , Zhenhong Zhou , Junhao Wang , He Zhu , Wangchunshu Zhou , Shuicheng Yan