English
Related papers

Related papers: EgoMem: Lifelong Memory Agent for Full-duplex Omni…

200 papers

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

Long-horizon conversational agents have to manage ever-growing interaction histories that quickly exceed the finite context windows of large language models (LLMs). Existing memory frameworks provide limited support for temporally…

Computation and Language · Computer Science 2026-05-01 Kai Li , Xuanqing Yu , Ziyi Ni , Yi Zeng , Yao Xu , Zheqing Zhang , Xin Li , Jitao Sang , Xiaogang Duan , Xuelei Wang , Chengbao Liu , Jie Tan

Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a biologically inspired…

Neurons and Cognition · Quantitative Biology 2026-03-17 Yuru Song , Qi Xin

We present MGM-Omni, a unified Omni LLM for omni-modal understanding and expressive, long-horizon speech generation. Unlike cascaded pipelines that isolate speech synthesis, MGM-Omni adopts a "brain-mouth" design with a dual-track,…

Sound · Computer Science 2025-09-30 Chengyao Wang , Zhisheng Zhong , Bohao Peng , Senqiao Yang , Yuqi Liu , Haokun Gui , Bin Xia , Jingyao Li , Bei Yu , Jiaya Jia

Ultra long video understanding remains an open challenge, as existing vision language models (VLMs) falter on such content due to limited context length and inefficient long term memory retention. To address this, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hongbo Jin , Qingyuan Wang , Wenhao Zhang , Yang Liu , Sijie Cheng

Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs…

Computation and Language · Computer Science 2026-03-10 Muxin Fu , Xiangyuan Xue , Yafu Li , Zefeng He , Siyuan Huang , Xiaoye Qu , Yu Cheng , Yang Yang

Humans excel at performing complex tasks by leveraging long-term memory across temporal and spatial experiences. In contrast, current Large Language Models (LLMs) struggle to effectively plan and act in dynamic, multi-room 3D environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wenbo Hu , Yining Hong , Yanjun Wang , Leison Gao , Zibu Wei , Xingcheng Yao , Nanyun Peng , Yonatan Bitton , Idan Szpektor , Kai-Wei Chang

Research on large language models (LLMs) has shown remarkable performance in domains such as mathematics, programming, and literary creation. However, most studies have focused on semantic memory-based question answering, neglecting LLMs'…

Computation and Language · Computer Science 2025-02-25 WenTao Liu , Ruohua Zhang , Aimin Zhou , Feng Gao , JiaLi Liu

Recognizing emotional signals in speech has a significant impact on enhancing the effectiveness of human-computer interaction (HCI). This study introduces EmoAugNet, a hybrid deep learning framework, that incorporates Long Short-Term Memory…

Sound · Computer Science 2025-08-11 Durjoy Chandra Paul , Gaurob Saha , Md Amjad Hossain

Large language models (LLMs) excel at single-turn reasoning but often lose accuracy and coherence over extended, multi-turn interactions. Recent evaluations such as TurnBench highlight recurring failure modes-reasoning bias, task drift,…

Computation and Language · Computer Science 2025-12-17 Yiran Zhang , Jincheng Hu , Mark Dras , Usman Naseem

We present SpatialMem, a memory-centric system for long-horizon, language-grounded retrieval and QA from egocentric video, where metric 3D serves as an interpretable indexing scaffold rather than an explicit mapping objective. Starting from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyi Zheng , Yunze Liu , Chi-Hao Wu , Fan Zhang , Hao Zheng , Wenqi Zhou , Walterio W. Mayol-Cuevas , Junxiao Shen

Large language models (LLMs) have shown remarkable capabilities, but still struggle with processing extensive contexts, limiting their ability to maintain coherence and accuracy over long sequences. In contrast, the human brain excels at…

Long-term, open-domain dialogue capabilities are essential for chatbots aiming to recall past interactions and demonstrate emotional intelligence (EI). Yet, most existing research relies on synthetic, LLM-generated data, leaving open…

Computation and Language · Computer Science 2025-02-20 Dong-Ho Lee , Adyasha Maharana , Jay Pujara , Xiang Ren , Francesco Barbieri

Large language models (LLMs) have made significant progress in Emotional Intelligence (EI) and long-context modeling. However, existing benchmarks often overlook the fact that emotional information processing unfolds as a continuous…

Computation and Language · Computer Science 2026-01-13 Weichu Liu , Jing Xiong , Yuxuan Hu , Zixuan Li , Minghuan Tan , Ningning Mao , Hui Shen , Wendong Xu , Chaofan Tao , Min Yang , Chengming Li , Lingpeng Kong , Ngai Wong

Recent progress in multimodal large language models (MLLMs) has brought AI capabilities from static offline data processing to real-time streaming interaction, yet they still remain far from human-level multimodal interaction. The key…

In human imitation learning, the imitator typically take the egocentric view as a benchmark, naturally transferring behaviors observed from an exocentric view to their owns, which provides inspiration for researching how robots can more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Heqian Qiu , Zhaofeng Shi , Lanxiao Wang , Huiyu Xiong , Xiang Li , Hongliang Li

Large Language Models have revolutionized interactive applications; however, their finite context windows pose a critical data management challenge for maintaining stateful, long-term interactions. Existing memory approaches often rely on…

Artificial Intelligence · Computer Science 2026-05-29 Jiajie Fu , Junwen Chen , Mengzhao Wang , Aoxiang He , Maojia Sheng , Xiangyu Ke , Yifan Zhu , Yunjun Gao

Recent advancements in Large Language Models (LLMs) have significantly enhanced conversational agents, making them applicable to various fields (e.g., education, entertainment). Despite their progress, the evaluation of the agents often…

Computation and Language · Computer Science 2025-09-29 Jiho Kim , Woosog Chay , Hyeonji Hwang , Daeun Kyung , Hyunseung Chung , Eunbyeol Cho , Yeonsu Kwon , Yohan Jo , Edward Choi

Egocentric video reasoning centers on an unobservable agent behind the camera who dynamically shapes the environment, requiring inference of hidden intentions and recognition of fine-grained interactions. This core challenge limits current…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Baoqi Pei , Yifei Huang , Jilan Xu , Yuping He , Guo Chen , Fei Wu , Yu Qiao , Jiangmiao Pang

Driven by recent advances in vision-language models (VLMs) and egocentric perception research, the emerging topic of an egocentric procedural AI assistant (EgoProceAssist) is introduced to step-by-step support daily procedural tasks in a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Junlong Li , Huaiyuan Xu , Sijie Cheng , Kejun Wu , Kim-Hui Yap , Lap-Pui Chau , Yi Wang