English
Related papers

Related papers: Evaluating Memory Capability in Continuous Lifelog…

200 papers

Real-time understanding of long video streams remains challenging for multimodal large language models (VLMs) due to redundant frame processing and rapid forgetting of past context. Existing streaming systems rely on fixed-interval decoding…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zhenghui Guo , Yuanbin Man , Junyuan Sheng , Bowen Lin , Ahmed Ahmed , Bo Jiang , Boyuan Zhang , Miao Yin , Sian Jin , Omprakash Gnawal , Chengming Zhang

Reasoning about time is of fundamental importance. Many facts are time-dependent. For example, athletes change teams from time to time, and different government officials are elected periodically. Previous time-dependent question answering…

Computation and Language · Computer Science 2023-06-28 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Large language models (LLMs) have made significant progress in Emotional Intelligence (EI) and long-context modeling. However, existing benchmarks often overlook the fact that emotional information processing unfolds as a continuous…

Computation and Language · Computer Science 2026-01-13 Weichu Liu , Jing Xiong , Yuxuan Hu , Zixuan Li , Minghuan Tan , Ningning Mao , Hui Shen , Wendong Xu , Chaofan Tao , Min Yang , Chengming Li , Lingpeng Kong , Ngai Wong

Advances in large language models are making personalized AI agents a new research focus. While current agent systems primarily rely on personalized external memory databases to deliver customized experiences, they face challenges such as…

Computation and Language · Computer Science 2025-11-03 Junfeng Lu , Yueyan Li

Temporal reasoning in multi-session dialogues presents a significant challenge which has been under-studied in previous temporal reasoning benchmarks. To bridge this gap, we propose a new evaluation task for temporal reasoning in…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Raphael Shu , Monica Sunkara , Yassine Benajiba , Yi Zhang

Multimodal Large Language Models excel at offline audio-visual understanding, but their ability to serve as mobile assistants in continuous real-world streams remains underexplored. In daily phone use, mobile assistants must track streaming…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xudong Lu , Huankang Guan , Yang Bo , Jinpeng Chen , Xintong Guo , Shuhan Li , Fang Liu , Peiwen Sun , Xueying Li , Wei Zhang , Xue Yang , Rui Liu , Hongsheng Li

Extending LLM context windows is hindered by scarce high-quality long-context data. Recent methods synthesize data with genuine long-range dependencies via information-theoretic verification, selecting contexts that reduce a base model's…

Machine Learning · Computer Science 2026-04-10 Junlong Jia , Ziyang Chen , Xing Wu , Chaochen Gao , TingHao Yu , Feng Zhang , Songlin Hu

Large language models (LLMs) perform well on step-by-step reasoning benchmarks such as mathematics and code generation, yet their ability to carry out robust long-horizon planning under realistic constraints remains insufficiently…

Artificial Intelligence · Computer Science 2026-04-21 Petr Anokhin , Roman Khalikov , Stefan Rebrikov , Viktor Volkov , Artyom Sorokin , Vincent Bissonnette

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…

Large language models often suffer from fact loss, timeline confusion, persona drift, and reduced stability during long-range interaction, especially under high-noise knowledge bases, context clearing, and cross-model transfer. To address…

Artificial Intelligence · Computer Science 2026-05-15 Zhao Yang , Wang Huan , Li Yingshuo , Tu Haomiao , Lin Hujite

Continual Learning (CL) on time series data represents a promising but under-studied avenue for real-world applications. We propose two new CL benchmarks for Human State Monitoring. We carefully designed the benchmarks to mirror real-world…

Machine Learning · Computer Science 2022-07-12 Federico Matteoni , Andrea Cossu , Claudio Gallicchio , Vincenzo Lomonaco , Davide Bacciu

In real-world scenarios, providing user queries with visually enhanced responses can considerably benefit understanding and memory, underscoring the great value of interleaved image-text generation. Despite recent progress, like the visual…

Information Retrieval · Computer Science 2025-12-08 Rongyang Zhang , Yuqing Huang , Chengqiang Lu , Qimeng Wang , Yan Gao , Yi Wu , Yao Hu , Yin Xu , Wei Wang , Hao Wang , Enhong Chen

We investigate the feasibility of using Multimodal Large Language Models (MLLMs) for real-time online episodic memory question answering. While cloud offloading is common, it raises privacy and latency concerns for wearable assistants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Giuseppe Lando , Rosario Forte , Antonino Furnari

Large language models deployed as autonomous agents face critical memory limitations, lacking selective forgetting mechanisms that lead to either catastrophic forgetting at context boundaries or information overload within them. While human…

Artificial Intelligence · Computer Science 2026-02-09 Lei Wei , Xiao Peng , Xu Dong , Niantao Xie , Bin Wang

Recommender models are hard to evaluate, particularly under offline setting. In this paper, we provide a comprehensive and critical analysis of the data leakage issue in recommender system offline evaluation. Data leakage is caused by not…

Information Retrieval · Computer Science 2023-08-07 Yitong Ji , Aixin Sun , Jie Zhang , Chenliang Li

The increasing autonomy of Large Language Models (LLMs) necessitates a rigorous evaluation of their potential to aid in cyber offense. Existing benchmarks often lack real-world complexity and are thus unable to accurately assess LLMs'…

Cryptography and Security · Computer Science 2025-10-14 Zicheng Liu , Lige Huang , Jie Zhang , Dongrui Liu , Yuan Tian , Jing Shao

AI assistants that interact with users over time need to interpret the user's current emotional state in order to respond appropriately and personally. However, this capability remains insufficiently evaluated. Existing emotion datasets…

Artificial Intelligence · Computer Science 2026-04-09 Deliang Wen , Ke Sun , Yu Wang

Benefiting from the advancements in large language models and cross-modal alignment, existing multi-modal video understanding methods have achieved prominent performance in offline scenario. However, online video streams, as one of the most…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Haoji Zhang , Yiqin Wang , Yansong Tang , Yong Liu , Jiashi Feng , Jifeng Dai , Xiaojie Jin

Existing agent memory systems universally follow what we term a Memory-as-Tool paradigm where a single query triggers one-shot retrieval of flat passage lists, suffering from passive invocation, reasoning-retrieval decoupling, and…

Artificial Intelligence · Computer Science 2026-05-28 Zihan Li , Xingyu Fan , Feifei Li , Wenhui Que

Since individuals may struggle to recall all life details and often confuse events, establishing a system to assist users in recalling forgotten experiences is essential. While numerous studies have proposed memory recall systems, these…

Computation and Language · Computer Science 2026-02-26 Chia Cheng Chang , An-Zi Yen , Hen-Hsen Huang , Hsin-Hsi Chen