English
Related papers

Related papers: EventMemAgent: Hierarchical Event-Centric Memory f…

200 papers

We present StreamBridge, a simple yet effective framework that seamlessly transforms offline Video-LLMs into streaming-capable models. It addresses two fundamental challenges in adapting existing models into online scenarios: (1) limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Haibo Wang , Bo Feng , Zhengfeng Lai , Mingze Xu , Shiyu Li , Weifeng Ge , Afshin Dehghan , Meng Cao , Ping Huang

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Current Large Language Models (LLMs) are not only limited to some maximum context length, but also are not able to robustly consume long inputs. To address these limitations, we propose ReadAgent, an LLM agent system that increases…

Computation and Language · Computer Science 2024-07-23 Kuang-Huei Lee , Xinyun Chen , Hiroki Furuta , John Canny , Ian Fischer

Owing to powerful natural language processing and generative capabilities, large language model (LLM) agents have emerged as a promising solution for enhancing recommendation systems via user simulation. However, in the realm of video…

Multimedia · Computer Science 2025-07-04 Siran Chen , Boyu Chen , Chenyun Yu , Yuxiao Luo , Ouyang Yi , Lei Cheng , Chengxiang Zhuo , Zang Li , Yali Wang

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Understanding continuous video streams plays a fundamental role in real-time applications including embodied AI and autonomous driving. Unlike offline video understanding, streaming video understanding requires the ability to process video…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yibin Yan , Jilan Xu , Shangzhe Di , Yikun Liu , Yudi Shi , Qirui Chen , Zeqian Li , Yifei Huang , Weidi Xie

Large reasoning models have demonstrated strong problem-solving abilities, yet real-world tasks often require external tools and long-horizon interactions. Existing agent frameworks typically follow predefined workflows, which limit…

Artificial Intelligence · Computer Science 2026-02-06 Xiaoxi Li , Wenxiang Jiao , Jiarui Jin , Guanting Dong , Jiajie Jin , Yinuo Wang , Hao Wang , Yutao Zhu , Ji-Rong Wen , Yuan Lu , Zhicheng Dou

Video Large Language Models (Video-LLMs) excel at understanding videos in-context, provided they have full access to the video when answering queries. However, these models face challenges in streaming scenarios where hour-long videos must…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Vaggelis Dorovatas , Soroush Seifi , Gunshi Gupta , Rahaf Aljundi

Multimodal Large Language Models (MLLMs) perform well in video understanding but degrade on long videos due to fixed-length context and weak long-term dependency modeling. Retrieval-Augmented Generation (RAG) can expand knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhucun Xue , Jiangning Zhang , Xurong Xie , Yuxuan Cai , Yong Liu , Xiangtai Li , Dacheng Tao

Video Corpus Moment Retrieval (VCMR) is a practical video retrieval task focused on identifying a specific moment within a vast corpus of untrimmed videos using the natural language query. Existing methods for VCMR typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Danyang Hou , Liang Pang , Huawei Shen , Xueqi Cheng

Large Language Models (LLMs) have demonstrated remarkable capabilities in orchestrating tools for reasoning tasks. However, existing methods rely on a step-wise paradigm that lacks a global perspective, which causes error accumulation over…

Artificial Intelligence · Computer Science 2026-05-11 Tairan Huang , Siyu Shang , Qiang Chen , Xiu Su , Yi Chen

Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to store, update, and retrieve information over time. This ability…

Computation and Language · Computer Science 2026-05-19 Yuyao Wang , Zhongjian Zhang , Mo Chi , Kaichi Yu , Yuhan Li , Miao Peng , Bing Tong , Chen Zhang , Yan Zhou , Jia Li

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant improvement in offline video understanding. However, extending these capabilities to streaming video inputs, remains challenging, as existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Haowei Zhang , Shudong Yang , Jinlan Fu , See-Kiong Ng , Xipeng Qiu

Automated code documentation is essential for modern software development, providing the contextual grounding that both human developers and coding agents rely on to navigate large codebases. Existing repository-level approaches process…

Software Engineering · Computer Science 2026-05-15 Suyoung Bae , Jaehoon Lee , Changkyu Choi , YunSeok Choi , Jee-Hyong Lee

While existing video benchmarks largely consider specialized downstream tasks like retrieval or question-answering (QA), contemporary multimodal AI systems must be capable of well-rounded common-sense reasoning akin to human visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Kate Sanders , Benjamin Van Durme

The rapid advancement of large language models (LLMs) and artificial intelligence-generated content (AIGC) has accelerated AI-native applications, such as AI-based storybooks that automate engaging story production for children. However,…

Computation and Language · Computer Science 2025-03-10 Xuenan Xu , Jiahao Mei , Chenliang Li , Yuning Wu , Ming Yan , Shaopeng Lai , Ji Zhang , Mengyue Wu

Humans excel at remembering concrete experiences along spatiotemporal contexts and performing reasoning across those events, i.e., the capacity for episodic memory. In contrast, memory in language agents remains mainly semantic, and current…

Artificial Intelligence · Computer Science 2026-03-03 Yiheng Shu , Saisri Padmaja Jonnalagedda , Xiang Gao , Bernal Jiménez Gutiérrez , Weijian Qi , Kamalika Das , Huan Sun , Yu Su

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a…

Machine Learning · Computer Science 2025-03-07 Adarsh Kumarappan , Mo Tiwari , Peiyang Song , Robert Joseph George , Chaowei Xiao , Anima Anandkumar

Creating AI systems that can interact with environments over long periods, similar to human cognition, has been a longstanding research goal. Recent advancements in multimodal large language models (MLLMs) have made significant strides in…