English
Related papers

Related papers: MindMem: Multimodal for Predicting Advertisement M…

200 papers

Memes are a powerful tool for communication over social media. Their affinity for evolving across politics, history, and sociocultural phenomena makes them an ideal communication vehicle. To comprehend the subtle message conveyed within a…

Computation and Language · Computer Science 2023-05-30 Shivam Sharma , Ramaneswaran S , Udit Arora , Md. Shad Akhtar , Tanmoy Chakraborty

Effective memory management is essential for large language model agents to navigate long-horizon tasks. Recent research has explored using Reinforcement Learning to develop specialized memory manager agents. However, existing approaches…

Computation and Language · Computer Science 2026-01-14 Weitao Ma , Xiaocheng Feng , Lei Huang , Xiachong Feng , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Bing Qin

Understanding social interaction in video requires reasoning over a dynamic interplay of verbal and non-verbal cues: who is speaking, to whom, and with what gaze or gestures. While Multimodal Large Language Models (MLLMs) are natural…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Liangyang Ouyang , Yifei Huang , Mingfang Zhang , Caixin Kang , Ryosuke Furuta , Yoichi Sato

LLM agents that operate over long context depend on external memory to accumulate knowledge over time. However, existing methods typically store each observation as a single deterministic conclusion (e.g., inferring "API~X failed" from…

Artificial Intelligence · Computer Science 2026-05-11 Junfeng Liao , Qizhou Wang , Jianing Zhu , Bo Du , Rui Yan , Xiuying Chen

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…

Artificial Intelligence · Computer Science 2026-01-09 Muzhao Tian , Zisu Huang , Xiaohua Wang , Jingwen Xu , Zhengkang Guo , Qi Qian , Yuanzhe Shen , Kaitao Song , Jiakang Yuan , Changze Lv , Xiaoqing Zheng

Ultra long video understanding remains an open challenge, as existing vision language models (VLMs) falter on such content due to limited context length and inefficient long term memory retention. To address this, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hongbo Jin , Qingyuan Wang , Wenhao Zhang , Yang Liu , Sijie Cheng

We present SegLLM, a novel multi-round interactive reasoning segmentation model that enhances LLM-based segmentation by exploiting conversational memory of both visual and textual outputs. By leveraging a mask-aware multimodal LLM, SegLLM…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 XuDong Wang , Shaolun Zhang , Shufan Li , Konstantinos Kallidromitis , Kehan Li , Yusuke Kato , Kazuki Kozuka , Trevor Darrell

As short videos have become the primary form of content consumption across various industries, accurately predicting their popularity has become key to enhancing user engagement and optimizing business strategies. This report presents a…

Multimedia · Computer Science 2025-02-25 Jiacheng Lu , Mingyuan Xiao , Weijian Wang , Yuxin Du , Zhengze Wu , Cheng Hua

In today's assistant landscape, personalisation enhances interactions, fosters long-term relationships, and deepens engagement. However, many systems struggle with retaining user preferences, leading to repetitive user requests and…

Artificial Intelligence · Computer Science 2025-01-17 Johannes Kirmayr , Lukas Stappen , Phillip Schneider , Florian Matthes , Elisabeth André

Equipping agents with memory is essential for solving real-world long-horizon problems. However, most existing agent memory mechanisms rely on static and hand-crafted workflows. This limits the performance and generalization ability of…

Artificial Intelligence · Computer Science 2026-03-30 Yupeng Huo , Yaxi Lu , Zhong Zhang , Haotian Chen , Yankai Lin

While multimodal fusion has been extensively studied in Multimodal Sentiment Analysis (MSA), the role of fusion depth and multimodal capacity allocation remains underexplored. In this work, we position fusion depth, scalability, and…

Computation and Language · Computer Science 2025-04-16 Efthymios Georgiou , Vassilis Katsouros , Yannis Avrithis , Alexandros Potamianos

The future of digital marketing lies in the convergence of human creativity and generative AI, where insight, strategy, and storytelling are co-authored by intelligent systems. We present MindFuse, a brave new explainable generative AI…

Multimedia · Computer Science 2025-12-05 Aleksandr Farseev , Marlo Ongpin , Qi Yang , Ilia Gossoudarev , Yu-Yi Chu-Farseeva , Sergey Nikolenko

Personalization is one of the next milestones in advancing AI capability and alignment. We introduce PersonaMem-v2, the state-of-the-art dataset for LLM personalization that simulates 1,000 realistic user-chatbot interactions on 300+…

Search algorithms and user query relevance have given LLMs the ability to return relevant information, but the effect of content phrasing on ad visibility remains underexplored. We investigate how LLM-based rewriting of advertisements can…

Computation and Language · Computer Science 2025-07-30 Chloe Ho , Ishneet Sukhvinder Singh , Diya Sharma , Tanvi Reddy Anumandla , Michael Lu , Vasu Sharma , Kevin Zhu

Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various modalities for a given query. But their practical application is often hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qi Li , Yanzhe Zhao , Yongxin Zhou , Yameng Wang , Yandong Yang , Yuanjia Zhou , Jue Wang , Zuojian Wang , Jinxiang Liu

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

In recent years, online lecture videos have become an increasingly popular resource for acquiring new knowledge. Systems capable of effectively understanding/indexing lecture videos are thus highly desirable, enabling downstream tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Kangda Wei , Zhengyu Zhou , Bingqing Wang , Jun Araki , Lukas Lange , Ruihong Huang , Zhe Feng

Personalization is a core capability across consumer technologies, streaming, shopping, wearables, and voice, yet it remains challenged by sparse interactions, fast content churn, and heterogeneous textual signals. We present RecMind, an…

Machine Learning · Computer Science 2025-09-09 Chang Xue , Youwei Lu , Chen Yang , Jinming Xing

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

Artificial Intelligence · Computer Science 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

Large language models (LLMs) enable a new form of advertising for retrieval-augmented generation (RAG) systems in which organic responses are blended with contextually relevant ads. The prospect of such "generated native ads" has sparked…

Information Retrieval · Computer Science 2026-04-10 Sebastian Heineking , Wilhelm Pertsch , Ines Zelch , Janek Bevendorff , Benno Stein , Matthias Hagen , Martin Potthast