English
Related papers

Related papers: PersonaVLM: Long-Term Personalized Multimodal LLMs

200 papers

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches…

Information Retrieval · Computer Science 2024-12-10 Minglai Shao , Hua Huang , Qiyao Peng , Hongtao Liu

Large language model (LLM) agents increasingly rely on external memory to support long-horizon interaction, personalized assistance, and multi-step reasoning. However, existing memory systems still face three core challenges: they often…

Computation and Language · Computer Science 2026-04-30 Shannan Yan , Jingchen Ni , Leqi Zheng , Jiajun Zhang , Peixi Wu , Dacheng Yin , Jing Lyu , Chun Yuan , Fengyun Rao

Unified large multimodal models (LMMs) have achieved remarkable progress in general-purpose multimodal understanding and generation. However, they still operate under a ``one-size-fits-all'' paradigm and struggle to model user-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yu Zhong , Tianwei Lin , Ruike Zhu , Yuqian Yuan , Haoyu Zheng , Liang Liang , Wenqiao Zhang , Feifei Shao , Haoyuan Li , Wanggui He , Hao Jiang , Yueting Zhuang

Large language models (LLMs) have recently demonstrated remarkable advancements in embodying diverse personas, enhancing their effectiveness as conversational agents and virtual assistants. Consequently, LLMs have made significant strides…

Computation and Language · Computer Science 2025-03-03 Julius Broomfield , Kartik Sharma , Srijan Kumar

While closed-source Large Language Models (LLMs) demonstrate strong mathematical problem-solving abilities, open-source models still face challenges with such tasks. To bridge this gap, we propose a data augmentation approach and introduce…

Large language models are increasingly deployed in multi-turn settings such as tutoring, support, and counseling, where reliability depends on preserving consistent roles, personas, and goals across long horizons. This requirement becomes…

Computation and Language · Computer Science 2026-04-13 Han Luo , Guy Laban

Large language model (LLM) agents have evolved to intelligently process information, make decisions, and interact with users or tools. A key capability is the integration of long-term memory capabilities, enabling these agents to draw upon…

Computation and Language · Computer Science 2025-08-04 Rana Salama , Jason Cai , Michelle Yuan , Anna Currey , Monica Sunkara , Yi Zhang , Yassine Benajiba

We present SalesSim, a framework and testbed for evaluating the ability of Multimodal Large Language Models (MLLMs) to simulate realistic, persona-driven customer behavior in multi-turn, multi-modal, tool-augmented online retail…

Computation and Language · Computer Science 2026-05-12 Yada Pruksachatkun , Elaine Wan , Lyanna Chen , Kai-Wei Chang , Chien-Sheng Wu

Recent advances in Large Language Models (LLMs) have demonstrated significant potential in the field of Recommendation Systems (RSs). Most existing studies have focused on converting user behavior logs into textual prompts and leveraging…

Information Retrieval · Computer Science 2025-01-14 Yuyang Ye , Zhi Zheng , Yishan Shen , Tianshu Wang , Hengruo Zhang , Peijun Zhu , Runlong Yu , Kai Zhang , Hui Xiong

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Machine learning (ML) models have significantly impacted various domains in our everyday lives. While large language models (LLMs) offer intuitive interfaces and versatility, task-specific ML models remain valuable for their efficiency and…

Human-Computer Interaction · Computer Science 2024-12-04 Wataru Kawabe , Yusuke Sugano

While large language models (LLMs) have proven effective in leveraging textual data for recommendations, their application to multimodal recommendation tasks remains relatively underexplored. Although LLMs can process multimodal information…

Information Retrieval · Computer Science 2025-04-23 Chen Zhang , Bo Hu , Weidong Chen , Zhendong Mao

In this study, we propose a novel human-like memory architecture designed for enhancing the cognitive abilities of large language model based dialogue agents. Our proposed architecture enables agents to autonomously recall memories…

Human-Computer Interaction · Computer Science 2024-04-02 Yuki Hou , Haruki Tamoto , Homei Miyashita

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

In recent years, large language models have demonstrated remarkable capabilities in natural language understanding and generation. However, these models often struggle with hallucinations and maintaining long term contextual relevance,…

Multiagent Systems · Computer Science 2024-10-15 Sumedh Rasal

This paper introduces PersonaAI, a cutting-edge application that leverages Retrieval-Augmented Generation (RAG) and the LLAMA model to create highly personalized digital avatars capable of accurately mimicking individual personalities.…

Human-Computer Interaction · Computer Science 2025-03-21 Elvis Kimara , Kunle S. Oguntoye , Jian Sun

Personalized large language models (LLMs) rely on memory retrieval to incorporate user-specific histories, preferences, and contexts. Existing approaches either overload the LLM by feeding all the user's past memory into the prompt, which…

Information Retrieval · Computer Science 2026-03-11 Yingyi Zhang , Junyi Li , Wenlin Zhang , Penyue Jia , Xianneng Li , Yichao Wang , Derong Xu , Yi Wen , Huifeng Guo , Yong Liu , Xiangyu Zhao

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

Computation and Language · Computer Science 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li