English
Related papers

Related papers: Towards Unified Multi-Modal Personalization: Large…

200 papers

Despite recent progress in Multi-Modal Large Language Models (MLLMs), it remains challenging to integrate diverse tasks ranging from pixel-level perception to high-fidelity generation. Existing approaches often suffer from either restricted…

Computation and Language · Computer Science 2026-01-29 Bin Zhu , Munan Ning , Peng Jin , Bin Lin , Jinfa Huang , Qi Song , Junwu Zhang , Zhenyu Tang , Mingjun Pan , Li Yuan

The recent advancements in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively. Building upon this capability, we propose to enable…

Multimedia · Computer Science 2024-02-19 Yongqi Li , Wenjie Wang , Leigang Qu , Liqiang Nie , Wenjie Li , Tat-Seng Chua

Generative recommendation models often struggle with two key challenges: (1) the superficial integration of collaborative signals, and (2) the decoupled fusion of multimodal features. These limitations hinder the creation of a truly…

Information Retrieval · Computer Science 2025-12-29 Yuzhen Lin , Hongyi Chen , Xuanjing Chen , Shaowen Wang , Ivonne Xu , Dongming Jiang

With the rapid growth of fintech, personalized financial product recommendations have become increasingly important. Traditional methods like collaborative filtering or content-based models often fail to capture users' latent preferences…

Information Retrieval · Computer Science 2025-06-09 Yushang Zhao , Yike Peng , Dannier Li , Yuxin Yang , Chengrui Zhou , Jing Dong

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

In this paper, we propose UniLIP, a unified framework that adapts CLIP for multimodal understanding, generation and editing. Although CLIP excels at understanding, it lacks reconstruction abilities required to be a unified visual encoder.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Hao Tang , Chenwei Xie , Xiaoyi Bao , Tingyu Weng , Pandeng Li , Yun Zheng , Liwei Wang

Although Multimodal Large Language Models (MLLMs) have been widely applied across domains, they are still facing challenges in domain-specific tasks, such as User Interface (UI) understanding accuracy and UI generation quality. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hao Yang , Weijie Qiu , Ru Zhang , Zhou Fang , Ruichao Mao , Xiaoyu Lin , Maji Huang , Zhaosong Huang , Teng Guo , Shuoyang Liu , Hai Rao

Multimodal learning seeks to combine data from multiple input sources to enhance the performance of different downstream tasks. In real-world scenarios, performance can degrade substantially if some input modalities are missing. Existing…

Machine Learning · Computer Science 2024-10-10 Niki Nezakati , Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

In recent years, large language models (LLM) have emerged as powerful tools for diverse natural language processing tasks. However, their potential for recommender systems under the generative recommendation paradigm remains relatively…

Information Retrieval · Computer Science 2023-07-11 Jianchao Ji , Zelong Li , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Juntao Tan , Yongfeng Zhang

Recent advances in Large Language Models (LLMs) have demonstrated significant potential in the field of Recommendation Systems (RSs). Most existing studies have focused on converting user behavior logs into textual prompts and leveraging…

Information Retrieval · Computer Science 2025-01-14 Yuyang Ye , Zhi Zheng , Yishan Shen , Tianshu Wang , Hengruo Zhang , Peijun Zhu , Runlong Yu , Kai Zhang , Hui Xiong

Personalization today is fundamentally platform-centric: services build user representations from the behavioral fragments they observe. Yet no platform can construct a complete picture of the user, as competitive incentives, legal…

Visual personalization is essential in user-facing AI systems such as smart homes and healthcare, where aligning model behavior with user-centric concepts is critical. However, recent large Vision-Language Models (VLMs), despite their broad…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jaeik Kim , Woojin Kim , Woohyeon Park , Jaeyoung Do

In modern commercial systems, including Recommendation, Ranking, and E-Commerce platforms, there is a trend towards improving customer experiences by incorporating Personalization context as input into Large Language Models (LLMs). However,…

Computation and Language · Computer Science 2024-09-23 Jiarui Zhang

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

Computation and Language · Computer Science 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li

With the information explosion on the Web, search and recommendation are foundational infrastructures to satisfying users' information needs. As the two sides of the same coin, both revolve around the same core research problem, matching…

Information Retrieval · Computer Science 2024-04-29 Yongqi Li , Xinyu Lin , Wenjie Wang , Fuli Feng , Liang Pang , Wenjie Li , Liqiang Nie , Xiangnan He , Tat-Seng Chua

This paper addresses the challenge of jointly modeling user intent diversity and behavioral uncertainty in recommender systems. A unified representation learning framework is proposed. The framework builds a multi-intent representation…

Information Retrieval · Computer Science 2025-09-08 Wei Xu , Jiasen Zheng , Junjiang Lin , Mingxuan Han , Junliang Du

Existing MLLM benchmarks face significant challenges in evaluating Unified MLLMs (U-MLLMs) due to: 1) lack of standardized benchmarks for traditional tasks, leading to inconsistent comparisons; 2) absence of benchmarks for mixed-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Wulin Xie , Yi-Fan Zhang , Chaoyou Fu , Yang Shi , Bingyan Nie , Hongkai Chen , Zhang Zhang , Liang Wang , Tieniu Tan

Conducting supervised and preference fine-tuning of large language models (LLMs) requires high-quality datasets to improve their ability to follow instructions and align with human preferences and values. However, constructing such datasets…

Computation and Language · Computer Science 2026-02-24 Renren Jin , Tianhao Shen , Xinwei Wu , Dan Shi , Haoran Sun , Yuqi Ren , Wuwei Huang , Quandong Wang , Wei Liu , Jian Luan , Bin Wang , Deyi Xiong

Product designers often begin their design process with handcrafted personas. While personas are intended to ground design decisions in consumer preferences, they often fall short in practice by remaining abstract, expensive to produce, and…

Human-Computer Interaction · Computer Science 2026-02-09 Taewook Kim , Matthew K. Hong , Yan-Ying Chen , Jonathan Q. Li , Monica P Van , Shabnam Hakimi , Matthew Kay , Matthew Klenk