English
Related papers

Related papers: VRAgent-R1: Boosting Video Recommendation with MLL…

200 papers

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

Artificial Intelligence · Computer Science 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song

GUI agents powered by vision-language models (VLMs) show promise in automating complex digital tasks. However, their effectiveness in real-world applications is often limited by scarce training data and the inherent complexity of these…

Computation and Language · Computer Science 2025-09-30 Ran Xu , Kaixin Ma , Wenhao Yu , Hongming Zhang , Joyce C. Ho , Carl Yang , Dong Yu

User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user…

Information Retrieval · Computer Science 2024-12-24 Zijian Zhang , Shuchang Liu , Ziru Liu , Rui Zhong , Qingpeng Cai , Xiangyu Zhao , Chunxu Zhang , Qidong Liu , Peng Jiang

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the preferences of the…

Information Retrieval · Computer Science 2022-11-07 Xiong Junwu , Xiaoyun Feng , YunZhou Shi , James Zhang , Zhongzhou Zhao , Wei Zhou

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited by static perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ziang Yan , Xinhao Li , Yinan He , Zhengrong Yue , Xiangyu Zeng , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Personalization in social robotics is critical for fostering effective human-robot interactions, yet systems often face the cold start problem, where initial user preferences or characteristics are unavailable. This paper proposes a novel…

Human-Computer Interaction · Computer Science 2025-04-03 Hamed Rahimi , Jeanne Cattoni , Meriem Beghili , Mouad Abrini , Mahdi Khoramshahi , Maribel Pino , Mohamed Chetouani

Vision-Language Models (VLMs) often yield inconsistent descriptions of the same object across viewpoints, hindering the ability of embodied agents to construct consistent semantic representations over time. Previous methods resolved…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tommaso Galliena , Stefano Rosa , Tommaso Apicella , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Large Language Models (LLMs) have emerged as a promising paradigm for next-generation recommender systems, offering strong semantic understanding and natural-language reasoning abilities. Despite recent progress, current LLM-based…

Information Retrieval · Computer Science 2026-05-11 Shijun Li , Wooseong Yang , Yu Wang , Tianxin Wei , Joydeep Ghosh

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

The advancement in large language models (LLMs) and large vision models has fueled the rapid progress in multi-modal vision-language reasoning capabilities. However, existing vision-language models (VLMs) remain challenged by compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yichang Xu , Gaowen Liu , Ramana Rao Kompella , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Zachary Yahn , Ling Liu

Recommender systems have rapidly evolved and become integral to many online services. However, existing systems sometimes produce unstable and unsatisfactory recommendations that fail to align with users' fundamental and long-term…

Information Retrieval · Computer Science 2025-05-05 Lijian Chen , Wei Yuan , Tong Chen , Xiangyu Zhao , Nguyen Quoc Viet Hung , Hongzhi Yin

Preference-based reinforcement learning (RL) offers a promising approach for aligning policies with human intent but is often constrained by the high cost of human feedback. In this work, we introduce PrefVLM, a framework that integrates…

Machine Learning · Computer Science 2025-02-04 Udita Ghosh , Dripta S. Raychaudhuri , Jiachen Li , Konstantinos Karydis , Amit Roy-Chowdhury

Recommender selects and presents top-K items to the user at each online request, and a recommendation session consists of several sequential requests. Formulating a recommendation session as a Markov decision process and solving it by…

Information Retrieval · Computer Science 2024-05-06 Peilun Zhou , Xiaoxiao Xu , Lantao Hu , Han Li , Peng Jiang