English
Related papers

Related papers: Multimodal Point-of-Interest Recommendation

200 papers

The integration of multimodal information into sequential recommender systems has attracted significant attention in recent research. In the initial stages of multimodal sequential recommendation models, the mainstream paradigm was…

Information Retrieval · Computer Science 2024-03-06 Jiaxi Hu , Jingtong Gao , Xiangyu Zhao , Yuehong Hu , Yuxuan Liang , Yiqi Wang , Ming He , Zitao Liu , Hongzhi Yin

Current conversational recommendation systems focus predominantly on text. However, real-world recommendation settings are generally multimodal, causing a significant gap between existing research and practical applications. To address this…

Multimedia · Computer Science 2025-04-16 Zihan Wang , Xiaocui Yang , Yongkang Liu , Shi Feng , Daling Wang , Yifei Zhang

In recommender systems, large language models (LLMs) have gained popularity for generating descriptive summarization to improve recommendation robustness, along with Graph Convolution Networks. However, existing LLM-enhanced recommendation…

Information Retrieval · Computer Science 2026-03-18 Moonsoo Park , Seulbeen Je , Donghyeon Park

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

The recent advancements in auto-regressive multimodal large language models (MLLMs) have demonstrated promising progress for vision-language tasks. While there exists a variety of studies investigating the processing of linguistic…

Artificial Intelligence · Computer Science 2025-03-28 Zhi Zhang , Srishti Yadav , Fengze Han , Ekaterina Shutova

In this paper, we present empirical studies on conversational recommendation tasks using representative large language models in a zero-shot setting with three primary contributions. (1) Data: To gain insights into model behavior in…

Information Retrieval · Computer Science 2023-08-22 Zhankui He , Zhouhang Xie , Rahul Jha , Harald Steck , Dawen Liang , Yesu Feng , Bodhisattwa Prasad Majumder , Nathan Kallus , Julian McAuley

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing…

Information Retrieval · Computer Science 2024-10-22 Bingjie Huang , Qingyi Lu , Shuaishuai Huang , Xue-she Wang , Haowei Yang

This is a research exploring existing models and fine tuning them to combine a YOLOv8 segmentation model, a LSTM model trained on hand point motion sequence and a ASR (whisper-base) to extract enough data for a LLM (TinyLLaMa) to predict…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Tahoshin Alam Ishat , Mohammad Abdul Qayum

Existing sequential recommendation models, even advanced diffusion-based approaches, often struggle to capture the rich semantic intent underlying user behavior, especially for new users or long-tail items. This limitation stems from their…

Information Retrieval · Computer Science 2026-01-08 Bo-Chian Chen , Manel Slokom

Recent advances in multimodal large language models (MLLMs) have demonstrated strong capabilities in understanding general visual content. However, these general-domain MLLMs perform poorly in face perception tasks, often producing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jingzhi Li , Changjiang Luo , Ruoyu Chen , Hua Zhang , Wenqi Ren , Jianhou Gan , Xiaochun Cao

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

Recommender systems are indispensable in the realm of online applications, and sequential recommendation has enjoyed considerable prevalence due to its capacity to encapsulate the dynamic shifts in user interests. However, previous…

Information Retrieval · Computer Science 2024-04-16 Junzhe Jiang , Shang Qu , Mingyue Cheng , Qi Liu , Zhiding Liu , Hao Zhang , Rujiao Zhang , Kai Zhang , Rui Li , Jiatong Li , Min Gao

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Many multimodal recommender systems have been proposed to exploit the rich side information associated with users or items (e.g., user reviews and item images) for learning better user and item representations to improve the recommendation…

Information Retrieval · Computer Science 2022-10-26 Fan Liu , Huilin Chen , Zhiyong Cheng , Anan Liu , Liqiang Nie , Mohan Kankanhalli

The growth of recommender systems (RecSys) is driven by digitization and the need for personalized content in areas such as e-commerce and video streaming. The content in these systems often changes rapidly and therefore they constantly…

Information Retrieval · Computer Science 2024-11-15 Shiyu Wang , Hao Ding , Yupeng Gu , Sergul Aydore , Kousha Kalantari , Branislav Kveton

Recommendation system (RS) plays significant roles in matching users information needs for Internet applications, and it usually utilizes the vanilla neural network as the backbone to handle embedding details. Recently, the large language…

Information Retrieval · Computer Science 2023-10-26 Dui Wang , Xiangyu Hou , Xiaohui Yang , Bo Zhang , Renbing Chen , Daiyue Xue

Most existing recommender systems represent a user's preference with a feature vector, which is assumed to be fixed when predicting this user's preferences for different items. However, the same vector cannot accurately capture a user's…

Information Retrieval · Computer Science 2019-08-22 Fan Liu , Zhiyong Cheng , Changchang Sun , Yinglong Wang , Liqiang Nie , Mohan Kankanhalli

Traditional recommender systems leverage users' item preference history to recommend novel content that users may like. However, modern dialog interfaces that allow users to express language-based preferences offer a fundamentally different…

Information Retrieval · Computer Science 2023-07-27 Scott Sanner , Krisztian Balog , Filip Radlinski , Ben Wedin , Lucas Dixon

In the realm of vision-language understanding, the proficiency of models in interpreting and reasoning over visual content has become a cornerstone for numerous applications. However, it is challenging for the visual encoder in Large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zuyan Liu , Yuhao Dong , Yongming Rao , Jie Zhou , Jiwen Lu

The goal of sequential recommendation (SR) is to predict a user's potential interested items based on her/his historical interaction sequences. Most existing sequential recommenders are developed based on ID features, which, despite their…

Information Retrieval · Computer Science 2023-10-24 Jinpeng Wang , Ziyun Zeng , Yunxiao Wang , Yuting Wang , Xingyu Lu , Tianxiang Li , Jun Yuan , Rui Zhang , Hai-Tao Zheng , Shu-Tao Xia