English
Related papers

Related papers: Multimodal Point-of-Interest Recommendation

200 papers

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Large-language Models (LLMs) have been extremely successful at tasks like complex dialogue understanding, reasoning and coding due to their emergent abilities. These emergent abilities have been extended with multi-modality to include…

Information Retrieval · Computer Science 2025-05-19 Li Yang , Anushya Subbiah , Hardik Patel , Judith Yue Li , Yanwei Song , Reza Mirghaderi , Vikram Aggarwal , Qifan Wang

User intention which often changes dynamically is considered to be an important factor for modeling users in the design of recommendation systems. Recent studies are starting to focus on predicting user intention (what users want) beyond…

Information Retrieval · Computer Science 2021-07-19 Arpita Chaudhuri , Debasis Samanta , Monalisa Sarma

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach,…

Kuaishou serving hundreds of millions of searches daily, the quality of short-video search is paramount. However, it suffers from a severe Matthew effect on long-tail queries: sparse user behavior data causes models to amplify low-quality…

Information Retrieval · Computer Science 2026-03-31 Wenyi Xu , Feiran Zhu , Songyang Li , Renzhe Zhou , Chao Zhang , Chenglei Dai , Yuren Mao , Yunjun Gao , Yi Zhang

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

This work proposes a novel and simple sequential learning strategy to train models on videos and texts for multimodal sentiment analysis. To estimate sentiment polarities on unseen out-of-distribution data, we introduce a multimodal model…

Machine Learning · Computer Science 2024-09-10 Xianbing Zhao , Lizhen Qu , Tao Feng , Jianfei Cai , Buzhou Tang

State-of-the-art rule-based and classification-based food recommendation systems face significant challenges in becoming practical and useful. This difficulty arises primarily because most machine learning models struggle with problems…

Artificial Intelligence · Computer Science 2024-02-15 Ali Rostami , Ramesh Jain , Amir M. Rahmani

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Narrative-driven recommendation (NDR) presents an information access problem where users solicit recommendations with verbose descriptions of their preferences and context, for example, travelers soliciting recommendations for points of…

Information Retrieval · Computer Science 2023-07-24 Sheshera Mysore , Andrew McCallum , Hamed Zamani

The next Point-of-Interest (POI) recommendation task aims to predict users' next destinations based on their historical movement data and plays a key role in location-based services and personalized applications. Accurate next POI…

Information Retrieval · Computer Science 2025-05-21 Zhao Liu , Wei Liu , Huajie Zhu , Jianxing Yu , Jian Yin , Wang-Chien Lee , Shun Wang

Preference-conditioned image generation seeks to adapt generative models to individual users, producing outputs that reflect personal aesthetic choices beyond the given textual prompt. Despite recent progress, existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenyi Mo , Tianyu Zhang , Yalong Bai , Ligong Han , Ying Ba , Dimitris N. Metaxas

Sequential Recommender Systems (SRS) aim to predict users' next interaction based on their historical behaviors, while still facing the challenge of data sparsity. With the rapid advancement of Multimodal Large Language Models (MLLMs),…

Information Retrieval · Computer Science 2026-02-17 Mingyao Huang , Qidong Liu , Wenxuan Yang , Moranxin Wang , Yuqi Sun , Haiping Zhu , Feng Tian , Yan Chen

The goal of personalized history-based recommendation is to automatically output a distribution over all the items given a sequence of previous purchases of a user. In this work, we present a novel approach that uses a recurrent network for…

Machine Learning · Computer Science 2017-09-25 Tian Wang , Kyunghyun Cho

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

Human-Computer Interaction · Computer Science 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

The effectiveness of large language models (LLMs) in conversational AI is hindered by their reliance on single-turn supervised fine-tuning (SFT) data, which limits contextual coherence in multi-turn dialogues. Existing methods for…

Computation and Language · Computer Science 2025-07-08 Jiangxu Wu , Cong Wang , TianHuang Su , Jun Yang , Haozhi Lin , Chao Zhang , Ming Peng , Kai Shi , SongPan Yang , BinQing Pan , ZiXian Li , Ni Yang , ZhenYu Yang