English
Related papers

Related papers: An item is worth one token in Multimodal Large Lan…

200 papers

Sequential Recommender Systems (SRSs) are a popular type of recommender system that learns from a user's history to predict the next item they are likely to interact with. However, user interactions can be affected by noise stemming from…

Information Retrieval · Computer Science 2024-04-18 Andrea Bacciu , Federico Siciliano , Nicola Tonellotto , Fabrizio Silvestri

Recently, there has been growing interest in developing the next-generation recommender systems (RSs) based on pretrained large language models (LLMs). However, the semantic gap between natural language and recommendation tasks is still not…

Information Retrieval · Computer Science 2024-02-23 Yaochen Zhu , Liang Wu , Qi Guo , Liangjie Hong , Jundong Li

Next-token prediction is the fundamental principle for training large language models (LLMs), and reinforcement learning (RL) further enhances their reasoning performance. As an effective way to model language, image, video, and other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Marc Pollefeys , Chang Wen Chen

Deriving governing equations from observational data, known as Symbolic Regression (SR), is a cornerstone of scientific discovery. Large Language Models, (LLMs) have shown promise in this task by leveraging their vast cross-disciplinary…

Computational Engineering, Finance, and Science · Computer Science 2025-10-01 Yingfan Hua , Ruikun Li , Jun Yao , Guohang Zhuang , Shixiang Tang , Bin Liu , Wanli Ouyang , Yan Lu

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

Large Language Models (LLMs) have emerged as a new paradigm for recommendation by converting interacted item history into language modeling. However, constrained by the limited context length of LLMs, existing approaches have to truncate…

Information Retrieval · Computer Science 2025-05-20 Jiayi Liao , Ruobing Xie , Sihang Li , Xiang Wang , Xingwu Sun , Zhanhui Kang , Xiangnan He

This paper examines how the sequencing of images and text within multi-modal prompts influences the reasoning performance of large language models (LLMs). We performed empirical evaluations using three commercial LLMs. Our results…

Artificial Intelligence · Computer Science 2024-10-07 Grant Wardle , Teo Susnjak

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Different from most conventional recommendation problems, sequential recommendation focuses on learning users' preferences by exploiting the internal order and dependency among the interacted items, which has received significant attention…

Information Retrieval · Computer Science 2025-03-14 Liwei Pan , Weike Pan , Meiyan Wei , Hongzhi Yin , Zhong Ming

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Audio-Visual Speech Recognition (AVSR) achieves robust speech recognition in noisy environments by combining auditory and visual information. However, recent Large Language Model (LLM) based AVSR systems incur high computational costs due…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Jeong Hun Yeo , Hyeongseop Rha , Se Jin Park , Yong Man Ro

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogue comprehension and…

Information Retrieval · Computer Science 2024-07-09 Yunjia Xi , Weiwen Liu , Jianghao Lin , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user through inner product computation between the user and all item…

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Large Language Models (LLMs) have emerged as promising recommendation systems, offering novel ways to model user preferences through generative approaches. However, many existing methods often rely solely on text semantics or incorporate…

Machine Learning · Computer Science 2026-01-09 Mir Rayat Imtiaz Hossain , Leo Feng , Leonid Sigal , Mohamed Osama Ahmed

Large language models have recently shown promise for multimodal recommendation, particularly with text and image inputs. Yet real-world recommendation signals extend far beyond these modalities. To reflect this, we formalize recommendation…

Information Retrieval · Computer Science 2026-05-01 Zijie Lei , Tao Feng , Zhigang Hua , Yan Xie , Guanyu Lin , Shuang Yang , Ge Liu , Jiaxuan You

The fashion industry is one of the leading domains in the global e-commerce sector, prompting major online retailers to employ recommendation systems for product suggestions and customer convenience. While recommendation systems have been…

Reward Models (RMs) are crucial to aligning large language models (LLMs), but the degree to which an RM specialized to one task (e.g. writing) generalizes to new tasks (e.g. math) is often not known a priori, often making using only one…

Computation and Language · Computer Science 2025-10-23 Duy Nguyen , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal