English
Related papers

Related papers: An item is worth one token in Multimodal Large Lan…

200 papers

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Leveraging Large Language Models (LLMs) for generative recommendation has attracted significant research interest, where item tokenization is a critical step. It involves assigning item identifiers for LLMs to encode user history and…

Information Retrieval · Computer Science 2025-05-27 Xinyu Lin , Haihan Shi , Wenjie Wang , Fuli Feng , Qifan Wang , See-Kiong Ng , Tat-Seng Chua

Masked language modeling (MLM) is one of the key sub-tasks in vision-language pretraining. In the cross-modal setting, tokens in the sentence are masked at random, and the model predicts the masked tokens given the image and the text. In…

Computation and Language · Computer Science 2021-09-07 Yonatan Bitton , Gabriel Stanovsky , Michael Elhadad , Roy Schwartz

The increase in parameter size of multimodal large language models (MLLMs) introduces significant capabilities, particularly in-context learning, where MLLMs enhance task performance without updating pre-trained parameters. This…

Computation and Language · Computer Science 2024-11-13 Yang Luo , Zangwei Zheng , Zirui Zhu , Yang You

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and,…

Information Retrieval · Computer Science 2024-08-27 Yaoyiran Li , Xiang Zhai , Moustafa Alzantot , Keyi Yu , Ivan Vulić , Anna Korhonen , Mohamed Hammad

The modern recommender systems are facing an increasing challenge of modelling and predicting the dynamic and context-rich user preferences. Traditional collaborative filtering and content-based methods often struggle to capture the…

Information Retrieval · Computer Science 2025-07-21 Yitong Li , Raoul Grasman

Session-based recommendation (SR) has become an important and popular component of various e-commerce platforms, which aims to predict the next interacted item based on a given session. Most of existing SR models only focus on exploiting…

Information Retrieval · Computer Science 2020-06-19 Wenjing Meng , Deqing Yang , Yanghua Xiao

Harnessing the reasoning power of Large Language Models (LLMs) for recommender systems is hindered by two fundamental challenges. First, current approaches lack a mechanism for automated, data-driven discovery of effective reasoning…

Information Retrieval · Computer Science 2026-02-26 Jie Jiang , Yang Wu , Qian Li , Yuling Xiong , Hongbo Tang , Xun Liu , Haoze Wang , Jun Zhang , Huan Yu , Hailong Shi

Large language models (LLMs) are reshaping the recommender system paradigm by enabling users to express preferences and receive recommendations through conversations. Yet, aligning LLMs to the recommendation task remains challenging:…

Information Retrieval · Computer Science 2026-02-17 Yaochen Zhu , Harald Steck , Dawen Liang , Yinhan He , Vito Ostuni , Jundong Li , Nathan Kallus

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

While Large Language Models (LLMs) excel at reasoning on text and Vision-Language Models (VLMs) are highly effective for visual perception, applying those models for visual instruction-based planning remains a widely open problem. In this…

Machine Learning · Computer Science 2025-09-11 Mohamed Salim Aissi , Clemence Grislain , Mohamed Chetouani , Olivier Sigaud , Laure Soulier , Nicolas Thome

Effectively modeling the dynamic nature of user preferences is crucial for enhancing recommendation accuracy and fostering transparency in recommender systems. Traditional user profiling often overlooks the distinction between transitory…

Information Retrieval · Computer Science 2025-11-04 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

In recent years, Recommender Systems (RS) have witnessed a transformative shift with the advent of Large Language Models (LLMs) in the field of Natural Language Processing (NLP). Models such as GPT-3.5/4, Llama, have demonstrated…

Information Retrieval · Computer Science 2024-10-02 Junyi Chen , Toyotaro Suzumura

Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual inputs, including high-resolution images and long video sequences. As these models scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junwan Kim , Hyunkyung Bae

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data…

Information Retrieval · Computer Science 2025-07-15 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

Recent advances in path-based explainable recommendation systems have attracted increasing attention thanks to the rich information provided by knowledge graphs. Most existing explainable recommendations only utilize static knowledge graphs…

Information Retrieval · Computer Science 2021-11-25 Yicong Li , Hongxu Chen , Yile Li , Lin Li , Philip S. Yu , Guandong Xu

Recently, sequential recommendation has been adapted to the LLM paradigm to enjoy the power of LLMs. LLM-based methods usually formulate recommendation information into natural language and the model is trained to predict the next item in…

Information Retrieval · Computer Science 2024-02-16 Hanbing Wang , Xiaorui Liu , Wenqi Fan , Xiangyu Zhao , Venkataramana Kini , Devendra Yadav , Fei Wang , Zhen Wen , Jiliang Tang , Hui Liu

Multimodal large language models (MLLMs) have made remarkable strides, largely driven by their ability to process increasingly long and complex contexts, such as high-resolution images, extended video sequences, and lengthy audio input.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Kele Shao , Keda Tao , Kejia Zhang , Sicheng Feng , Mu Cai , Yuzhang Shang , Haoxuan You , Can Qin , Yang Sui , Huan Wang

Language models (LM) play an important role in large vocabulary continuous speech recognition (LVCSR). However, traditional language models only predict next single word with given history, while the consecutive predictions on a sequence of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-06 Qi Liu , Yanmin Qian , Kai Yu

Current large language models (LLMs) primarily utilize next-token prediction method for inference, which significantly impedes their processing speed. In this paper, we introduce a novel inference methodology termed next-sentence…

Artificial Intelligence · Computer Science 2024-08-15 Hongjun An , Yifan Chen , Zhe Sun , Xuelong Li