English
Related papers

Related papers: M6-Rec: Generative Pretrained Language Models are …

200 papers

In a multi-stage recommendation system, reranking plays a crucial role in modeling intra-list correlations among items. A key challenge lies in exploring optimal sequences within the combinatorial space of permutations. Recent research…

Information Retrieval · Computer Science 2025-10-30 Zhijie Lin , Zhuofeng Li , Chenglei Dai , Wentian Bao , Shuai Lin , Enyun Yu , Haoxiang Zhang , Liang Zhao

Existing knowledge-grounded conversation systems generate responses typically in a retrieve-then-generate manner. They require a large knowledge base and a strong knowledge retrieval component, which is time- and resource-consuming. In this…

Computation and Language · Computer Science 2023-06-28 Jiaqi Bai , Zhao Yan , Jian Yang , Xinnian Liang , Hongcheng Guo , Zhoujun Li

Particularly in low-data regimes, an outstanding challenge in machine learning is developing principled techniques for augmenting our models with suitable priors. This is to encourage them to learn in ways that are compatible with our…

Machine Learning · Computer Science 2022-10-25 Kristy Choi , Chris Cundy , Sanjari Srivastava , Stefano Ermon

As large-scale pre-trained foundation models continue to expand in size and capability, efficiently adapting them to specific downstream tasks has become increasingly critical. Despite substantial progress, existing adaptation approaches…

Machine Learning · Computer Science 2025-10-21 Zesheng Ye , Chengyi Cai , Ruijiang Dong , Jianzhong Qi , Lei Feng , Pin-Yu Chen , Feng Liu

With the explosive growth of multimodal content online, pre-trained visual-language models have shown great potential for multimodal recommendation. However, while these models achieve decent performance when applied in a frozen manner,…

Information Retrieval · Computer Science 2025-02-24 Wenyu Zhang , Jie Luo , Xinming Zhang , Yuan Fang

Foundation models have received much attention due to their effectiveness across a broad range of downstream applications. Though there is a big convergence in terms of architecture, most pretrained models are typically still developed for…

Computation and Language · Computer Science 2022-06-14 Yaru Hao , Haoyu Song , Li Dong , Shaohan Huang , Zewen Chi , Wenhui Wang , Shuming Ma , Furu Wei

Generating natural language explanations for recommendations has become increasingly important in recommender systems. Traditional approaches typically treat user reviews as ground truth for explanations and focus on improving review…

Information Retrieval · Computer Science 2025-02-18 Jingsen Zhang , Zihang Tian , Xueyang Feng , Xu Chen

Sequential recommendation is an important recommendation task that aims to predict the next item in a sequence. Recently, adaptations of language models, particularly Transformer-based models such as SASRec and BERT4Rec, have achieved…

Information Retrieval · Computer Science 2023-06-21 Aleksandr V. Petrov , Craig Macdonald

Foundation models encompass an extensive knowledge base and offer remarkable transferability. However, this knowledge becomes outdated or insufficient over time. The challenge lies in continuously updating foundation models to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenxuan Zhang , Paul Janson , Rahaf Aljundi , Mohamed Elhoseiny

Generative models powered by Large Language Models (LLMs) are emerging as a unified solution for powering both recommendation and search tasks. A key design choice in these models is how to represent items, traditionally through unique…

Recent advances in LLM-based recommendation have shown promise, yet their cross-domain generalization is hindered by a fundamental mismatch between language-centric pretraining and the recommendation task. Existing methods, relying on…

Information Retrieval · Computer Science 2025-09-04 Sashuai Zhou , Weinan Gan , Qijiong Liu , Ke Lei , Jieming Zhu , Hai Huang , Yan Xia , Ruiming Tang , Zhenhua Dong , Zhou Zhao

Fine-tuning pre-trained generative language models to down-stream language generation tasks has shown promising results. However, this comes with the cost of having a single, large model for each task, which is not ideal in low-memory/power…

Computation and Language · Computer Science 2020-09-22 Zhaojiang Lin , Andrea Madotto , Pascale Fung

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user's explicit preferences expressed in dialogue. While…

Computation and Language · Computer Science 2023-05-11 Naveen Ram , Dima Kuzmin , Ellie Ka In Chio , Moustafa Farid Alzantot , Santiago Ontanon , Ambarish Jash , Judith Yue Li

Despite their remarkable reasoning capabilities across diverse domains, large language models (LLMs) face fundamental challenges in natively functioning as generative reasoning recommendation models (GRRMs), where the intrinsic modeling gap…

Information Retrieval · Computer Science 2025-10-24 Minjie Hong , Zetong Zhou , Zirun Guo , Ziang Zhang , Ruofan Hu , Weinan Gan , Jieming Zhu , Zhou Zhao

Research and industry are rapidly advancing the innovation and adoption of foundation model-based systems, yet the tools for managing these models have not kept pace. Understanding the provenance and lineage of models is critical for…

Machine Learning · Computer Science 2024-12-17 Keyu Wang , Abdullah Norozi Iranzad , Scott Schaffter , Meg Risdal , Doina Precup , Jonathan Lebensold

Generative recommendation based on Large Language Models (LLMs) have transformed the traditional ranking-based recommendation style into a text-to-text generation paradigm. However, in contrast to standard NLP tasks that inherently operate…

Information Retrieval · Computer Science 2024-05-20 Juntao Tan , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Zelong Li , Yongfeng Zhang

The design of conceptually sound metamodels that embody proper semantics in relation to the application domain is particularly tedious in Model-Driven Engineering. As metamodels define complex relationships between domain concepts, it is…

Software Engineering · Computer Science 2022-02-22 Martin Weyssow , Houari Sahraoui , Eugene Syriani

Nowadays, billions of people engage in communication and express their opinions on the internet daily. Unfortunately, not all of these expressions are friendly or compliant, making content moderation an indispensable task. A common approach…

Machine Learning · Computer Science 2024-03-08 Huan Ma , Changqing Zhang , Huazhu Fu , Peilin Zhao , Bingzhe Wu

Search-based recommendation is one of the most critical application scenarios in e-commerce platforms. Users' complex search contexts--such as spatiotemporal factors, historical interactions, and current query's information--constitute an…

Information Retrieval · Computer Science 2026-02-16 Zhiding Liu , Ben Chen , Mingyue Cheng , Enhong Chen , Li Li , Chenyi Lei , Wenwu Ou , Han Li , Kun Gai

Graph-structured data pervades domains such as social networks, biological systems, knowledge graphs, and recommender systems. While foundation models have transformed natural language processing, vision, and multimodal learning through…