English
Related papers

Related papers: UniTRec: A Unified Text-to-Text Transformer and Jo…

200 papers

Public Code Review (PCR) can be implemented through a Software Question Answering (SQA) community, which facilitates high knowledge dissemination. Current methods mainly focus on the reviewer's perspective, including finding a capable…

Software Engineering · Computer Science 2024-04-18 Xinyu Chen , Lin Li , Rui Zhang , Peng Liang

Recent research efforts have investigated how to integrate Large Language Models (LLMs) into recommendation, capitalizing on their semantic comprehension and open-world knowledge for user behavior understanding. These approaches…

Information Retrieval · Computer Science 2025-04-15 Haokai Ma , Yunshan Ma , Ruobing Xie , Lei Meng , Jialie Shen , Xingwu Sun , Zhanhui Kang , Tat-Seng Chua

Adapting large language models (LLMs) for personalized recommendation requires aligning their general-purpose capabilities with user-specific preferences while effectively leveraging both behavioral and semantic signals. Existing approaches…

Information Retrieval · Computer Science 2026-05-27 Pingjun Pan , Tingting Zhou , Peiyao Lu , Tingting Fei , Hongxiang Chen , Chuanjiang Luo

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Given the fact of a case, Legal Judgment Prediction (LJP) involves a series of sub-tasks such as predicting violated law articles, charges and term of penalty. We propose leveraging a unified text-to-text Transformer for LJP, where the…

Computation and Language · Computer Science 2021-12-14 Yunyun Huang , Xiaoyu Shen , Chuanyi Li , Jidong Ge , Bin Luo

This paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks. The model is pre-trained using three types of language modeling tasks: unidirectional,…

Computation and Language · Computer Science 2019-10-16 Li Dong , Nan Yang , Wenhui Wang , Furu Wei , Xiaodong Liu , Yu Wang , Jianfeng Gao , Ming Zhou , Hsiao-Wuen Hon

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Recently, Large Language Models (LLMs) have been widely employed in Conversational Recommender Systems (CRSs). Unlike traditional language model approaches that focus on training, all existing LLMs-based approaches are mainly centered…

Computation and Language · Computer Science 2025-09-26 Jianyu Wen , Jingyun Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Ying Zhang

Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations:…

Computation and Language · Computer Science 2025-08-21 Jiaming Leng , Yunying Bi , Chuan Qin , Bing Yin , Yanyong Zhang , Chao Wang

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

Information Retrieval · Computer Science 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

Although pretraining has garnered significant attention and popularity in recent years, its application in graph-based recommender systems is relatively limited. It is challenging to exploit prior knowledge by pretraining in widely used…

Information Retrieval · Computer Science 2023-10-23 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

This paper studies a text classification algorithm based on an improved Transformer to improve the performance and efficiency of the model in text classification tasks. Aiming at the shortcomings of the traditional Transformer model in…

Computation and Language · Computer Science 2025-01-24 Jia Gao , Guiran Liu , Binrong Zhu , Shicheng Zhou , Hongye Zheng , Xiaoxuan Liao

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item transitions, often…

Information Retrieval · Computer Science 2024-07-17 Yang Liu , Yitong Wang , Chenyue Feng

Recently, generative recommendation has emerged as a promising paradigm, attracting significant research attention. The basic framework involves an item tokenizer, which represents each item as a sequence of codes serving as its identifier,…

Information Retrieval · Computer Science 2025-05-27 Bowen Zheng , Hongyu Lu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

Recommender Systems (RS) play a pivotal role in boosting user satisfaction by providing personalized product suggestions in domains such as e-commerce and entertainment. This study examines the integration of multimodal data text and audio…

Information Retrieval · Computer Science 2024-09-16 Zezheng Qin

Recent advances in Large Language Models (LLMs) have been changing the paradigm of Recommender Systems (RS). However, when items in the recommendation scenarios contain rich textual information, such as product descriptions in online…

Information Retrieval · Computer Science 2024-03-21 Zhi Zheng , Wenshuo Chao , Zhaopeng Qiu , Hengshu Zhu , Hui Xiong

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based architectures that do…

Computation and Language · Computer Science 2025-06-24 Shuhan Guo , Yatao Bian , Ruibing Wang , Nan Yin , Zhen Wang , Quanming Yao

Effective personalization on large-scale job platforms requires modeling members based on heterogeneous textual sources, including profiles, professional data, and search activity logs. As recommender systems increasingly adopt Large…

Information Retrieval · Computer Science 2026-02-10 Rajat Arora , Ye Tao , Jianqiang Shen , Ping Liu , Muchen Wu , Qianqi Shen , Benjamin Le , Fedor Borisyuk , Jingwei Wu , Wenjing Zhang