中文
相关论文

相关论文: Preliminary Study on Incremental Learning for Larg…

200 篇论文

As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becomes crucial. Traditional training methods, relying on static…

机器学习 · 计算机科学 2024-06-11 Junhao Zheng , Shengjie Qiu , Chengming Shi , Qianli Ma

Conventional continual pretraining (CPT) for large language model (LLM) domain adaptation often suffers from catastrophic forgetting and limited domain capacity. Existing strategies adopt layer expansion, introducing additional trainable…

机器学习 · 计算机科学 2025-10-14 Jinyang Zhang , Yue Fang , Hongxin Ding , Weibin Liao , Muyang Ye , Xu Chu , Junfeng Zhao , Yasha Wang

Large language models (LLMs) are powerful but static; they lack mechanisms to adapt their weights in response to new tasks, knowledge, or examples. We introduce Self-Adapting LLMs (SEAL), a framework that enables LLMs to self-adapt by…

机器学习 · 计算机科学 2025-09-19 Adam Zweiger , Jyothish Pari , Han Guo , Ekin Akyürek , Yoon Kim , Pulkit Agrawal

Recent advancements in Large Language Models (LLMs) have shown significant potential in enhancing recommender systems. However, addressing the cold-start recommendation problem, where users lack historical data, remains a considerable…

信息检索 · 计算机科学 2025-04-29 Hai-Dang Kieu , Minh Duc Nguyen , Thanh-Son Nguyen , Dung D. Le

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and,…

信息检索 · 计算机科学 2024-08-27 Yaoyiran Li , Xiang Zhai , Moustafa Alzantot , Keyi Yu , Ivan Vulić , Anna Korhonen , Mohamed Hammad

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

信息检索 · 计算机科学 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

Recommender Systems (RS) play a pivotal role in boosting user satisfaction by providing personalized product suggestions in domains such as e-commerce and entertainment. This study examines the integration of multimodal data text and audio…

信息检索 · 计算机科学 2024-09-16 Zezheng Qin

The application of Large Language Models (LLMs) in recommender systems faces key challenges in delivering deep personalization and intelligent reasoning, especially for interactive scenarios. Current methods are often constrained by limited…

信息检索 · 计算机科学 2025-10-17 Jiani Huang , Xingchen Zou , Lianghao Xia , Qing Li

Existing efforts to improve logical reasoning ability of language models have predominantly relied on supervised fine-tuning, hindering generalization to new domains and/or tasks. The development of Large Langauge Models (LLMs) has…

计算与语言 · 计算机科学 2024-06-18 Fangkai Jiao , Zhiyang Teng , Bosheng Ding , Zhengyuan Liu , Nancy F. Chen , Shafiq Joty

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

信息检索 · 计算机科学 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

Sequential Recommendation (SR) task involves predicting the next item a user is likely to interact with, given their past interactions. The SR models examine the sequence of a user's actions to discern more complex behavioral patterns and…

信息检索 · 计算机科学 2025-04-22 Wujiang Xu , Qitian Wu , Zujie Liang , Jiaojiao Han , Xuying Ning , Yunxiao Shi , Wenfang Lin , Yongfeng Zhang

Large Language Models (LLMs) represent the recent success of deep learning in achieving remarkable human-like predictive performance. It has become a mainstream strategy to leverage fine-tuning to adapt LLMs for various real-world…

机器学习 · 计算机科学 2023-09-19 Hongpeng Jin , Wenqi Wei , Xuyu Wang , Wenbin Zhang , Yanzhao Wu

Sequential recommendation (SR) tasks aim to predict users' next interaction by learning their behavior sequence and capturing the connection between users' past interactions and their changing preferences. Conventional SR models often focus…

信息检索 · 计算机科学 2024-12-19 Haoyi Zhang , Guohao Sun , Jinhu Lu , Guanfeng Liu , Xiu Susie Fang

Despite the strong performance of Large Language Models (LLMs) on complex instruction-following tasks, precise control of output length remains a persistent challenge. Existing methods primarily attempt to enforce length constraints by…

计算与语言 · 计算机科学 2026-03-23 Wei Zhang , Lintong Du , Yuanhe Zhang , Zhenhong Zhou , Kun Wang , Li Sun , Sen Su

Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving…

计算与语言 · 计算机科学 2024-02-08 Tongtong Wu , Linhao Luo , Yuan-Fang Li , Shirui Pan , Thuy-Trang Vu , Gholamreza Haffari

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

计算与语言 · 计算机科学 2025-06-12 Yuxin Jiang

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches…

信息检索 · 计算机科学 2024-12-10 Minglai Shao , Hua Huang , Qiyao Peng , Hongtao Liu

Large language models (LLMs) typically utilize the top-k contexts from a retriever in retrieval-augmented generation (RAG). In this work, we propose a novel instruction fine-tuning framework RankRAG, which instruction-tunes a single LLM for…

计算与语言 · 计算机科学 2024-07-03 Yue Yu , Wei Ping , Zihan Liu , Boxin Wang , Jiaxuan You , Chao Zhang , Mohammad Shoeybi , Bryan Catanzaro

Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes decision-making scenarios is still limited due to the…

计算与语言 · 计算机科学 2023-11-14 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan O Arik , Tomas Pfister , Somesh Jha

Reinforcement Learning-based recommender systems (RLRS) offer an effective way to handle sequential recommendation tasks but often face difficulties in real-world settings, where user feedback data can be sub-optimal or sparse. In this…

信息检索 · 计算机科学 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao