English
Related papers

Related papers: Preliminary Study on Incremental Learning for Larg…

200 papers

We introduce a new sequential transformer reinforcement learning architecture RLT4Rec and demonstrate that it achieves excellent performance in a range of item recommendation tasks. RLT4Rec uses a relatively simple transformer architecture…

Information Retrieval · Computer Science 2024-12-11 Dilina Chandika Rajapakse , Douglas Leith

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on…

Computation and Language · Computer Science 2024-04-30 Yichuan Li , Kaize Ding , Jianling Wang , Kyumin Lee

Previous work has showcased the intriguing capabilities of Large Language Models (LLMs) in instruction-following and rhetorical fluency. However, systematic exploration of their dual capabilities to autonomously persuade and resist…

Computation and Language · Computer Science 2025-06-10 Tianjie Ju , Yujia Chen , Hao Fei , Mong-Li Lee , Wynne Hsu , Pengzhou Cheng , Zongru Wu , Zhuosheng Zhang , Gongshen Liu

In the evolutionary computing community, the remarkable language-handling capabilities and reasoning power of large language models (LLMs) have significantly enhanced the functionality of evolutionary algorithms (EAs), enabling them to…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Jiao Liu , Zhu Sun , Shanshan Feng , Caishun Chen , Yew-Soon Ong

Recommender systems (RecSys) are widely used across various modern digital platforms and have garnered significant attention. Traditional recommender systems usually focus only on fixed and simple recommendation scenarios, making it…

Information Retrieval · Computer Science 2026-02-03 Jiani Huang , Shijie Wang , Liang-bo Ning , Wenqi Fan , Shuaiqiang Wang , Dawei Yin , Qing Li

The prevailing approach to aligning Large Language Models (LLMs) typically relies on human or AI feedback and assumes access to specific types of preference datasets. In our work, we question the efficacy of such datasets and explore…

Machine Learning · Computer Science 2024-03-19 Hao Sun

Large language models (LLMs) have introduced new paradigms for recommender systems by enabling richer semantic understanding and incorporating implicit world knowledge. In this study, we propose a systematic taxonomy that classifies…

Information Retrieval · Computer Science 2025-05-30 Wei-Hsiang Huang , Chen-Wei Ke , Wei-Ning Chiu , Yu-Xuan Su , Chun-Chun Yang , Chieh-Yuan Cheng , Yun-Nung Chen , Pu-Jen Cheng

Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to…

Information Retrieval · Computer Science 2024-03-29 Yuling Wang , Changxin Tian , Binbin Hu , Yanhua Yu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Liang Pang , Xiao Wang

Despite the impressive performance of large language models (LLMs), they often lag behind specialized models in various tasks. LLMs only use a fraction of the existing training data for in-context learning, while task-specific models…

Computation and Language · Computer Science 2024-02-02 Giorgos Vernikos , Arthur Bražinskas , Jakub Adamek , Jonathan Mallinson , Aliaksei Severyn , Eric Malmi

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

Recent advancements in Artificial Intelligence have led to the development of Multimodal Large Language Models (MLLMs). However, adapting these pre-trained models to dynamic data distributions and various tasks efficiently remains a…

Machine Learning · Computer Science 2025-03-05 Yukang Huo , Hao Tang

Incremental Learning (IL) has been a long-standing problem in both vision and Natural Language Processing (NLP) communities. In recent years, as Pre-trained Language Models (PLMs) have achieved remarkable progress in various NLP downstream…

Computation and Language · Computer Science 2024-08-09 Junhao Zheng , Shengjie Qiu , Qianli Ma

Instruction tuning constitutes a prevalent technique for tailoring Large Vision Language Models (LVLMs) to meet individual task requirements. To date, most of the existing approaches are confined to single-task adaptation, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Meng Cao , Yuyang Liu , Yingfei Liu , Tiancai Wang , Jiahua Dong , Henghui Ding , Xiangyu Zhang , Ian Reid , Xiaodan Liang

Enhancing the adaptive capabilities of large language models is a critical pursuit in both research and application. Traditional fine-tuning methods require substantial data and computational resources, especially for enhancing specific…

Computation and Language · Computer Science 2025-02-27 Futing Wang , Jianhao Yan , Yue Zhang , Tao Lin

With instruction tuning, Large Language Models (LLMs) can enhance their ability to adhere to commands. Diverging from most works focusing on data mixing, our study concentrates on enhancing the model's capabilities from the perspective of…

Computation and Language · Computer Science 2024-10-07 Jun Rao , Xuebo Liu , Lian Lian , Shengjun Cheng , Yunjie Liao , Min Zhang

Large Language Models (LLMs) exhibit substantial capabilities yet encounter challenges, including hallucination, outdated knowledge, and untraceable reasoning processes. Retrieval-augmented generation (RAG) has emerged as a promising…

Artificial Intelligence · Computer Science 2024-06-03 Feiteng Fang , Yuelin Bai , Shiwen Ni , Min Yang , Xiaojun Chen , Ruifeng Xu

Formal verification via theorem proving enables the expressive specification and rigorous proof of software correctness, but it is difficult to scale due to the significant manual effort and expertise required. While Large Language Models…

Software Engineering · Computer Science 2025-10-30 Minghai Lu , Zhe Zhou , Danning Xie , Songlin Jia , Benjamin Delaware , Tianyi Zhang

The integration of reinforcement learning (RL) into large language models (LLMs) has opened new opportunities for recommender systems by eliciting reasoning and improving user preference modeling. However, RL-based LLM recommendation faces…

Information Retrieval · Computer Science 2026-02-05 Lin Wang , Yang Zhang , Jingfan Chen , Xiaoyan Zhao , Fengbin Zhu , Qing Li , Tat-Seng Chua

Large language models (LLMs) have demonstrated significant potential in enhancing dense retrieval through query augmentation. However, most existing methods treat the LLM and the retriever as separate modules, overlooking the alignment…

Information Retrieval · Computer Science 2025-05-30 Sijia Yao , Pengcheng Huang , Zhenghao Liu , Yu Gu , Yukun Yan , Shi Yu , Ge Yu