English
Related papers

Related papers: CoRA: Collaborative Information Perception by Larg…

200 papers

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning Large Language Models (LLMs) for text generation. In particular, recent LLMs such as ChatGPT and GPT-4 can engage in fluent conversations with users after…

Machine Learning · Computer Science 2023-11-14 Jonathan D. Chang , Kiante Brantley , Rajkumar Ramamurthy , Dipendra Misra , Wen Sun

LoRA employs lightweight modules to customize large language models (LLMs) for each downstream task or domain, where different learned additional modules represent diverse skills. Combining existing LoRAs to address new tasks can enhance…

Computation and Language · Computer Science 2024-02-20 Hanqing Wang , Bowen Ping , Shuo Wang , Xu Han , Yun Chen , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like retrieval. We attribute this to a mismatch between LLMs'…

Information Retrieval · Computer Science 2024-04-02 Yuwei Cao , Nikhil Mehta , Xinyang Yi , Raghunandan Keshavan , Lukasz Heldt , Lichan Hong , Ed H. Chi , Maheswaran Sathiamoorthy

LoRA (Low-Rank Adaptation) has emerged as a preferred method for efficiently adapting Large Language Models (LLMs) with remarkable simplicity and efficacy. This note extends the original LoRA paper by offering new perspectives that were not…

Machine Learning · Computer Science 2024-04-09 Vlad Fomenko , Han Yu , Jongho Lee , Stanley Hsieh , Weizhu Chen

Current Large Language Models (LLMs) excel in general reasoning yet struggle with specialized tasks requiring proprietary or domain-specific knowledge. Fine-tuning large models for every niche application is often infeasible due to…

Artificial Intelligence · Computer Science 2025-04-23 Yizhu Jiao , Xuchao Zhang , Zhaoyang Wang , Yubo Ma , Zhun Deng , Rujia Wang , Chetan Bansal , Saravan Rajmohan , Jiawei Han , Huaxiu Yao

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

In recent years, large language models (LLM) have emerged as powerful tools for diverse natural language processing tasks. However, their potential for recommender systems under the generative recommendation paradigm remains relatively…

Information Retrieval · Computer Science 2023-07-11 Jianchao Ji , Zelong Li , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Juntao Tan , Yongfeng Zhang

Instruction fine-tuning has conventionally been employed to adapt Large Language Models (LLMs) to a variety of tasks. Nonetheless, this technique often necessitates substantial computational resources, making it impractical for deployment…

Computation and Language · Computer Science 2024-10-08 Zhenting Qi , Xiaoyu Tan , Shaojie Shi , Chao Qu , Yinghui Xu , Yuan Qi

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

LLMs' remarkable ability to tackle a wide range of language tasks opened new opportunities for collaborative human-AI problem solving. LLMs can amplify human capabilities by applying their intuitions and reasoning strategies at scale. We…

Computation and Language · Computer Science 2025-09-23 Abhishek Sharma , Dan Goldwasser

Fine-tuning large language models (LLMs) aims to adapt pre-trained models to specific tasks using relatively small and domain-specific datasets. Among Parameter-Efficient Fine-Tuning (PEFT) methods, Low-Rank Adaptation (LoRA) stands out by…

Computation and Language · Computer Science 2026-04-16 Yarui Cao , Kai Liu

Recommender systems (RS) have become essential tools for helping users efficiently navigate the overwhelming amount of information on e-commerce and social platforms. However, traditional RS relying on Collaborative Filtering (CF) struggles…

Information Retrieval · Computer Science 2025-02-27 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

With the rapid development of large language models (LLMs) and the growing demand for personalized content, recommendation systems have become critical in enhancing user experience and driving engagement. Collaborative filtering algorithms,…

Artificial Intelligence · Computer Science 2024-12-30 Haowei Yang , Longfei Yun , Jinghan Cao , Qingyi Lu , Yuming Tu

Collaborative filtering recommender systems (CF-RecSys) have shown successive results in enhancing the user experience on social media and e-commerce platforms. However, as CF-RecSys struggles under cold scenarios with sparse user-item…

Information Retrieval · Computer Science 2024-06-04 Sein Kim , Hongseok Kang , Seungyoon Choi , Donghyun Kim , Minchul Yang , Chanyoung Park

Large Language Models (LLMs) have become powerful foundations for generative recommender systems, framing recommendation tasks as text generation tasks. However, existing generative recommendation methods often rely on discrete ID-based…

Information Retrieval · Computer Science 2026-03-24 Jerome Ramos , Bin Wu , Aldo Lipani

The rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Federated learning (FL) further enhances fine-tuning in a…

Machine Learning · Computer Science 2024-09-11 Ziyao Wang , Zheyu Shen , Yexiao He , Guoheng Sun , Hongyi Wang , Lingjuan Lyu , Ang Li

Recommender Systems (RS) play a pivotal role in boosting user satisfaction by providing personalized product suggestions in domains such as e-commerce and entertainment. This study examines the integration of multimodal data text and audio…

Information Retrieval · Computer Science 2024-09-16 Zezheng Qin

Large Language Models (LLMs) have recently emerged as promising tools for recommendation thanks to their advanced textual understanding ability and context-awareness. Despite the current practice of training and evaluating LLM-based…

Information Retrieval · Computer Science 2025-06-12 Sein Kim , Hongseok Kang , Kibum Kim , Jiwan Kim , Donghyun Kim , Minchul Yang , Kwangjin Oh , Julian McAuley , Chanyoung Park

In the evolving landscape of conversational AI, generating concise, context-aware, and human-like dialogue using small and medium-sized language models (LLMs) remains a complex challenge. This study investigates the influence of LoRA rank,…

Computation and Language · Computer Science 2025-04-15 Chitranshu Harbola , Anupam Purwar

Large-language Models (LLMs) have been extremely successful at tasks like complex dialogue understanding, reasoning and coding due to their emergent abilities. These emergent abilities have been extended with multi-modality to include…

Information Retrieval · Computer Science 2025-05-19 Li Yang , Anushya Subbiah , Hardik Patel , Judith Yue Li , Yanwei Song , Reza Mirghaderi , Vikram Aggarwal , Qifan Wang