English
Related papers

Related papers: Towards Efficient and Effective Adaptation of Larg…

200 papers

Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most…

Information Retrieval · Computer Science 2024-11-04 Qidong Liu , Xian Wu , Yejing Wang , Zijian Zhang , Feng Tian , Yefeng Zheng , Xiangyu Zhao

Fine-tuning is a key approach for adapting language models to specific downstream tasks, but updating all model parameters becomes impractical as model sizes increase. Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank…

Computation and Language · Computer Science 2025-02-10 Jiayang Yu , Yihang Zhang , Bin Wang , Peiqin Lin , Yongkang Liu , Shi Feng

The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e.g.,…

Computation and Language · Computer Science 2023-10-10 Zhiqiang Hu , Lei Wang , Yihuai Lan , Wanyu Xu , Ee-Peng Lim , Lidong Bing , Xing Xu , Soujanya Poria , Roy Ka-Wei Lee

While Large language models (LLMs) have demonstrated considerable capabilities across various natural language tasks, they often fall short of the performance achieved by domain-specific state-of-the-art models. One potential approach to…

Computation and Language · Computer Science 2024-06-19 An Liu , Zonghan Yang , Zhenhe Zhang , Qingyuan Hu , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Yang Liu

Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Qingyao Ai , Yiqun Liu , Mingchen Cai , Min Zhang

Low-resource languages (LRLs) face significant challenges in natural language processing (NLP) due to limited data. While current state-of-the-art large language models (LLMs) still struggle with LRLs, smaller multilingual models (mLMs)…

Computation and Language · Computer Science 2025-02-17 Daniil Gurgurov , Ivan Vykopal , Josef van Genabith , Simon Ostermann

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

Information Retrieval · Computer Science 2025-04-15 Tong Zhang

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLMs). While the…

Information Retrieval · Computer Science 2024-12-31 Yucong Luo , Qitao Qin , Hao Zhang , Mingyue Cheng , Ruiran Yan , Kefan Wang , Jie Ouyang

The recent advancements in large language models (LLMs) have significantly improved language understanding and generation capabilities. However, it is difficult to deploy LLMs on resource-constrained edge devices due to their high…

Computation and Language · Computer Science 2024-12-20 Haotian Zheng , Jinke Ren , Yushan Sun , Ruichen Zhang , Wenbo Zhang , Zhen Li , Dusit Niyato , Shuguang Cui , Yatong Han

LLMs' performance on complex tasks is still unsatisfactory. A key issue is that presently LLMs learn in a data-driven schema, while the instructions about these complex tasks are both scarce and hard to collect or construct. On the…

Machine Learning · Computer Science 2024-10-21 Yang Zhao , Li Du , Xiao Ding , Kai Xiong , Ting Liu , Bing Qin

The advent of Large Language Models (LLM) has reformed the Automatic Speech Recognition (ASR). Prompting LLM with audio embeddings to generate transcriptions becomes the new state-of-the-art ASR. Despite LLMs being trained with an extensive…

Computation and Language · Computer Science 2024-12-11 Yingyi Ma , Zhe Liu , Ozlem Kalinli

Sequential Recommendation (SR) aims to leverage the sequential patterns in users' historical interactions to accurately track their preferences. However, the primary reliance of existing SR methods on collaborative data results in…

Information Retrieval · Computer Science 2025-04-29 Yuhao Wang , Junwei Pan , Pengyue Jia , Wanyu Wang , Maolin Wang , Zhixiang Feng , Xiaotian Li , Jie Jiang , Xiangyu Zhao

Sequential recommendation (SR) aims to capture users' dynamic interests and sequential patterns based on their historical interactions. Recently, the powerful capabilities of large language models (LLMs) have driven their adoption in SR.…

Information Retrieval · Computer Science 2025-09-03 Yuhao Wang , Junwei Pan , Xinhang Li , Maolin Wang , Yuan Wang , Yue Liu , Dapeng Liu , Jie Jiang , Xiangyu Zhao

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

It is today acknowledged that neural network language models outperform backoff language models in applications like speech recognition or statistical machine translation. However, training these models on large amounts of data can take…

Neural and Evolutionary Computing · Computer Science 2015-07-08 Aram Ter-Sarkisov , Holger Schwenk , Loic Barrault , Fethi Bougares

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

Sequential Recommenders generate recommendations based on users' historical interaction sequences. However, in practice, these collected sequences are often contaminated by noisy interactions, which significantly impairs recommendation…

Information Retrieval · Computer Science 2025-06-10 Bohao Wang , Feng Liu , Changwang Zhang , Jiawei Chen , Yudi Wu , Sheng Zhou , Xingyu Lou , Jun Wang , Yan Feng , Chun Chen , Can Wang

Large language models (LLMs) face significant challenges when balancing multiple high-level objectives, such as generating coherent, relevant, and high-quality responses while maintaining efficient task adaptation across diverse tasks. To…

Computation and Language · Computer Science 2025-02-21 Yupeng Chang , Yi Chang , Yuan Wu

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples, inadvertently overlooking the needs of diverse user populations. The performance disparity among various…

Information Retrieval · Computer Science 2025-10-21 Kirandeep Kaur , Vinayak Gupta , Manya Chadha , Chirag Shah