中文
相关论文

相关论文: Training Large-Scale News Recommenders with Pretra…

200 篇论文

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of…

人工智能 · 计算机科学 2026-01-09 Tongyu Wen , Guanting Dong , Zhicheng Dou

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

信息检索 · 计算机科学 2024-05-03 Kirandeep Kaur , Chirag Shah

Transformer-based large language models (LLMs) have demonstrated impressive capabilities in a variety of natural language processing (NLP) tasks. Nonetheless, it is challenging to deploy and fine-tune LLMs on mobile edge devices with…

机器学习 · 计算机科学 2023-11-23 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Jiming Chen

When using supervised fine-tuning (SFT) to adapt large language models (LLMs) to specific domains, a significant challenge arises: should we use the entire SFT dataset for fine-tuning? Common practice often involves fine-tuning directly on…

计算与语言 · 计算机科学 2025-05-26 Xiang Liu , Zhaoxiang Liu , Peng Wang , Kohou Wang , Huan Hu , Kai Wang , Shiguo Lian

The past few years have witnessed a growing interest in LLM-based recommender systems (RSs), although their industrial deployment remains in a preliminary stage. Most existing deployments leverage LLMs offline as feature enhancers,…

信息检索 · 计算机科学 2025-04-30 Yunjia Xi , Hangyu Wang , Bo Chen , Jianghao Lin , Menghui Zhu , Weiwen Liu , Ruiming Tang , Zhewei Wei , Weinan Zhang , Yong Yu

As a promising paradigm to collaboratively train models with decentralized data, Federated Learning (FL) can be exploited to fine-tune Large Language Models (LLMs). While LLMs correspond to huge size, the scale of the training data…

机器学习 · 计算机科学 2024-10-21 Ji Liu , Jiaxiang Ren , Ruoming Jin , Zijie Zhang , Yang Zhou , Patrick Valduriez , Dejing Dou

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

计算与语言 · 计算机科学 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained…

机器学习 · 计算机科学 2023-06-05 Zhuo Zhang , Yuanhang Yang , Yong Dai , Lizhen Qu , Zenglin Xu

Recently, Large Language Models~(LLMs) such as ChatGPT have showcased remarkable abilities in solving general tasks, demonstrating the potential for applications in recommender systems. To assess how effectively LLMs can be used in…

信息检索 · 计算机科学 2025-01-17 Lanling Xu , Junjie Zhang , Bingqian Li , Jinpeng Wang , Sheng Chen , Wayne Xin Zhao , Ji-Rong Wen

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

计算与语言 · 计算机科学 2025-04-08 Menglin Liu , Ge Shi

Pruning is an effective method for compressing Large Language Models, but finding an optimal, non-uniform layer-wise sparsity allocation remains a key challenge. While heuristic methods are fast but yield suboptimal performance, more…

机器学习 · 计算机科学 2025-11-25 Xin Yuan , Siqi Li , Jiateng Wei , Chengrui Zhu , Yanming Wu , Qingpeng Li , Jiajun Lv , Xiaoke Lan , Jun Chen , Yong Liu

In sequential decision-making (SDM) tasks, methods like reinforcement learning (RL) and heuristic search have made notable advances in specific cases. However, they often require extensive exploration and face challenges in generalizing…

机器学习 · 计算机科学 2024-10-11 Xue Yan , Yan Song , Xidong Feng , Mengyue Yang , Haifeng Zhang , Haitham Bou Ammar , Jun Wang

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

计算与语言 · 计算机科学 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

Large Language Models (LLMs) have significantly advanced the field of information retrieval, particularly for reranking. Listwise LLM rerankers have showcased superior performance and generalizability compared to existing supervised…

信息检索 · 计算机科学 2024-06-25 Revanth Gangi Reddy , JaeHyeok Doo , Yifei Xu , Md Arafat Sultan , Deevya Swain , Avirup Sil , Heng Ji

With the rapid development of online services, recommender systems (RS) have become increasingly indispensable for mitigating information overload. Despite remarkable progress, conventional recommendation models (CRM) still have some…

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

人工智能 · 计算机科学 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Speculative decoding has emerged as a popular method to accelerate the inference of Large Language Models (LLMs) while retaining their superior text generation performance. Previous methods either adopt a fixed speculative decoding…

机器学习 · 计算机科学 2025-11-21 Yunlong Hou , Fengzhuo Zhang , Cunxiao Du , Xuan Zhang , Jiachun Pan , Tianyu Pang , Chao Du , Vincent Y. F. Tan , Zhuoran Yang

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiveness of in-context learning is heavily reliant on the…

计算与语言 · 计算机科学 2024-01-29 Liang Wang , Nan Yang , Furu Wei

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in…

信息检索 · 计算机科学 2025-10-06 Rahul Raja , Anshaj Vats , Arpita Vats , Anirban Majumder

To seek reliable information sources for news events, we introduce a novel task of expert recommendation, which aims to identify trustworthy sources based on their previously quoted statements. To achieve this, we built a novel dataset,…

信息检索 · 计算机科学 2024-06-18 Wenjia Zhang , Lin Gui , Rob Procter , Yulan He