中文
相关论文

相关论文: CPRM: A LLM-based Continual Pre-training Framework…

200 篇论文

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

计算与语言 · 计算机科学 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for…

计算与语言 · 计算机科学 2023-05-09 Deepak Gupta , Dina Demner-Fushman

The paper underscores the significance of Large Language Models (LLMs) in reshaping recommender systems, attributing their value to unique reasoning abilities absent in traditional recommenders. Unlike conventional systems lacking direct…

信息检索 · 计算机科学 2024-03-20 Arpita Vats , Vinija Jain , Rahul Raja , Aman Chadha

LLM development has aroused great interest in Sequential Recommendation (SR) applications. However, comprehensive evaluation of SR models remains lacking due to the limitations of the existing benchmarks: 1) an overemphasis on accuracy,…

信息检索 · 计算机科学 2026-04-14 Jianhong Li , Zeheng Qian , Wangze Ni , Haoyang Li , Hongwei Yao , Yang Bai , Kui Ren

Large Language Model (LLM) has transformative potential in various domains, including recommender systems (RS). There have been a handful of research that focuses on empowering the RS by LLM. However, previous efforts mainly focus on LLM as…

Instruction-following capabilities in LLMs have progressed significantly, enabling more complex user interactions through detailed prompts. However, retrieval systems have not matched these advances, most of them still relies on traditional…

信息检索 · 计算机科学 2025-03-06 Jianqun Zhou , Yuanlei Zheng , Wei Chen , Qianqian Zheng , Hui Su , Wei Zhang , Rui Meng , Xiaoyu Shen

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

信息检索 · 计算机科学 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

The emergence of pre-trained language models (PLMs) has shown great success in many Natural Language Processing (NLP) tasks including text classification. Due to the minimal to no feature engineering required when using these models, PLMs…

计算与语言 · 计算机科学 2022-11-07 Yasmen Wahba , Nazim Madhavji , John Steinbacher

Consumers often heavily rely on online product reviews, analyzing both quantitative ratings and textual descriptions to assess product quality. However, existing research hasn't adequately addressed how to systematically encourage the…

信息检索 · 计算机科学 2025-04-22 Ekta Gujral , Apurva Sinha , Lishi Ji , Bijayani Sanghamitra Mishra

Long-context handling remains a core challenge for language models: even with extended context windows, models often fail to reliably extract, reason over, and use the information across long contexts. Recent works like Recursive Language…

计算与语言 · 计算机科学 2026-03-18 Keivan Alizadeh , Parshin Shojaee , Minsik Cho , Mehrdad Farajtabar

In recent years, deep neural networks have led to exciting breakthroughs in speech recognition, computer vision, and natural language processing (NLP) tasks. However, there have been few positive results of deep models on ad-hoc retrieval…

信息检索 · 计算机科学 2017-11-27 Jiafeng Guo , Yixing Fan , Qingyao Ai , W. Bruce Croft

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevant is document A to…

信息检索 · 计算机科学 2024-04-19 Le Yan , Zhen Qin , Honglei Zhuang , Rolf Jagerman , Xuanhui Wang , Michael Bendersky , Harrie Oosterhuis

Systematic reviews require the use of rigorously designed search strategies to ensure both comprehensive retrieval and minimization of bias. Conventional manual approaches, although methodologically systematic, are resource-intensive and…

信息检索 · 计算机科学 2026-02-03 Fatima Nasser , Fouad Trad , Ammar Mohanna , Ghada El-Hajj Fuleihan , Ali Chehab

Large Language Models (LLMs) are a class of generative AI models built using the Transformer network, capable of leveraging vast datasets to identify, summarize, translate, predict, and generate language. LLMs promise to revolutionize…

信息检索 · 计算机科学 2024-03-05 Chunhe Ni , Jiang Wu , Hongbo Wang , Wenran Lu , Chenwei Zhang

Large language models (LLMs) have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. To address this gap, we…

计算与语言 · 计算机科学 2026-04-21 Yujie Liu , Zonglin Yang , Tong Xie , Jinjie Ni , Ben Gao , Yuqiang Li , Shixiang Tang , Wanli Ouyang , Erik Cambria , Dongzhan Zhou

Cross-Domain Sequential Recommendation (CDSR) aims to mine and transfer users' sequential preferences across different domains to alleviate the long-standing cold-start issue. Traditional CDSR models capture collaborative information…

机器学习 · 计算机科学 2024-06-06 Tingjia Shen , Hao Wang , Jiaqing Zhang , Sirui Zhao , Liangyue Li , Zulong Chen , Defu Lian , Enhong Chen

In the field of language modeling, models augmented with retrieval components have emerged as a promising solution to address several challenges faced in the natural language processing (NLP) field, including knowledge grounding,…

机器学习 · 计算机科学 2024-10-22 To Eun Kim , Alireza Salemi , Andrew Drozdov , Fernando Diaz , Hamed Zamani

Sequential recommendation (SR) has seen significant advancements with the help of Pre-trained Language Models (PLMs). Some PLM-based SR models directly use PLM to encode user historical behavior's text sequences to learn user…

信息检索 · 计算机科学 2024-08-15 Zekai Qu , Ruobing Xie , Chaojun Xiao , Xingwu Sun , Zhanhui Kang

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

计算与语言 · 计算机科学 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

Click-Through Rate (CTR) prediction holds a paramount position in recommender systems. The prevailing ID-based paradigm underperforms in cold-start scenarios due to the skewed distribution of feature frequency. Additionally, the utilization…