English
Related papers

Related papers: Bidirectional Knowledge Distillation for Enhancing…

200 papers

Large Language Models (LLMs) often exhibit misalignment between the quality of their generated responses and the confidence estimates they assign to them. Bayesian treatments, such as marginalizing over a reliable weight posterior or over…

The growing adoption of large language models (LLMs) in business applications has amplified interest in Natural Language to SQL (NL2SQL) solutions, in which there is competing demand for high performance and efficiency. Domain- and…

Large language models (LLMs) have garnered increasing attention owing to their powerful logical reasoning capabilities. Generally, larger LLMs (L-LLMs) that require paid interfaces exhibit significantly superior performance compared to…

Artificial Intelligence · Computer Science 2025-11-11 Dong Chen , Shilin Zhang , Fei Gao , Yueting Zhuang , Siliang Tang , Qidong Liu , Mingliang Xu

Knowledge distillation (KD) is a powerful paradigm for compressing large language models (LLMs), whose effectiveness depends on intertwined choices of divergence direction, optimization strategy, and data regime. We break down the design of…

Computation and Language · Computer Science 2026-04-23 Wenhong Zhu , Ruobing Xie , Rui Wang , Pengfei Liu

On many natural language processing tasks, large pre-trained language models (PLMs) have shown overwhelming performances compared with traditional neural network methods. Nevertheless, their huge model size and low inference speed have…

Computation and Language · Computer Science 2021-10-19 Chenhe Dong , Yaliang Li , Ying Shen , Minghui Qiu

Modern language models have the capacity to store and use immense amounts of knowledge about real-world entities, but it remains unclear how to update such knowledge stored in model parameters. While prior methods for updating knowledge in…

Computation and Language · Computer Science 2023-11-01 Shankar Padmanabhan , Yasumasa Onoe , Michael J. Q. Zhang , Greg Durrett , Eunsol Choi

Sequential recommender systems stand out for their ability to capture users' dynamic interests and the patterns of item-to-item transitions. However, the inherent openness of sequential recommender systems renders them vulnerable to…

Information Retrieval · Computer Science 2025-03-03 Kaike Zhang , Qi Cao , Yunfan Wu , Fei Sun , Huawei Shen , Xueqi Cheng

Recent advances in generative artificial intelligence, particularly large language models (LLMs), have opened new opportunities for enhancing recommender systems (RecSys). Most existing LLM-based RecSys approaches operate in a discrete…

Information Retrieval · Computer Science 2026-02-25 Haohao Qu , Shanru Lin , Yujuan Ding , Yiqi Wang , Wenqi Fan

Post-training endows pretrained LLMs with a variety of desirable skills, including instruction-following, reasoning, and others. However, these post-trained LLMs only encode knowledge up to a cut-off date, necessitating continual…

Computation and Language · Computer Science 2026-02-19 Shankar Padmanabhan , Mustafa Omer Gul , Tanya Goyal

Professional job recommendation involves a complex bipartite matching process that must reconcile a candidate's subjective preference with an employer's objective qualification. While Large Language Models (LLMs) are well-suited for…

Artificial Intelligence · Computer Science 2026-02-04 Bryce Kan , Wei Yang , Emily Nguyen , Ganghui Yi , Bowen Yi , Chenxiao Yu , Yan Liu

Recommender systems help users navigate information overload by providing personalized recommendations aligned with their preferences. Collaborative Filtering (CF) is a widely adopted approach, but while advanced techniques like graph…

Information Retrieval · Computer Science 2024-09-24 Qiyao Ma , Xubin Ren , Chao Huang

Large Language models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities, where a LLM makes predictions for a given test input together with a few input-output pairs (demonstrations). Nevertheless, the inclusion of…

Computation and Language · Computer Science 2024-03-13 Yichuan Li , Xiyao Ma , Sixing Lu , Kyumin Lee , Xiaohu Liu , Chenlei Guo

This paper presents ReasoningRec, a reasoning-based recommendation framework that leverages Large Language Models (LLMs) to bridge the gap between recommendations and human-interpretable explanations. In contrast to conventional…

Information Retrieval · Computer Science 2024-10-31 Millennium Bismay , Xiangjue Dong , James Caverlee

Sequential recommendation methods play a pivotal role in modern recommendation systems. A key challenge lies in accurately modeling user preferences in the face of data sparsity. To tackle this challenge, recent methods leverage contrastive…

Information Retrieval · Computer Science 2024-04-18 Shaowei Wei , Zhengwei Wu , Xin Li , Qintong Wu , Zhiqiang Zhang , Jun Zhou , Lihong Gu , Jinjie Gu

Large Language Models (LLMs) unlearning is crucial for removing hazardous or privacy-leaking information from the model. Practical LLM unlearning demands satisfying multiple challenging objectives simultaneously: removing undesirable…

Machine Learning · Computer Science 2026-04-20 Yisheng Zhong , Sijia Liu , Zhuangdi Zhu

The successful integration of large language models (LLMs) into recommendation systems has proven to be a major breakthrough in recent studies, paving the way for more generic and transferable recommendations. However, LLMs struggle to…

Information Retrieval · Computer Science 2023-11-29 Junyan Qiu , Haitao Wang , Zhaolin Hong , Yiping Yang , Qiang Liu , Xingxing Wang

Retrieval-augmented Large Language Models (LLMs) offer substantial benefits in enhancing performance across knowledge-intensive scenarios. However, these methods often face challenges with complex inputs and encounter difficulties due to…

Computation and Language · Computer Science 2024-10-17 Haoyu Wang , Ruirui Li , Haoming Jiang , Jinjin Tian , Zhengyang Wang , Chen Luo , Xianfeng Tang , Monica Cheng , Tuo Zhao , Jing Gao

Sequential recommender systems (SRS) have become a research hotspot due to its power in modeling user dynamic interests and sequential behavioral patterns. To maximize model expressive ability, a default choice is to apply a larger and…

Information Retrieval · Computer Science 2022-04-12 Lei Chen , Fajie Yuan , Jiaxi Yang , Min Yang , Chengming Li

Recent advances in large language models (LLMs) have enabled agent-based recommendation systems with strong semantic understanding and flexible reasoning capabilities. While LLM-based agents deployed in the cloud offer powerful…

Information Retrieval · Computer Science 2025-09-03 Jing Long , Sirui Huang , Huan Huo , Tong Chen , Hongzhi Yin , Guandong Xu

Large-scale models (LSMs) can be an effective framework for semantic representation and understanding, thereby providing a suitable tool for designing semantic communication (SC) systems. However, their direct deployment is often hindered…

Machine Learning · Computer Science 2025-08-26 Kuiyuan Ding , Caili Guo , Yang Yang , Zhongtian Du , Walid Saad