English
Related papers

Related papers: Stratified Expert Cloning for Retention-Aware Reco…

200 papers

Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with large-vocab categorical features, a typical recommender…

Offline reinforcement learning (RL) enables policy optimization from fixed datasets, making it suitable for safety-critical applications where online exploration is infeasible. However, these datasets are often contaminated by adversarial…

Machine Learning · Computer Science 2026-05-19 Shriram Karpoora Sundara Pandian , Ali Baheri

We study a challenging form of Smoothed Online Convex Optimization, a.k.a. SOCO, including multi-step nonlinear switching costs and feedback delay. We propose a novel machine learning (ML) augmented online algorithm, Robustness-Constrained…

Machine Learning · Computer Science 2023-11-01 Pengfei Li , Jianyi Yang , Adam Wierman , Shaolei Ren

Continual fine-tuning of large language models (LLMs) suffers from catastrophic forgetting. Rehearsal-based methods mitigate this problem by retaining a small set of old data. Nevertheless, they still suffer inevitable performance loss.…

Computation and Language · Computer Science 2025-04-10 Zhilin Wang , Yafu Li , Xiaoye Qu , Yu Cheng

Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringing no extra…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-01 Nian Shao , Erfan Loweimi , Xiaofei Li

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

Machine Learning · Computer Science 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt…

Information Retrieval · Computer Science 2025-12-23 Ziqiang Cui , Yunpeng Weng , Xing Tang , Xiaokun Zhang , Shiwei Li , Peiyang Liu , Bowei He , Dugang Liu , Weihong Luo , Xiuqiang He , Chen Ma

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

Information Retrieval · Computer Science 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

In sequential decision-making environments, the primary approaches for training agents are Reinforcement Learning (RL) and Imitation Learning (IL). Unlike RL, which relies on modeling a reward function, IL leverages expert demonstrations,…

Artificial Intelligence · Computer Science 2024-12-11 Jonas Nüßlein , Maximilian Zorn , Philipp Altmann , Claudia Linnhoff-Popien

Students in online courses generate large amounts of data that can be used to personalize the learning process and improve quality of education. In this paper, we present the Latent Skill Embedding (LSE), a probabilistic model of students…

Machine Learning · Computer Science 2016-02-24 Siddharth Reddy , Igor Labutov , Thorsten Joachims

Cloud computing is a reliable solution to provide distributed computation power. However, real-time response is still challenging regarding the enormous amount of data generated by the IoT devices in 5G and 6G networks. Thus, multi-access…

Artificial Intelligence · Computer Science 2022-11-03 Anahita Mazloomi , Hani Sami , Jamal Bentahar , Hadi Otrok , Azzam Mourad

Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) has emerged as the standard post-training paradigm for large language models (LLMs). However, the conventional SFT process, driven by Cross-Entropy (CE) loss, often…

Computation and Language · Computer Science 2026-02-10 Yijie Chen , Yijin Liu , Fandong Meng

Reinforcement learning (RL) has proven effective for fine-tuning large language models (LLMs), significantly enhancing their reasoning abilities in domains such as mathematics and code generation. A crucial factor influencing RL fine-tuning…

Artificial Intelligence · Computer Science 2025-10-31 Xiaoyin Chen , Jiarui Lu , Minsu Kim , Dinghuai Zhang , Jian Tang , Alexandre Piché , Nicolas Gontier , Yoshua Bengio , Ehsan Kamalloo

Meta-reinforcement learning (Meta-RL) facilitates rapid adaptation to unseen tasks but faces challenges in long-horizon environments. Skill-based approaches tackle this by decomposing state-action sequences into reusable skills and…

Machine Learning · Computer Science 2026-05-21 Sanghyeon Lee , Sangjun Bae , Yisak Park , Seungyul Han

[Context] Researchers analyze underground forums to study abuse and cybercrime activities. Due to the size of the forums and the domain expertise required to identify criminal discussions, most approaches employ supervised machine learning…

Social and Information Networks · Computer Science 2023-08-21 Giorgio Di Tizio , Gilberto Atondo Siu , Alice Hutchings , Fabio Massacci

The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable…

Learning generalizable and robust behavior cloning policies requires large volumes of high-quality robotics data. While human demonstrations (e.g., through teleoperation) serve as the standard source for expert behaviors, acquiring such…

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

Machine Learning · Statistics 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz

Recently, distant supervision has gained great success on Fine-grained Entity Typing (FET). Despite its efficiency in reducing manual labeling efforts, it also brings the challenge of dealing with false entity type labels, as distant…

Computation and Language · Computer Science 2019-04-16 Bo Chen , Xiaotao Gu , Yufeng Hu , Siliang Tang , Guoping Hu , Yueting Zhuang , Xiang Ren

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng