English
Related papers

Related papers: Real Negatives Matter: Continuous Training with Re…

200 papers

In industrial recommender systems, conversion rate (CVR) is widely used for traffic allocation, but it fails to fully reflect recommendation effectiveness because it ignores refund behavior. To better capture true user satisfaction and…

Machine Learning · Computer Science 2026-01-30 Mingxuan Luo , Guipeng Xv , Sishuo Chen , Xinyu Li , Li Zhang , Zhangming Chan , Xiang-Rong Sheng , Han Zhu , Jian Xu , Bo Zheng , Chen Lin

In real-world scenarios, risk-averse learning is valuable for mitigating potential adverse outcomes. However, the delayed feedback makes it challenging to assess and manage risk effectively. In this paper, we investigate risk-averse…

Machine Learning · Computer Science 2025-08-06 Siyi Wang , Zifan Wang , Karl Henrik Johansson , Sandra Hirche

The delayed feedback problem is one of the imperative challenges in online advertising, which is caused by the highly diversified feedback delay of a conversion varying from a few minutes to several days. It is hard to design an appropriate…

Machine Learning · Computer Science 2021-08-16 Haoming Li , Feiyang Pan , Xiang Ao , Zhao Yang , Min Lu , Junwei Pan , Dapeng Liu , Lei Xiao , Qing He

Appropriate credit assignment for delay rewards is a fundamental challenge for reinforcement learning. To tackle this problem, we introduce a delay reward calibration paradigm inspired from a classification perspective. We hypothesize that…

Machine Learning · Computer Science 2021-08-26 Yixuan Liu , Hu Wang , Xiaowei Wang , Xiaoyue Sun , Liuyue Jiang , Minhui Xue

In the paper https://doi.org/10.1016/j.physleta.2011.08.072 authors propose a modification of the conventional delayed feedback control algorithm, where time-delay is varied continuously to minimize the power of control force. Minimization…

Adaptation and Self-Organizing Systems · Physics 2020-04-22 Viktor Novičenko

Delayed feedback control is an easy realizable control method which generates control force by comparing the current and the delayed version of the system states. In this paper, a new form of the delayed feedback structure is introduced.…

Systems and Control · Computer Science 2019-02-08 Zahed Dastan , Mahsan Tavakoli-Kakhki

Purpose: Often, the inverse deformation vector field (DVF) is needed together with the corresponding forward DVF in 4D reconstruction and dose calculation, adaptive radiation therapy, and simultaneous deformable registration. This study…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Abhishek Kumar Dubey , Alexandros-Stavros Iliopoulos , Xiaobai Sun , Fang-Fang Yin , Lei Ren

Transfer learning has become a central paradigm in modern machine learning, yet it suffers from the long-standing problem of negative transfer, where leveraging source representations can harm rather than help performance on the target…

Machine Learning · Computer Science 2026-04-28 Yichen Xu , Ryumei Nakada , Linjun Zhang , Lexin Li

Neural networks often learn spurious correlations when exposed to biased training data, leading to poor performance on out-of-distribution data. A biased dataset can be divided, according to biased features, into bias-aligned samples (i.e.,…

Machine Learning · Computer Science 2023-08-17 Rui Hu , Yahan Tu , Jitao Sang

Collaborative filtering (CF), as a standard method for recommendation with implicit feedback, tackles a semi-supervised learning problem where most interaction data are unobserved. Such a nature makes existing approaches highly rely on…

Information Retrieval · Computer Science 2022-07-04 Chenxiao Yang , Qitian Wu , Jipeng Jin , Xiaofeng Gao , Junwei Pan , Guihai Chen

Recent studies in reinforcement learning (RL) have made significant progress by leveraging function approximation to alleviate the sample complexity hurdle for better performance. Despite the success, existing provably efficient algorithms…

Machine Learning · Computer Science 2023-11-07 Nikki Lijing Kuang , Ming Yin , Mengdi Wang , Yu-Xiang Wang , Yi-An Ma

Delays frequently occur in real-world environments, yet standard reinforcement learning (RL) algorithms often assume instantaneous perception of the environment. We study random sensor delays in POMDPs, where observations may arrive…

Machine Learning · Computer Science 2026-04-17 Armin Karamzade , Kyungmin Kim , JB Lanier , Davide Corsi , Roy Fox

Deepfake (DF) detectors face significant challenges when deployed in real-world environments, particularly when encountering test samples deviated from training data through either postprocessing manipulations or distribution shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Dinh-Thuc Nguyen , Nhien-An Le-Khac

There are many algorithms for regret minimisation in episodic reinforcement learning. This problem is well-understood from a theoretical perspective, providing that the sequences of states, actions and rewards associated with each episode…

Machine Learning · Computer Science 2023-04-07 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

In model serving, having one fixed model during the entire often life-long inference process is usually detrimental to model performance, as data distribution evolves over time, resulting in lack of reliability of the model trained on…

Artificial Intelligence · Computer Science 2020-12-16 Yiming Xu , Diego Klabjan

We study reinforcement learning for revenue management with delayed feedback, where a substantial fraction of value is determined by customer cancellations and modifications observed days after booking. We propose…

Machine Learning · Computer Science 2026-02-03 Owen Shen , Patrick Jaillet

We propose that feedback-delayed manual tracking performance is limited by fundamental constraints imposed by the physics of negative group delay. To test this hypothesis, the results of an experiment in which subjects demonstrate both…

Adaptation and Self-Organizing Systems · Physics 2016-06-27 Henning U. Voss , Nigel Stepp

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

Learning from implicit feedback has become the standard paradigm for modern recommender systems. However, this setting is fraught with the persistent challenge of false negatives, where unobserved user-item interactions are not necessarily…

Information Retrieval · Computer Science 2026-01-09 Minglei Yin , Chuanbo Hu , Bin Liu , Neil Zhenqiang Gong , Yanfang , Ye , Xin Li

Spurious correlations in training data significantly hinder the generalization capability of machine learning models when faced with distribution shifts, leading to the proposition of numberous debiasing methods. However, it remains to be…

Machine Learning · Computer Science 2025-05-22 Peng Kuang , Zhibo Wang , Zhixuan Chu , Jingyi Wang , Kui Ren