English
Related papers

Related papers: Online Bayesian Imbalanced Learning with Bregman-C…

200 papers

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

Machine Learning · Computer Science 2021-03-15 Alex J. Chan , Mihaela van der Schaar

Machine learning models often encounter distribution shifts when deployed in the real world. In this paper, we focus on adaptation to label distribution shift in the online setting, where the test-time label distribution is continually…

Machine Learning · Computer Science 2022-01-06 Ruihan Wu , Chuan Guo , Yi Su , Kilian Q. Weinberger

Offline Reinforcement Learning (RL) faces distributional shift and unreliable value estimation, especially for out-of-distribution (OOD) actions. To address this, existing uncertainty-based methods penalize the value function with…

Machine Learning · Computer Science 2024-04-10 Xudong Yu , Chenjia Bai , Hongyi Guo , Changhong Wang , Zhen Wang

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Modern systems that rely on Machine Learning (ML) for predictive modelling, may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. This problem is even…

Machine Learning · Computer Science 2021-10-25 Ricardo Barata , Miguel Leite , Ricardo Pacheco , Marco O. P. Sampaio , João Tiago Ascensão , Pedro Bizarro

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

Machine Learning · Computer Science 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

Machine Learning · Computer Science 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan

Recent advances in large pre-trained models showed promising results in few-shot learning. However, their generalization ability on two-dimensional Out-of-Distribution (OoD) data, i.e., correlation shift and diversity shift, has not been…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Lin Zhu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Due to the model aging problem, Deep Neural Networks (DNNs) need updates to adjust them to new data distributions. The common practice leverages incremental learning (IL), e.g., Class-based Incremental Learning (CIL) that updates output…

Machine Learning · Computer Science 2023-04-11 Xuanqi Gao , Juan Zhai , Shiqing Ma , Chao Shen , Yufei Chen , Shiwei Wang

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is…

Machine Learning · Computer Science 2024-03-14 Haowei Lin , Yijia Shao , Weinan Qian , Ningxin Pan , Yiduo Guo , Bing Liu

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

Machine Learning · Computer Science 2025-02-25 Muthu Chidambaram , Rong Ge

The Bayesian inference approach is widely used to tackle inverse problems due to its versatile and natural ability to handle ill-posedness. However, it often faces challenges when dealing with situations involving continuous fields or…

Numerical Analysis · Mathematics 2023-08-28 Xinchao Jiang , Xin Wang , Ziming Wen , Hu Wang

The increased computerization in recent years has resulted in the production of a variety of different software, however measures need to be taken to ensure that the produced software isn't defective. Many researchers have worked in this…

Software Engineering · Computer Science 2023-04-06 Param Khakhar and , Rahul Kumar Dubey

Online Learning (OL) is a field of research that is increasingly gaining attention both in academia and industry. One of the main challenges of OL is the inherent presence of concept drifts, which are commonly defined as unforeseeable…

Machine Learning · Computer Science 2024-07-01 Mauro Dalle Lucca Tosi , Martin Theobald

When applying multi-instance learning (MIL) to make predictions for bags of instances, the prediction accuracy of an instance often depends on not only the instance itself but also its context in the corresponding bag. From the viewpoint of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Tiancheng Lin , Hongteng Xu , Canqian Yang , Yi Xu

Fairness-aware mining of massive data streams is a growing and challenging concern in the contemporary domain of machine learning. Many stream learning algorithms are used to replace humans at critical decision-making points e.g., hiring…

Machine Learning · Computer Science 2022-11-10 Maryam Badar , Marco Fisichella , Vasileios Iosifidis , Wolfgang Nejdl

In order to adhere to regulatory standards governing individual data privacy and safety, machine learning models must systematically eliminate information derived from specific subsets of a user's training data that can no longer be…

Machine Learning · Computer Science 2024-03-26 Subhodip Panda , Shashwat Sourav , Prathosh A. P

Deep neural networks usually perform poorly when the training dataset suffers from extreme class imbalance. Recent studies found that directly training with out-of-distribution data (i.e., open-set samples) in a semi-supervised manner would…

Machine Learning · Computer Science 2022-07-06 Hongxin Wei , Lue Tao , Renchunzi Xie , Lei Feng , Bo An

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

Machine Learning · Computer Science 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

Despite achieving excellent performance on benchmarks, deep neural networks often underperform in real-world deployment due to sensitivity to minor, often imperceptible shifts in input data, known as distributional shifts. These shifts are…

Machine Learning · Computer Science 2025-09-25 Birk Torpmann-Hagen , Pål Halvorsen , Michael A. Riegler , Dag Johansen