English
Related papers

Related papers: Distribution Shift Aware Neural Tabular Learning

200 papers

Deep reinforcement learning (DRL) has significantly advanced the field of combinatorial optimization (CO). However, its practicality is hindered by the necessity for a large number of reward evaluations, especially in scenarios involving…

Machine Learning · Computer Science 2024-07-18 Hyeonah Kim , Minsu Kim , Sungsoo Ahn , Jinkyoo Park

While tabular machine learning has achieved remarkable success, temporal distribution shifts pose significant challenges in real-world deployment, as the relationships between features and labels continuously evolve. Static models assume…

Machine Learning · Computer Science 2025-12-04 Hao-Run Cai , Han-Jia Ye

Deep learning models often rely only on a small set of features even when there is a rich set of predictive signals in the training data. This makes models brittle and sensitive to distribution shifts. In this work, we first examine vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Armand Mihai Nicolicioiu , Andrei Liviu Nicolicioiu , Bogdan Alexe , Damien Teney

Unsupervised domain adaptation (UDA) aims to leverage the knowledge learned from labeled source domains to improve performance on the unlabeled target domains. While Convolutional Neural Networks (CNNs) have been dominant in previous UDA…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Xiaowei Yu , Zhe Huang , Zao Zhang

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

Machine Learning · Computer Science 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

Ensuring fairness in machine learning remains a significant challenge, as models often inherit biases from their training data. Generative models have recently emerged as a promising approach to mitigate bias at the data level while…

Machine Learning · Computer Science 2025-09-25 Emmanouil Panagiotou , Benoît Ronval , Arjun Roy , Ludwig Bothmann , Bernd Bischl , Siegfried Nijssen , Eirini Ntoutsi

Given a CNF formula and a weight for each assignment of values to variables, two natural problems are weighted model counting and distribution-aware sampling of satisfying assignments. Both problems have a wide variety of important…

Artificial Intelligence · Computer Science 2014-04-14 Supratik Chakraborty , Daniel J. Fremont , Kuldeep S. Meel , Sanjit A. Seshia , Moshe Y. Vardi

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Muhammad Ahmad , Francesco Mauro , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

Adversarial training has proven to be a highly effective method for improving the robustness of deep neural networks against adversarial attacks. Nonetheless, it has been observed to exhibit a limitation in terms of robust fairness,…

Machine Learning · Computer Science 2025-01-09 Hongxin Zhi , Hongtao Yu , Shaome Li , Xiuming Zhao , Yiteng Wu

Improving the classification of multi-class imbalanced data is more difficult than its two-class counterpart. In this paper, we use deep neural networks to train new representations of tabular multi-class data. Unlike the typically…

Machine Learning · Computer Science 2023-12-19 Damian Horna , Lango Mateusz , Jerzy Stefanowski

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

The world we see is ever-changing and it always changes with people, things, and the environment. Domain is referred to as the state of the world at a certain moment. A research problem is characterized as transfer adaptation learning (TAL)…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Lei Zhang , Xinbo Gao

Deep Reinforcement Learning (DRL) has emerged as a promising approach for solving Combinatorial Optimization (CO) problems, such as the 3D Bin Packing Problem (3D-BPP), Traveling Salesman Problem (TSP), or Vehicle Routing Problem (VRP), but…

Machine Learning · Computer Science 2026-01-30 Han Fang , Paul Weng , Yutong Ban

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Algorithm unrolling has emerged as a learning-based optimization paradigm that unfolds truncated iterative algorithms in trainable neural-network optimizers. We introduce Stochastic UnRolled Federated learning (SURF), a method that expands…

Machine Learning · Computer Science 2024-02-08 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

Machine Learning · Computer Science 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

In practical machine learning, the environments encountered during the model development and deployment phases often differ, especially when a model is used by many users in diverse settings. Learning models that maintain reliable…

Machine Learning · Statistics 2026-03-18 Hiroyuki Hanada , Satoshi Akahane , Noriaki Hashimoto , Shion Takeno , Ichiro Takeuchi