中文
相关论文

相关论文: Benchmarking Distribution Shift in Tabular Data wi…

200 篇论文

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

机器学习 · 计算机科学 2026-02-10 Ruth Crasto , Esther Rolf

We present TableBank, a new image-based table detection and recognition dataset built with novel weak supervision from Word and Latex documents on the internet. Existing research for image-based table detection and recognition usually…

计算机视觉与模式识别 · 计算机科学 2020-07-07 Minghao Li , Lei Cui , Shaohan Huang , Furu Wei , Ming Zhou , Zhoujun Li

"Effective robustness" measures the extra out-of-distribution (OOD) robustness beyond what can be predicted from the in-distribution (ID) performance. Existing effective robustness evaluations typically use a single test set such as…

机器学习 · 计算机科学 2023-10-31 Zhouxing Shi , Nicholas Carlini , Ananth Balashankar , Ludwig Schmidt , Cho-Jui Hsieh , Alex Beutel , Yao Qin

Many safety-critical applications of machine learning, such as fraud or abuse detection, use data in tabular domains. Adversarial examples can be particularly damaging for these applications. Yet, existing works on adversarial robustness…

机器学习 · 计算机科学 2023-02-27 Klim Kireev , Bogdan Kulynych , Carmela Troncoso

In many real-world applications, researchers aim to deploy models trained in a source domain to a target domain, where obtaining labeled data is often expensive, time-consuming, or even infeasible. While most existing literature assumes…

统计方法学 · 统计学 2025-08-26 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

Pre-trained Language Models have recently emerged in Information Retrieval as providing the backbone of a new generation of neural systems that outperform traditional methods on a variety of tasks. However, it is still unclear to what…

信息检索 · 计算机科学 2023-01-26 Simon Lupart , Thibault Formal , Stéphane Clinchant

Research on adversarial robustness is primarily focused on image and text data. Yet, many scenarios in which lack of robustness can result in serious risks, such as fraud detection, medical diagnosis, or recommender systems often do not…

机器学习 · 计算机科学 2023-12-14 Klim Kireev , Maksym Andriushchenko , Carmela Troncoso , Nicolas Flammarion

Logistic regression models are widely used in the social and behavioral sciences and in high-stakes domains, due to their simplicity and interpretability properties. At the same time, such domains are permeated by distribution shifts, where…

机器学习 · 计算机科学 2025-03-18 Qingshi Sun , Nathan Justin , Andres Gomez , Phebe Vayanos

Machine learning models often encounter distribution shifts when deployed in the real world. In this paper, we focus on adaptation to label distribution shift in the online setting, where the test-time label distribution is continually…

机器学习 · 计算机科学 2022-01-06 Ruihan Wu , Chuan Guo , Yi Su , Kilian Q. Weinberger

Supervised fairness-aware machine learning under distribution shifts is an emerging field that addresses the challenge of maintaining equitable and unbiased predictions when faced with changes in data distributions from source to target…

机器学习 · 计算机科学 2024-05-07 Minglai Shao , Dong Li , Chen Zhao , Xintao Wu , Yujie Lin , Qin Tian

Deep neural networks often produce overconfident predictions, undermining their reliability in safety-critical applications. This miscalibration is further exacerbated under distribution shift, where test data deviates from the training…

计算机视觉与模式识别 · 计算机科学 2025-08-28 Yilin Zhang , Cai Xu , You Wu , Ziyu Guan , Wei Zhao

Generalization remains a central yet unresolved challenge in deep learning, particularly the ability to predict a model's performance beyond its training distribution using quantities available prior to test-time evaluation. Building on the…

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

机器学习 · 统计学 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Tabular foundation models such as TabPFN and TabICL already produce full predictive distributions, yet prevailing regression benchmarks evaluate them almost exclusively via point-estimate metrics (RMSE, $R^2$). This discards precisely the…

人工智能 · 计算机科学 2026-05-05 Jonas Landsgesell , Pascal Knoll , Tizian Wenzel

Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting. Existing CGL approaches typically adopt a task-based formulation, where the data stream is partitioned into a sequence…

机器学习 · 计算机科学 2026-05-15 Guiquan Sun , Xikun Zhang , Jingchao Ni , Dongjin Song

While traditional tree-based ensemble methods have long dominated tabular tasks, deep neural networks and emerging foundation models have challenged this primacy, yet no consensus exists on a universally superior paradigm. Existing…

TabPFN has recently gained attention as a foundation model for tabular datasets, achieving strong performance by leveraging in-context learning on synthetic data. However, we find that TabPFN is vulnerable to label shift, often overfitting…

机器学习 · 计算机科学 2026-05-26 Seunghan Lee

Machine learning models often fail to generalize well under distributional shifts. Understanding and overcoming these failures have led to a research field of Out-of-Distribution (OOD) generalization. Despite being extensively studied for…

As input data distributions evolve, the predictive performance of machine learning models tends to deteriorate. In practice, new input data tend to come without target labels. Then, state-of-the-art techniques model input data distributions…

机器学习 · 计算机科学 2023-09-08 Carlos Mougan , Klaus Broelemann , David Masip , Gjergji Kasneci , Thanassis Thiropanis , Steffen Staab

Uncertainty quantification is essential for the reliable deployment of machine learning models to high-stakes application domains. Uncertainty quantification is all the more challenging when training distribution and test distribution are…

机器学习 · 计算机科学 2022-06-07 Yaodong Yu , Stephen Bates , Yi Ma , Michael I. Jordan