English
Related papers

Related papers: Comprehensive OOS Evaluation of Predictive Algorit…

200 papers

Prior work typically describes out-of-domain (OOD) or out-of-distribution (OODist) samples as those that originate from dataset(s) or source(s) different from the training set but for the same task. When compared to in-domain (ID) samples,…

Computation and Language · Computer Science 2023-06-05 Rhitabrat Pokharel , Ameeta Agrawal

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to…

Machine Learning · Computer Science 2022-09-09 Haoling Li , Jie Song , Mengqi Xue , Haofei Zhang , Jingwen Ye , Lechao Cheng , Mingli Song

The detection of semantic and covariate out-of-distribution (OOD) examples is a critical yet overlooked challenge in digital pathology (DP). Recently, substantial insight and methods on OOD detection were presented by the ML community, but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Ji-Hun Oh , Kianoush Falahkheirkhah , Rohit Bhargava

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Driven by the rapid expansion of e-commerce and small-batch production, the size of the intralogistics load unit of finished goods, semi-finished goods and raw materials is steadily shrinking. Totes are gradually replacing pallets as the…

Robotics · Computer Science 2026-05-28 Jiaxin Liu , Peng Yang , Yuping Li , Xinyue Xie

We present efforts in the fields of machine learning and time series forecasting to accurately predict counts of future suspected opioid overdoses recorded by Emergency Medical Services (EMS) in the state of Kentucky. Forecasts help…

Classical model selection seeks to find a single model within a particular class that optimizes some pre-specified criteria, such as maximizing a likelihood or minimizing a risk. More recently, there has been an increased interest in model…

Methodology · Statistics 2025-11-17 Ryan Cecil , Lucas Mentch

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

Dimensionality reduction (DR) is a well-established approach for the visualization of high-dimensional data sets. While DR methods are often applied to typical DR benchmark data sets in the literature, they might suffer from high runtime…

Machine Learning · Computer Science 2024-08-09 Luca Reichmann , David Hägele , Daniel Weiskopf

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

Machine Learning · Computer Science 2026-01-30 Chen Cheng , Ang Li

In this paper we introduce a new classification algorithm called Optimization of Distributions Differences (ODD). The algorithm aims to find a transformation from the feature space to a new space where the instances in the same class are as…

Machine Learning · Computer Science 2017-03-06 Mohammad Reza Bonyadi , Quang M. Tieng , David C. Reutens

Perhaps surprisingly, recent studies have shown probabilistic model likelihoods have poor specificity for out-of-distribution (OOD) detection and often assign higher likelihoods to OOD data than in-distribution data. To ameliorate this…

Though Self-supervised learning (SSL) has been widely studied as a promising technique for representation learning, it doesn't generalize well on long-tailed datasets due to the majority classes dominating the feature space. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jianhong Bai , Zuozhu Liu , Hualiang Wang , Jin Hao , Yang Feng , Huanpeng Chu , Haoji Hu

In open set recognition (OSR), almost all existing methods are designed specially for recognizing individual instances, even these instances are collectively coming in batch. Recognizers in decision either reject or categorize them to some…

Machine Learning · Computer Science 2020-03-24 Chuanxing Geng , Songcan Chen

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

We consider a model of selective prediction, where the prediction algorithm is given a data sequence in an online fashion and asked to predict a pre-specified statistic of the upcoming data points. The algorithm is allowed to choose when to…

Machine Learning · Computer Science 2019-05-30 Mingda Qiao , Gregory Valiant

This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict expected tactical descriptions of operational solutions (TDOSs). The…

Machine Learning · Computer Science 2022-06-10 Eric Larsen , Sébastien Lachapelle , Yoshua Bengio , Emma Frejinger , Simon Lacoste-Julien , Andrea Lodi

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

The Markov decision process (MDP) formulation used to model many real-world sequential decision making problems does not efficiently capture the setting where the set of available decisions (actions) at each time step is stochastic.…

Machine Learning · Computer Science 2020-01-22 Yash Chandak , Georgios Theocharous , Blossom Metevier , Philip S. Thomas

High-dimensional regression specification and analysis is a complex and active area of research in statistics, machine learning, and econometrics. This paper proposes a new approach, Boosting with Multiple Testing (BMT), which combines…

Econometrics · Economics 2026-02-24 George Kapetanios , Vasilis Sarafidis , Alexia Ventouri