English
Related papers

Related papers: An efficient, accurate, and interpretable machine …

200 papers

Penalized regression models are popularly used in high-dimensional data analysis to conduct variable selection and model fitting simultaneously. Whereas success has been widely reported in literature, their performances largely depend on…

Machine Learning · Statistics 2013-12-16 Wei Sun , Junhui Wang , Yixin Fang

In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a…

Numerical Analysis · Mathematics 2021-04-14 Daan Crommelin , Wouter Edeling

In large deep neural networks that seem to perform surprisingly well on many tasks, we also observe a few failures related to accuracy, social biases, and alignment with human values, among others. Therefore, before deploying these models,…

Machine Learning · Computer Science 2024-06-17 Som Sagar , Aditya Taparia , Ransalu Senanayake

This paper develops a new approach to post-selection inference for screening high-dimensional predictors of survival outcomes. Post-selection inference for right-censored outcome data has been investigated in the literature, but much…

Methodology · Statistics 2021-12-22 Tzu-Jung Huang , Alex Luedtke , Ian W. McKeague

The progressive hedging algorithm (PHA) is a cornerstone among algorithms for large-scale stochastic programming problems. However, its traditional implementation is hindered by some limitations, including the requirement to solve all…

Optimization and Control · Mathematics 2025-03-13 Di Zhang , Yihang Zhang , Suvrajeet Sen

We present the efficient implementations of probabilistic deterministic finite automaton learning methods available in FlexFringe. These implement well-known strategies for state-merging including several modifications to improve their…

Machine Learning · Computer Science 2025-10-01 Sicco Verwer , Christian Hammerschmidt

Safe deployment of AI models requires proactive detection of failures to prevent costly errors. To this end, we study the important problem of detecting failures in deep regression models. Existing approaches rely on epistemic uncertainty…

Machine Learning · Computer Science 2024-06-04 Jayaraman J. Thiagarajan , Vivek Narayanaswamy , Puja Trivedi , Rushil Anirudh

Practical model building processes are often time-consuming because many different models must be trained and validated. In this paper, we introduce a novel algorithm that can be used for computing the lower and the upper bounds of model…

Machine Learning · Statistics 2014-02-11 Yoshiki Suzuki , Kohei Ogawa , Yuki Shinmura , Ichiro Takeuchi

We propose a probabilistic enhancement of standard kernel Support Vector Machines for binary classification, in order to address the case when, along with given data sets, a description of uncertainty (e.g., error bounds) may be available…

Machine Learning · Computer Science 2020-03-19 Yongxin Chen , Tryphon T. Georgiou , Allen R. Tannenbaum

We study the sample complexity of stochastic convex optimization when problem parameters, e.g., the distance to optimality, are unknown. We pursue two strategies. First, we develop a reliable model selection method that avoids overfitting…

Machine Learning · Computer Science 2025-06-16 Jared Lawrence , Ari Kalinsky , Hannah Bradfield , Yair Carmon , Oliver Hinder

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

Statistics Theory · Mathematics 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

In this work we study optimization problems subject to a failure constraint. This constraint is expressed in terms of a condition that causes failure, representing a physical or technical breakdown. We formulate the problem in terms of a…

Optimization and Control · Mathematics 2007-08-03 Laetitia Andrieu , Guy Cohen , Felisa Vázquez-Abad

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

Machine learning techniques always aim to reduce the generalized prediction error. In order to reduce it, ensemble methods present a good approach combining several models that results in a greater forecasting capacity. The Random Machines…

Machine Learning · Statistics 2020-03-31 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the…

Machine Learning · Computer Science 2024-07-10 Ping Hu , Virginia Bordignon , Mert Kayaalp , Ali H. Sayed

Banks utilize credit scoring as an important indicator of financial strength and eligibility for credit. Scoring models aim to assign statistical odds or probabilities for predicting if there is a risk of nonpayment in relation to many…

Risk Management · Quantitative Finance 2023-03-10 Oguz Koc , Omur Ugur , A. Sevtap Kestel

Before autonomous systems can be deployed in safety-critical applications, we must be able to understand and verify the safety of these systems. For cases where the risk or cost of real-world testing is prohibitive, we propose a…

Robotics · Computer Science 2023-09-18 Charles Dawson , Chuchu Fan

This paper considers a probabilistic generalization of the $N$-$k$ failure-identification problem in power transmission networks, where the probability of failure of each component in the network is known a priori and the goal of the…

Systems and Control · Computer Science 2021-05-06 Kaarthik Sundar , Carleton Coffrin , Harsha Nagarajan , Russell Bent

In many real-world applications of machine learning classifiers, it is essential to predict the probability of an example belonging to a particular class. This paper proposes a simple technique for predicting probabilities based on…

Machine Learning · Computer Science 2012-06-22 Aditya Menon , Xiaoqian Jiang , Shankar Vembu , Charles Elkan , Lucila Ohno-Machado

In many learning tasks, certain requirements on the processing of individual data samples should arguably be formalized as strict constraints in the underlying optimization problem, rather than by means of arbitrary penalties. We show that,…

Machine Learning · Computer Science 2026-01-26 Francesca Lanzillotta , Chiara Albisani , Davide Pucci , Daniele Baracchi , Alessandro Piva , Matteo Lapucci