English
Related papers

Related papers: The Limits of Post-Selection Generalization

200 papers

This paper develops a new approach to post-selection inference for screening high-dimensional predictors of survival outcomes. Post-selection inference for right-censored outcome data has been investigated in the literature, but much…

Methodology · Statistics 2021-12-22 Tzu-Jung Huang , Alex Luedtke , Ian W. McKeague

Doubly stochastic learning algorithms are scalable kernel methods that perform very well in practice. However, their generalization properties are not well understood and their analysis is challenging since the corresponding learning…

Machine Learning · Statistics 2018-03-12 Junhong Lin , Lorenzo Rosasco

Decision trees are important both as interpretable models amenable to high-stakes decision-making, and as building blocks of ensemble methods such as random forests and gradient boosting. Their statistical properties, however, are not well…

Machine Learning · Statistics 2021-10-20 Yan Shuo Tan , Abhineet Agarwal , Bin Yu

Many machine learning tasks can be formulated as a stochastic compositional optimization (SCO) problem such as reinforcement learning, AUC maximization, and meta-learning, where the objective function involves a nested composition…

Machine Learning · Computer Science 2023-11-23 Ming Yang , Xiyuan Wei , Tianbao Yang , Yiming Ying

Generalization error predictors (GEPs) aim to predict model performance on unseen distributions by deriving dataset-level error estimates from sample-level scores. However, GEPs often utilize disparate mechanisms (e.g., regressors,…

Machine Learning · Computer Science 2023-05-30 Puja Trivedi , Danai Koutra , Jayaraman J. Thiagarajan

Trained models are often composed with post-hoc transforms such as temperature scaling (TS), ensembling and stochastic weight averaging (SWA) to improve performance, robustness, uncertainty estimation, etc. However, such transforms are…

Machine Learning · Computer Science 2024-10-07 Rishabh Ranjan , Saurabh Garg , Mrigank Raman , Carlos Guestrin , Zachary Lipton

The problem of selecting an algorithm that appears most suitable for a specific instance of an algorithmic problem class, such as the Boolean satisfiability problem, is called instance-specific algorithm selection. Over the past decade, the…

Machine Learning · Computer Science 2021-07-21 Alexander Tornede , Lukas Gehring , Tanja Tornede , Marcel Wever , Eyke Hüllermeier

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai

When writing programs, people have the ability to tackle a new complex task by decomposing it into smaller and more familiar subtasks. While it is difficult to measure whether neural program synthesis methods have similar capabilities, what…

Machine Learning · Computer Science 2023-10-31 Kensen Shi , Joey Hong , Manzil Zaheer , Pengcheng Yin , Charles Sutton

It is becoming increasingly apparent that probabilistic approaches can overcome conservatism and computational complexity of the classical worst-case deterministic framework and may lead to designs that are actually safer. In this paper we…

Applications · Statistics 2008-11-01 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

Machine Learning · Computer Science 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

We study the generalization performance of $\text{full-batch}$ optimization algorithms for stochastic convex optimization: these are first-order methods that only access the exact gradient of the empirical risk (rather than gradients with…

Optimization and Control · Mathematics 2021-07-02 Idan Amir , Yair Carmon , Tomer Koren , Roi Livni

Sorting is one of the most used and well investigated algorithmic problem [1]. Traditional postulation supposes the sorting data archived, and the elementary operation as comparisons of two numbers. In a view of appearance of new processors…

Data Structures and Algorithms · Computer Science 2011-07-22 Hakob Aslanyan

Random Forests are powerful ensemble learning algorithms widely used in various machine learning tasks. However, they have a tendency to overfit noisy or irrelevant features, which can result in decreased generalization performance.…

Machine Learning · Computer Science 2023-06-07 Bastian Pfeifer

Generalization analyses of deep learning typically assume that the training converges to a fixed point. But, recent results indicate that in practice, the weights of deep neural networks optimized with stochastic gradient descent often…

Machine Learning · Computer Science 2022-08-22 Nisha Chandramoorthy , Andreas Loukas , Khashayar Gatmiry , Stefanie Jegelka

This work interprets and generalizes consensus-type algorithms as switching dynamics leading to symmetrization of some vector variables with respect to the actions of a finite group. We show how the symmetrization framework we develop…

Quantum Physics · Physics 2015-06-17 Luca Mazzarella , Francesco Ticozzi , Alain Sarlette

It is a widely believed, though unproven, conjecture that the capability of postselection increases the language recognition power of both probabilistic and quantum polynomial-time computers. It is also unknown whether polynomial-time…

Computational Complexity · Computer Science 2014-04-11 Abuzer Yakaryilmaz , A. C. Cem Say

Learning algorithms need bias to generalize and perform better than random guessing. We examine the flexibility (expressivity) of biased algorithms. An expressive algorithm can adapt to changing training data, altering its outcome based on…

Machine Learning · Statistics 2019-11-13 Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti , George D. Montanez

Existing private synthetic data generation algorithms are agnostic to downstream tasks. However, end users may have specific requirements that the synthetic data must satisfy. Failure to meet these requirements could significantly reduce…

Machine Learning · Computer Science 2023-10-20 Hao Wang , Shivchander Sudalairaj , John Henning , Kristjan Greenewald , Akash Srivastava

The success of machine learning on a given task dependson, among other things, which learning algorithm is selected and its associated hyperparameters. Selecting an appropriate learning algorithm and setting its hyperparameters for a given…

Machine Learning · Computer Science 2014-07-09 Michael R. Smith , Logan Mitchell , Christophe Giraud-Carrier , Tony Martinez