English
Related papers

Related papers: Projection predictive variable selection for discr…

200 papers

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Given $m$ $d$-dimensional responsors and $n$ $d$-dimensional predictors, sparse regression finds at most $k$ predictors for each responsor for linear approximation, $1\leq k \leq d-1$. The key problem in sparse regression is subset…

Machine Learning · Computer Science 2020-11-25 Jianji Wang , Qi Liu , Shupei Zhang , Nanning Zheng , Fei-Yue Wang

This paper presents an efficient gradient projection-based method for structural topological optimization problems characterized by a nonlinear objective function which is minimized over a feasible region defined by bilateral bounds and a…

Computational Engineering, Finance, and Science · Computer Science 2020-06-16 Zhi Zeng , Fulei Ma

Conventional methods of estimating latent behaviour generally use attitudinal questions which are subjective and these survey questions may not always be available. We hypothesize that an alternative approach can be used for latent variable…

Machine Learning · Computer Science 2018-09-18 Melvin Wong , Bilal Farooq , Guillaume-Alexandre Bilodeau

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

We develop a Bayesian approach called Bayesian projected calibration to address the problem of calibrating an imperfect computer model using observational data from a complex physical system. The calibration parameter and the physical…

Methodology · Statistics 2019-02-08 Fangzheng Xie , Yanxun Xu

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

Decisions under uncertainty or with multiple objectives usually require the decision maker to formulate a preference regarding risks or trade-offs. If this preference is known, the ordered weighted averaging (OWA) criterion can be applied…

Optimization and Control · Mathematics 2023-08-02 Werner Baak , Marc Goerigk , Michael Hartisch

The effectiveness of projection methods for solving systems of linear inequalities is investigated. It is shown that they have a computational advantage over some alternatives and that this makes them successful in real-world applications.…

Optimization and Control · Mathematics 2009-12-23 Y. Censor , W. Chen , P. L. Combettes , R. Davidi , G. T. Herman

We study system design problems stated as parameterized stochastic programs with a chance-constraint set. We adopt a Bayesian approach that requires the computation of a posterior predictive integral which is usually intractable. In…

Machine Learning · Statistics 2020-01-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent…

We consider data-based predictive control based on behavioral systems theory. In the linear setting this means that a system is described as a subspace of trajectories, and predictive control can be formulated using a projection onto the…

Systems and Control · Electrical Eng. & Systems 2026-04-02 András Sasfi , Jaap Eising , Florian Dörfler

We use Bayesian model selection paradigms, such as group least absolute shrinkage and selection operator priors, to facilitate generalized additive model selection. Our approach allows for the effects of continuous predictors to be…

Methodology · Statistics 2023-09-29 Virginia X. He , Matt P. Wand

Variable selection, or more generally, model reduction is an important aspect of the statistical workflow aiming to provide insights from data. In this paper, we discuss and demonstrate the benefits of using a reference model in variable…

Methodology · Statistics 2020-04-29 Federico Pavone , Juho Piironen , Paul-Christian Bürkner , Aki Vehtari

In the framework of online convex optimization, most iterative algorithms require the computation of projections onto convex sets, which can be computationally expensive. To tackle this problem HK12 proposed the study of projection-free…

Machine Learning · Computer Science 2022-12-16 Zhou Lu , Nataly Brukhim , Paula Gradu , Elad Hazan

We propose a novel projection-based particle method for solving the McKean-Vlasov stochastic differential equations. Our approach is based on a projection-type estimation of the marginal density of the solution in each time step. The…

Numerical Analysis · Mathematics 2018-08-07 Denis Belomestny , John Schoenmakers

Projection methods aim to reduce the dimensionality of the optimization instance, thereby improving the scalability of high-dimensional problems. Recently, Sakaue and Oki proposed a data-driven approach for linear programs (LPs), where the…

Optimization and Control · Mathematics 2025-11-18 Anh Tuan Nguyen , Viet Anh Nguyen

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Aggregation methods have emerged as a powerful and flexible framework in statistical learning, providing unified solutions across diverse problems such as regression, classification, and density estimation. In the context of generalized…

Statistics Theory · Mathematics 2025-04-15 The Tien Mai
‹ Prev 1 4 5 6 7 8 10 Next ›