English
Related papers

Related papers: Numerical optimization for the compatibility const…

200 papers

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

Statistics Theory · Mathematics 2016-06-23 Darren Homrighausen , Daniel J. McDonald

This paper presents a methodology for using varying sample sizes in sequential quadratic programming (SQP) methods for solving equality constrained stochastic optimization problems. The first part of the paper deals with the delicate issue…

Optimization and Control · Mathematics 2023-03-23 Albert S. Berahas , Raghu Bollapragada , Baoyu Zhou

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

In this paper, we consider the computational protein design (CPD) problem, which is usually modeled as a 0/1 programming and is extremely challenging due to its combinatorial properties. We propose an efficient algorithm for solving it.…

Optimization and Control · Mathematics 2024-12-30 Yukai Zheng , Weikun Chen , Qingna Li

Predicting the final folded structure of protein molecules and simulating their folding pathways is of crucial importance for designing viral drugs and studying diseases such as Alzheimer's at the molecular level. To this end, this paper…

Systems and Control · Electrical Eng. & Systems 2021-04-28 Alireza Mohammadi , Mark W. Spong

When Model Predictive Control (MPC) is used in real-time to control linear systems, quadratic programs (QPs) need to be solved within a limited time frame. Recently, several parametric methods have been proposed that certify the number of…

Optimization and Control · Mathematics 2022-11-24 Daniel Arnström , Daniel Axehill

In this paper, we consider lasso problems with zero-sum constraint, commonly required for the analysis of compositional data in high-dimensional spaces. A novel algorithm is proposed to solve these problems, combining a tailored active-set…

Optimization and Control · Mathematics 2022-09-26 Andrea Cristofari

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

Statistics Theory · Mathematics 2013-11-04 Adel Javanmard , Andrea Montanari

The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a…

Machine Learning · Statistics 2017-07-21 Cheryl J. Flynn , Clifford M. Hurvich , Jeffrey S. Simonoff

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

Quadratically constrained quadratic programs (QCQPs) are ubiquitous in optimization: Such problems arise in applications from operations research, power systems, signal processing, chemical engineering, and portfolio theory, among others.…

Optimization and Control · Mathematics 2026-03-31 Muge Dedeoglu , Buket Ozen , Burak Kocuk

Quadratic programming (QP) is a common and important constrained optimization problem. Here, we derive a surprising duality between constrained optimization with inequality constraints -- of which QP is a special case -- and consumer…

Statistical Mechanics · Physics 2019-05-22 Pankaj Mehta , Wenping Cui , Ching-Hao Wang , Robert Marsland

This paper presents a convex optimization-based solution to the design of state-feedback controllers for solving the linear quadratic regulator (LQR) problem of uncertain discrete-time systems with multiplicative noise. To synthesize a…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Majid Mazouchi , Farzaneh Tatari , Hamidreza Modares

Studies on simulation input uncertainty often built on the availability of input data. In this paper, we investigate an inverse problem where, given only the availability of output data, we nonparametrically calibrate the input models and…

Optimization and Control · Mathematics 2018-01-09 Aleksandrina Goeva , Henry Lam , Huajie Qian , Bo Zhang

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

Statistics Theory · Mathematics 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

Symmetry is the essential element of lifted inference that has recently demon- strated the possibility to perform very efficient inference in highly-connected, but symmetric probabilistic models models. This raises the question, whether…

Artificial Intelligence · Computer Science 2016-06-15 Martin Mladenov , Leonard Kleinhans , Kristian Kersting

Inverse linear programming (LP) has received increasing attention due to its potential to generate efficient optimization formulations that can closely replicate the behavior of a complex system. However, inversely inferred parameters and…

Optimization and Control · Mathematics 2022-02-22 Zahed Shahmoradi , Taewoo Lee

Conformal prediction is a model-free machine learning method for constructing prediction regions at a guaranteed coverage probability level. However, a data scientist often faces three challenges in practice: (i) the determination of a…

Machine Learning · Statistics 2026-03-31 Liang Hong , Noura Raydan Nasreddine

In this paper, we derive non-asymptotic error bounds for the Lasso estimator when the penalty parameter for the estimator is chosen using $K$-fold cross-validation. Our bounds imply that the cross-validated Lasso estimator has nearly…

Statistics Theory · Mathematics 2020-02-07 Denis Chetverikov , Zhipeng Liao , Victor Chernozhukov