English
Related papers

Related papers: Model selection for high-dimensional linear regres…

200 papers

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

Sparse signal recovery deals with finding the sparsest solution of an under-determined linear system $\vx = \mQ\vs$. In this paper, we propose a novel greedy approach to addressing the challenges from such a problem. Such an approach is…

Information Theory · Computer Science 2026-04-09 Gang Li , Qiuwei Li , Shuang Li , Wu Angela Li

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

In this paper, we consider the problem of collaboratively estimating the sparsity pattern of a sparse signal with multiple measurement data in distributed networks. We assume that each node makes Compressive Sensing (CS) based measurements…

Information Theory · Computer Science 2012-11-29 Thakshila Wimalajeewa , Pramod K. Varshney

We consider the high-dimensional heteroscedastic regression model, where the mean and the log variance are modeled as a linear combination of input variables. Existing literature on high-dimensional linear regres- sion models has largely…

Machine Learning · Statistics 2012-05-23 Mladen Kolar , James Sharpnack

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

The higher-order orthogonality iteration (HOOI) has been popularly used for finding a best low-multilinear-rank approximation of a tensor. However, its iterate sequence convergence is still an open question. In this paper, we first analyze…

Numerical Analysis · Mathematics 2017-10-10 Yangyang Xu

Online-learning research has mainly been focusing on minimizing one objective function. In many real-world applications, however, several objective functions have to be considered simultaneously. Recently, an algorithm for dealing with…

Machine Learning · Computer Science 2017-03-21 Guy Uziel , Ran El-Yaniv

Occupancy models are typically used to determine the probability of a species being present at a given site while accounting for imperfect detection. The survey data underlying these models often include information on several predictors…

Methodology · Statistics 2016-05-09 Daniel Taylor-Rodriguez , Andrew Womack , Claudio Fuentes , Nikolay Bliznyuk

One of the most important factors that contribute to the success of a machine learning model is a good training objective. Training objective crucially influences the model's performance and generalization capabilities. This paper…

Machine Learning · Computer Science 2022-05-10 Tim Poštuvan , Jiaxuan You , Mohammadreza Banaei , Rémi Lebret , Jure Leskovec

In this paper, we propose an interactive genetic algorithm for solving multi-objective combinatorial optimization problems under preference imprecision. More precisely, we consider problems where the decision maker's preferences over…

Artificial Intelligence · Computer Science 2023-11-13 Nawal Benabbou , Cassandre Leroy , Thibaut Lust

We study sublinear time algorithms for estimating the size of maximum matching in graphs. Our main result is a $(\frac{1}{2}+\Omega(1))$-approximation algorithm which can be implemented in $O(n^{1+\epsilon})$ time, where $n$ is the number…

Data Structures and Algorithms · Computer Science 2022-06-28 Soheil Behnezhad , Mohammad Roghani , Aviad Rubinstein , Amin Saberi

This thesis responds to the challenges of using a large number, such as thousands, of features in regression and classification problems. There are two situations where such high dimensional features arise. One is when high dimensional…

Machine Learning · Statistics 2007-09-20 Longhai Li

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time.…

Optimization and Control · Mathematics 2019-10-23 Yingying Li , Xin Chen , Na Li

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the…

Systems and Control · Electrical Eng. & Systems 2023-07-19 Xiaolong He , Youngsoo Choi , William D. Fries , Jon Belof , Jiun-Shyan Chen

In online learning an algorithm plays against an environment with losses possibly picked by an adversary at each round. The generality of this framework includes problems that are not adversarial, for example offline optimization, or saddle…

Machine Learning · Computer Science 2021-02-04 Ryan D'Orazio , Ruitong Huang

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either…

Machine Learning · Computer Science 2021-02-25 Leo Schwinn , An Nguyen , René Raab , Leon Bungert , Daniel Tenbrinck , Dario Zanca , Martin Burger , Bjoern Eskofier

Recently, high dimensional vector auto-regressive models (VAR), have attracted a lot of interest, due to novel applications in the health, engineering and social sciences. The presence of temporal dependence poses additional challenges to…

Statistics Theory · Mathematics 2022-09-20 Sagnik Halder , George Michailidis

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

An adaptive nonparametric estimation procedure is constructed for heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (oracle inequality) is obtained

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov