English
Related papers

Related papers: Max-min Learning of Approximate Weight Matrices fr…

200 papers

We investigate the use of Minimax distances to extract in a nonparametric way the features that capture the unknown underlying patterns and structures in the data. We develop a general-purpose and computationally efficient framework to…

Machine Learning · Computer Science 2023-01-02 Morteza Haghir Chehreghani

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

We investigate quasi-Newton methods for minimizing a strictly convex quadratic function which is subject to errors in the evaluation of the gradients. The methods all give identical behavior in exact arithmetic, generating minimizers of…

Optimization and Control · Mathematics 2025-02-26 Shen Peng , Gianpiero Canessa , David Ek , Anders Forsgren

We consider the problem of approximating the reachable set of a discrete-time polynomial system from a semialgebraic set of initial conditions under general semialgebraic set constraints. Assuming inclusion in a given simple set like a box…

Optimization and Control · Mathematics 2019-06-06 Victor Magron , Pierre-Loic Garoche , Didier Henrion , Xavier Thirioux

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

The closest vector problem (CVP) and shortest (nonzero) vector problem (SVP) are the core algorithmic problems on Euclidean lattices. They are central to the applications of lattices in many problems of communications and cryptography.…

Information Theory · Computer Science 2016-11-17 Laura Luzzi , Damien Stehle , Cong Ling

The problem of estimating a random vector x from noisy linear measurements y = A x + w with unknown parameters on the distributions of x and w, which must also be learned, arises in a wide range of statistical learning and linear inverse…

Information Theory · Computer Science 2017-06-20 Alyson K. Fletcher , Mojtaba Sahraee-Ardakan , Philip Schniter , Sundeep Rangan

We propose a data-driven algorithm for the maximum a posteriori (MAP) estimation of stochastic processes from noisy observations. The primary statistical properties of the sought signal is specified by the penalty function (i.e., negative…

Machine Learning · Computer Science 2018-02-14 Ha Q. Nguyen , Emrah Bostan , Michael Unser

Many metric learning tasks, such as triplet learning, nearest neighbor retrieval, and visualization, are treated primarily as embedding tasks where the ultimate metric is some variant of the Euclidean distance (e.g., cosine or Mahalanobis),…

Machine Learning · Computer Science 2023-11-22 Fred Lu , Edward Raff , Francis Ferraro

Consider the task of locating an unknown target point using approximate distance queries: in each round, a reconstructor selects a query point and receives a noisy version of its distance to the target. This problem arises naturally in…

Machine Learning · Computer Science 2025-11-11 Shay Moran , Elizaveta Nesterova

The Chebyshev or $\ell_{\infty}$ estimator is an unconventional alternative to the ordinary least squares in solving linear regressions. It is defined as the minimizer of the $\ell_{\infty}$ objective function \begin{align*}…

Statistics Theory · Mathematics 2023-03-16 Yufei Yi , Matey Neykov

In this paper, we derive optimality conditions (Chebyshev approximation) for multivariate functions. The theory of Chebyshev (uniform) approximation for univariate functions is very elegant. The optimality conditions are based on the notion…

Optimization and Control · Mathematics 2015-10-22 Nadezda Sukhorukova , Julien Ugon , David Yost

Linear matrix inequalities (LMIs) are ubiquitous in modern control theory, as well as in a variety of other fields in science and engineering. Their analytic centers, i.e. the maximum determinant elements of the feasible set spanned by…

Optimization and Control · Mathematics 2022-02-28 Biel Roig-Solvas , Mario Sznaier

Computation of the trace of a matrix function plays an important role in many scientific computing applications, including applications in machine learning, computational physics (e.g., lattice quantum chromodynamics), network analysis and…

Data Structures and Algorithms · Computer Science 2017-03-10 Insu Han , Dmitry Malioutov , Haim Avron , Jinwoo Shin

This work investigates the problem of estimating the weight matrices of a stable time-invariant linear dynamical system from a single sequence of noisy measurements. We show that if the unknown weight matrices describing the system are in…

Machine Learning · Computer Science 2021-02-24 Navid Reyhanian , Jarvis Haupt

Both unconstrained and constrained minimax single facility location problems are considered in multidimensional space with Chebyshev distance. A new solution approach is proposed within the framework of idempotent algebra to reduce the…

Optimization and Control · Mathematics 2012-10-18 Nikolai Krivulin

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

Machine Learning · Computer Science 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Recent progress in few-shot learning promotes a more realistic cross-domain setting, where the source and target datasets are from different domains. Due to the domain gap and disjoint label spaces between source and target datasets, their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Pan Li , Shaogang Gong , Chengjie Wang , Yanwei Fu

Deep metric learning is essential for visual recognition. The widely used pair-wise (or triplet) based loss objectives cannot make full use of semantical information in training samples or give enough attention to those hard samples during…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Lin Xu , Han Sun , Yuai Liu

In this paper, we study meta learning for support (i.e., the set of non-zero entries) recovery in high-dimensional precision matrix estimation where we reduce the sufficient sample complexity in a novel task with the information learned…

Machine Learning · Computer Science 2021-07-07 Qian Zhang , Yilin Zheng , Jean Honorio