English
Related papers

Related papers: Randomized Complexity of Vector-Valued Approximati…

200 papers

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

Motivated by models for multiway comparison data, we consider the problem of estimating a coordinate-wise isotonic function on the domain $[0, 1]^d$ from noisy observations collected on a uniform lattice, but where the design points have…

Statistics Theory · Mathematics 2021-06-25 Ashwin Pananjady , Richard J. Samworth

Combining the techniques of approximation algorithms and parameterized complexity has long been considered a promising research area, but relatively few results are currently known. In this paper we study the parameterized approximability…

Data Structures and Algorithms · Computer Science 2014-02-18 Michael Lampis

We describe a factor-revealing convex optimization problem for the integrality gap of the maximum-cut semidefinite programming relaxation: for each $n \geq 2$ we present a convex optimization problem whose optimal value is the largest…

Optimization and Control · Mathematics 2021-03-24 Fernando Mário de Oliveira Filho , Frank Vallentin

A defective eigenvalue is well documented to be hypersensitive to data perturbations and round-off? errors, making it a formidable challenge in numerical computation particularly when the matrix is known through approximate data. This paper…

Numerical Analysis · Mathematics 2021-03-05 Zhonggang Zeng

Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent…

Optimization and Control · Mathematics 2019-05-29 Joseph E. Gaudio , Travis E. Gibson , Anuradha M. Annaswamy , Michael A. Bolender

We discuss the optimal matching solution for both the assignment problem and the matching problem in one dimension for a large class of convex cost functions. We consider the problem in a compact set with the topology both of the interval…

Disordered Systems and Neural Networks · Physics 2017-10-11 Sergio Caracciolo , Matteo D'Achille , Gabriele Sicuro

Tuning hyperparameters, such as the stepsize, presents a major challenge of training machine learning models. To address this challenge, numerous adaptive optimization algorithms have been developed that achieve near-optimal complexities,…

Optimization and Control · Mathematics 2023-11-07 Florian Hübler , Junchi Yang , Xiang Li , Niao He

We study a generalization of the knapsack problem with geometric and vector constraints. The input is a set of rectangular items, each with an associated profit and $d$ nonnegative weights ($d$-dimensional vector), and a square knapsack.…

Data Structures and Algorithms · Computer Science 2021-02-12 Arindam Khan , Eklavya Sharma , K. V. N. Sreenivas

This paper considers the problem of matrix-variate logistic regression. It derives the fundamental error threshold on estimating low-rank coefficient matrices in the logistic regression problem by obtaining a lower bound on the minimax…

Machine Learning · Computer Science 2022-05-10 Batoul Taki , Mohsen Ghassemi , Anand D. Sarwate , Waheed U. Bajwa

We consider a general statistical learning problem where an unknown fraction of the training data is corrupted. We develop a robust learning method that only requires specifying an upper bound on the corrupted data fraction. The method…

Machine Learning · Statistics 2020-02-10 Muhammad Osama , Dave Zachariah , Peter Stoica

In this paper, we address learning problems for high dimensional data. Previously, oblivious random projection based approaches that project high dimensional features onto a random subspace have been used in practice for tackling…

Machine Learning · Computer Science 2016-12-07 Yi Xu , Haiqin Yang , Lijun Zhang , Tianbao Yang

In this paper, stability and sensitivity properties of a class of parametric constrained optimization problem, whose feasible region is defined by a set-valued inclusion, are investigated through the associated optimal value function.…

Optimization and Control · Mathematics 2024-12-06 Amos Uderzo

Motivated by open problems in applied and computational algebraic topology, we establish multivariate normal approximation theorems for three random vectors which arise organically in the study of random clique complexes. These are: (1) the…

Probability · Mathematics 2022-06-22 Tadas Temčinas , Vidit Nanda , Gesine Reinert

This paper proposes the capped least squares regression with an adaptive resistance parameter, hence the name, adaptive capped least squares regression. The key observation is, by taking the resistant parameter to be data dependent, the…

Methodology · Statistics 2021-07-02 Qiang Sun , Rui Mao , Wen-Xin Zhou

We study lower bounds on adaptive sensing algorithms for recovering low rank matrices using linear measurements. Given an $n \times n$ matrix $A$, a general linear measurement $S(A)$, for an $n \times n$ matrix $S$, is just the inner…

Data Structures and Algorithms · Computer Science 2024-02-21 Praneeth Kacham , David P Woodruff

This paper introduces a novel error estimator for the Proper Generalized Decomposition (PGD) approximation of parametrized equations. The estimator is intrinsically random: It builds on concentration inequalities of Gaussian maps and an…

Numerical Analysis · Mathematics 2019-10-28 Kathrin Smetana , Olivier Zahm

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

We investigate the problem of learning representations that are invariant to certain nuisance or sensitive factors of variation in the data while retaining as much of the remaining information as possible. Our model is based on a…

Machine Learning · Statistics 2017-08-11 Christos Louizos , Kevin Swersky , Yujia Li , Max Welling , Richard Zemel

We consider a stochastic variant of the packing-type integer linear programming problem, which contains random variables in the objective vector. We are allowed to reveal each entry of the objective vector by conducting a query, and the…

Data Structures and Algorithms · Computer Science 2019-03-14 Takanori Maehara , Yutaro Yamaguchi
‹ Prev 1 8 9 10 Next ›