English
Related papers

Related papers: $\lambda$-Regularized A-Optimal Design and its App…

200 papers

The approximation ratio has become one of the dominant measures in mechanism design problems. In light of analysis of algorithms, we define the \emph{smoothed approximation ratio} to compare the performance of the optimal mechanism and a…

Computer Science and Game Theory · Computer Science 2017-06-23 Xiaotie Deng , Yansong Gao , Jie Zhang

In this paper, we study the problem of approximating the minimum cut in a distributed message-passing model, the CONGEST model. The minimum cut problem has been well-studied in the context of centralized algorithms. However, there were no…

Data Structures and Algorithms · Computer Science 2014-01-22 Hsin-Hao Su

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

Methodology · Statistics 2023-11-16 Haohui Han , Liya Fu

We propose an optimal experimental design for a curvilinear regression model that minimizes the band-width of simultaneous confidence bands. Simultaneous confidence bands for curvilinear regression are constructed by evaluating the volume…

Statistics Theory · Mathematics 2019-04-02 Satoshi Kuriki , Henry P. Wynn

This paper presents a randomized algorithm for computing the near-optimal low-rank dynamic mode decomposition (DMD). Randomized algorithms are emerging techniques to compute low-rank matrix approximations at a fraction of the cost of…

Numerical Analysis · Mathematics 2019-11-28 N. Benjamin Erichson , Lionel Mathelin , Steven L. Brunton , J. Nathan Kutz

Differentially private computation often begins with a bound on some $d$-dimensional statistic's $\ell_p$ sensitivity. For pure differential privacy, the $K$-norm mechanism can improve on this approach using a norm tailored to the…

Cryptography and Security · Computer Science 2024-05-22 Matthew Joseph , Alexander Yu

Motivated by machine learning applications in networks of sensors, internet-of-things (IoT) devices, and autonomous agents, we propose techniques for distributed stochastic convex learning from high-rate data streams. The setup involves a…

Machine Learning · Statistics 2019-06-11 Matthew Nokleby , Waheed U. Bajwa

The truncated singular value decomposition (SVD) of the measurement matrix is the optimal solution to the_representation_ problem of how to best approximate a noisy measurement matrix using a low-rank matrix. Here, we consider the…

Statistics Theory · Mathematics 2014-04-21 Raj Rao Nadakuditi

In the problem of online unweighted interval selection, the objective is to maximize the number of non-conflicting intervals accepted by the algorithm. In the conventional online model of irrevocable decisions, there is an Omega(n) lower…

Data Structures and Algorithms · Computer Science 2025-06-03 Allan Borodin , Christodoulos Karavasilis

We consider the problem of reconstructing an unknown function $u\in L^2(D,\mu)$ from its evaluations at given sampling points $x^1,\dots,x^m\in D$, where $D\subset \mathbb R^d$ is a general domain and $\mu$ a probability measure. The…

Numerical Analysis · Mathematics 2020-10-29 Albert Cohen , Matthieu Dolbeault

In this article we study some optimal design problems related to nonstandard growth eigenvalues ruled by the $g-$Laplacian operator. More precisely, given $\Omega\subset \R^n$ and $\alpha,c>0$ we consider the optimization problem $\inf \{…

Analysis of PDEs · Mathematics 2022-09-02 Ariel Salort , Belem Schvager , Analía Silva

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

Optimization and Control · Mathematics 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

In the contextual linear bandit setting, algorithms built on the optimism principle fail to exploit the structure of the problem and have been shown to be asymptotically suboptimal. In this paper, we follow recent approaches of deriving…

Machine Learning · Computer Science 2020-11-23 Andrea Tirinzoni , Matteo Pirotta , Marcello Restelli , Alessandro Lazaric

We propose a new randomized algorithm for solving L2-regularized least-squares problems based on sketching. We consider two of the most popular random embeddings, namely, Gaussian embeddings and the Subsampled Randomized Hadamard Transform…

Machine Learning · Computer Science 2020-10-26 Jonathan Lacotte , Mert Pilanci

In recent years methods from optimal linear experimental design have been leveraged to obtain state of the art results for linear bandits. A design returned from an objective such as $G$-optimal design is actually a probability distribution…

Machine Learning · Computer Science 2021-05-13 Romain Camilleri , Julian Katz-Samuels , Kevin Jamieson

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

We propose an automatic parameter selection strategy for the problem of image super-resolution for images corrupted by blur and additive white Gaussian noise with unknown standard deviation. The proposed approach exploits the structure of…

Numerical Analysis · Mathematics 2021-08-31 Monica Pragliola , Luca Calatroni , Alessandro Lanza , Fiorella Sgallari

In experimental design, we are given $n$ vectors in $d$ dimensions, and our goal is to select $k\ll n$ of them to perform expensive measurements, e.g., to obtain labels/responses, for a linear regression task. Many statistical criteria have…

Machine Learning · Computer Science 2019-06-11 Michał Dereziński , Feynman Liang , Michael W. Mahoney

Sampling-based motion planning has emerged as a powerful approach for robotics, enabling exploration of complex, high-dimensional configuration spaces. When combined with Signal Temporal Logic (STL), a temporal logic widely used for…

Robotics · Computer Science 2026-02-20 Ahmad Ahmad , Shuo Liu , Roberto Tron , Calin Belta

We study stochastic nonconvex optimization under heavy-tailed noise. In this setting, the stochastic gradients only have bounded $p$-th central moment ($p$-BCM) for some $p \in (1,2]$. Building on the foundational work of Arjevani et al.…

Optimization and Control · Mathematics 2026-04-01 Adrien Fradin , Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik