English
Related papers

Related papers: Optimal Reconstruction from Linear Queries

200 papers

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and…

Machine Learning · Statistics 2023-09-07 Hugo Cui , Florent Krzakala , Lenka Zdeborová

This work studies linear bandits under a new notion of gap-adjusted misspecification and is an extension of Liu et al. (2023). When the underlying reward function is not linear, existing linear bandits work usually relies on a uniform…

Machine Learning · Computer Science 2025-01-10 Chong Liu , Dan Qiao , Ming Yin , Ilija Bogunovic , Yu-Xiang Wang

We study the framework of universal dynamic regret minimization with strongly convex losses. We answer an open problem in Baby and Wang 2021 by showing that in a proper learning setup, Strongly Adaptive algorithms can achieve the near…

Machine Learning · Computer Science 2022-01-25 Dheeraj Baby , Yu-Xiang Wang

Automated three-dimensional (3D) object reconstruction is the task of building a geometric representation of a physical object by means of sensing its surface. Even though new single view reconstruction techniques can predict the surface,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 J. Irving Vasquez-Gomez , David Troncoso , Israel Becerra , Enrique Sucar , Rafael Murrieta-Cid

We study the minimum diameter problem for a set of inexact points. By inexact, we mean that the precise location of the points is not known. Instead, the location of each point is restricted to a contineus region ($\impre$ model) or a…

Computational Geometry · Computer Science 2017-04-03 Mohammad Ghodsi , Hamid Homapour , Masoud Seddighin

The Johnson-Lindenstrauss (JL) lemma is a fundamental result in dimensionality reduction, ensuring that any finite set $X \subseteq \mathbb{R}^d$ can be embedded into a lower-dimensional space $\mathbb{R}^k$ while approximately preserving…

Probability · Mathematics 2025-10-30 Rafael Chiclana , Mark Iwen

This paper addresses a class of problems under interval data uncertainty composed of min-max regret versions of classical 0-1 optimization problems with interval costs. We refer to them as interval 0-1 min-max regret problems. The…

Data Structures and Algorithms · Computer Science 2020-01-07 Lucas Assunção , Andréa Cynthia Santos , Thiago F. Noronha , Rafael Andrade

In transfer learning, the learner leverages auxiliary data to improve generalization on a main task. However, the precise theoretical understanding of when and how auxiliary data help remains incomplete. We provide new insights on this…

Machine Learning · Computer Science 2026-03-31 Meitong Liu , Christopher Jung , Rui Li , Xue Feng , Han Zhao

We study the problem of $(\epsilon,\delta)$-differentially private learning of linear predictors with convex losses. We provide results for two subclasses of loss functions. The first case is when the loss is smooth and non-negative but not…

Machine Learning · Computer Science 2024-03-07 Raman Arora , Raef Bassily , Cristóbal Guzmán , Michael Menart , Enayat Ullah

In the framework of multidimensional Compressed Sensing (CS), we introduce an analytical reconstruction formula that allows one to recover an $N$th-order $(I_1\times I_2\times \cdots \times I_N)$ data tensor $\underline{\mathbf{X}}$ from a…

Information Theory · Computer Science 2015-06-19 Cesar F. Caiafa , Andrzej Cichocki

The problem of determining three-dimensional density fields from single two-dimensional projections is hopelessly underdetermined without additional assumptions. While parameterized inversions are typically used to solve this problem, we…

Dynamical Systems · Mathematics 2007-05-23 Kevin R. Vixie , Gary L. Sandine

In the Random Subset Sum Problem, given $n$ i.i.d. random variables $X_1, ..., X_n$, we wish to approximate any point $z \in [-1,1]$ as the sum of a suitable subset $X_{i_1(z)}, ..., X_{i_s(z)}$ of them, up to error $\varepsilon$. Despite…

Neural and Evolutionary Computing · Computer Science 2022-11-18 Luca Becchetti , Arthur Carvalho Walraven da Cunha , Andrea Clementi , Francesco d'Amore , Hicham Lesfari , Emanuele Natale , Luca Trevisan

A line of work has looked at the problem of recovering an input from distance queries. In this setting, there is an unknown sequence $s \in \{0,1\}^{\leq n}$, and one chooses a set of queries $y \in \{0,1\}^{\mathcal{O}(n)}$ and receives…

Data Structures and Algorithms · Computer Science 2023-08-15 Zhuangfei Hu , Xinda Li , David P. Woodruff , Hongyang Zhang , Shufan Zhang

Linear regression studies the problem of estimating a model parameter $\beta^* \in \mathbb{R}^p$, from $n$ observations $\{(y_i,\mathbf{x}_i)\}_{i=1}^n$ from linear model $y_i = \langle \mathbf{x}_i,\beta^* \rangle + \epsilon_i$. We…

Machine Learning · Statistics 2015-05-14 Xinyang Yi , Zhaoran Wang , Constantine Caramanis , Han Liu

We consider the limits of super-resolution using imaging constraints. Due to various theoretical and practical limitations, reconstruction-based methods have been largely restricted to small increases in resolution. In addition, motion-blur…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Gabby Litterio , Juan-David Lizarazo-Ferro , Pedro Felzenszwalb , Rashid Zia

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

Linear regression is a basic and widely-used methodology in data analysis. It is known that some quantum algorithms efficiently perform least squares linear regression of an exponentially large data set. However, if we obtain values of the…

Quantum Physics · Physics 2021-08-27 Kazuya Kaneko , Koichi Miyamoto , Naoyuki Takeda , Kazuyoshi Yoshino

Resolving a linear combination of point sources from their band-limited Fourier data is a fundamental problem in imaging and signal processing. With the incomplete Fourier data and the inevitable noise in the measurement, there is a…

Image and Video Processing · Electrical Eng. & Systems 2021-10-27 Ping Liu , Hai Zhang

We identify a universal structural principle underlying the smoothing of classical divergences: the optimizer of the smoothing problem is a clipped probability vector, independently of the specific divergence. This yields a…

Quantum Physics · Physics 2026-03-24 Gilad Gour

We consider approximation of diameter of a set $S$ of $n$ points in dimension $m$. E$\tilde{g}$ecio$\tilde{g}$lu and Kalantari \cite{kal} have shown that given any $p \in S$, by computing its farthest in $S$, say $q$, and in turn the…

Computational Geometry · Computer Science 2014-10-09 Sharareh Alipour , Bahman Kalantari , Hamid Homapour