English
Related papers

Related papers: Sample-Optimal Density Estimation in Nearly-Linear…

200 papers

We define a novel, basic, unsupervised learning problem - learning the lowest density homogeneous hyperplane separator of an unknown probability distribution. This task is relevant to several problems in machine learning, such as…

Machine Learning · Computer Science 2009-01-22 Shai Ben-David , Tyler Lu , David Pal , Miroslava Sotakova

Mixture models are regularly used in density estimation applications, but the problem of estimating the mixing distribution remains a challenge. Nonparametric maximum likelihood produce estimates of the mixing distribution that are…

Computation · Statistics 2019-06-28 Minwoo Chae , Ryan Martin , Stephen G. Walker

We study the estimation of distributional parameters when samples are shown only if they fall in some unknown set $S \subseteq \mathbb{R}^d$. Kontonis, Tzamos, and Zampetakis (FOCS'19) gave a $d^{\mathrm{poly}(1/\varepsilon)}$ time…

Statistics Theory · Mathematics 2026-05-12 Jane H. Lee , Anay Mehrotra , Manolis Zampetakis

We revisit the optimization from samples (OPS) model, which studies the problem of optimizing objective functions directly from the sample data. Previous results showed that we cannot obtain a constant approximation ratio for the maximum…

Machine Learning · Computer Science 2020-07-07 Wei Chen , Xiaoming Sun , Jialin Zhang , Zhijie Zhang

Many popular learning algorithms (E.g. Regression, Fourier-Transform based algorithms, Kernel SVM and Kernel ridge regression) operate by reducing the problem to a convex optimization problem over a vector space of functions. These methods…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

This article presents uniform random generators of plane partitions according to the size (the number of cubes in the 3D interpretation). Combining a bijection of Pak with the method of Boltzmann sampling, we obtain random samplers that are…

Combinatorics · Mathematics 2009-09-29 Olivier Bodini , Eric Fusy , Carine Pivoteau

We design nearly-linear time numerical algorithms for the problem of multivariate multipoint evaluation over the fields of rational, real and complex numbers. We consider both \emph{exact} and \emph{approximate} versions of the algorithm.…

Discrete Mathematics · Computer Science 2023-12-27 Sumanta Ghosh , Prahladh Harsha , Simão Herdade , Mrinal Kumar , Ramprasad Saptharishi

The approximate uniform sampling of graphs with a given degree sequence is a well-known, extensively studied problem in theoretical computer science and has significant applications, e.g., in the analysis of social networks. In this work we…

Discrete Mathematics · Computer Science 2023-01-05 Georgios Amanatidis , Pieter Kleer

Estimation of probability density function from samples is one of the central problems in statistics and machine learning. Modern neural network-based models can learn high dimensional distributions but have problems with hyperparameter…

Machine Learning · Computer Science 2022-02-28 Georgii S. Novikov , Maxim E. Panov , Ivan V. Oseledets

We present a simple sublinear-time algorithm for sampling an arbitrary subgraph $H$ \emph{exactly uniformly} from a graph $G$ with $m$ edges, to which the algorithm has access by performing the following types of queries: (1) degree…

Data Structures and Algorithms · Computer Science 2021-03-29 Hendrik Fichtenberger , Mingze Gao , Pan Peng

Estimating the parameters of ordinary differential equations (ODEs) is of fundamental importance in many scientific applications. While ODEs are typically approximated with deterministic algorithms, new research on probabilistic solvers…

Machine Learning · Statistics 2023-12-08 Mohan Wu , Martin Lysy

We begin the study of list-decodable linear regression using batches. In this setting only an $\alpha \in (0,1]$ fraction of the batches are genuine. Each genuine batch contains $\ge n$ i.i.d. samples from a common unknown distribution and…

Machine Learning · Computer Science 2022-11-24 Abhimanyu Das , Ayush Jain , Weihao Kong , Rajat Sen

Motivated by the recent empirical successes of deep generative models, we study the computational complexity of the following unsupervised learning problem. For an unknown neural network $F:\mathbb{R}^d\to\mathbb{R}^{d'}$, let $D$ be the…

Machine Learning · Computer Science 2022-06-01 Sitan Chen , Jerry Li , Yuanzhi Li

We study the problem of computationally efficient robust estimation of the covariance/scatter matrix of elliptical distributions -- that is, affine transformations of spherically symmetric distributions -- under the strong contamination…

Data Structures and Algorithms · Computer Science 2025-04-15 Gleb Novikov

In this paper, we present a novel algorithm for piecewise linear regression which can learn continuous as well as discontinuous piecewise linear functions. The main idea is to repeatedly partition the data and learn a liner model in in each…

Machine Learning · Computer Science 2014-09-10 Naresh Manwani , P. S. Sastry

In the unsplittable flow problem on a path, we are given a capacitated path $P$ and $n$ tasks, each task having a demand, a profit, and start and end vertices. The goal is to compute a maximum profit set of tasks, such that for each edge…

Data Structures and Algorithms · Computer Science 2015-03-19 Paul Bonsma , Jens Schulz , Andreas Wiese

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

We present an $(1+\varepsilon)$-approximation algorithm with quasi-polynomial running time for computing the maximum weight independent set of polygons out of a given set of polygons in the plane (specifically, the running time is $n^{O(…

Computational Geometry · Computer Science 2017-03-16 Anna Adamaszek , Sariel Har-Peled , Andreas Wiese

Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d.…

Optimization and Control · Mathematics 2021-02-17 Junqi Wang , Pei Wang , Patrick Shafto

Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required…

Numerical Analysis · Mathematics 2017-10-10 Abdul-Lateef Haji-Ali , Fabio Nobile , Raúl Tempone , Sören Wolfers