English
Related papers

Related papers: A simple universal algorithm for high-dimensional …

200 papers

Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the…

Optimization and Control · Mathematics 2024-02-22 Martin Ryner , Jan Kronqvist , Johan Karlsson

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Many real-world problems can be formulated as the alignment between two geometric patterns. Previously, a great amount of research focus on the alignment of 2D or 3D patterns in the field of computer vision. Recently, the alignment problem…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Hu Ding , Wenjie Liu , Mingquan Ye

We formulate a resolution of singularities algorithm for analyzing the zero sets of real-analytic functions in dimensions $\geq 3$. Rather than using the celebrated result of Hironaka, the algorithm is modeled on a more explicit and…

Classical Analysis and ODEs · Mathematics 2011-08-09 Tristan Collins , Allan Greenleaf , Malabika Pramanik

Estimates of the quantum accuracy threshold often tacitly assume that it is possible to interact arbitrary pairs of qubits in a quantum computer with a failure rate that is independent of the distance between them. None of the many physical…

Quantum Physics · Physics 2013-05-29 A. M. Stephens , Z. W. E. Evans

Fitting geometric models onto outlier contaminated data is provably intractable. Many computer vision systems rely on random sampling heuristics to solve robust fitting, which do not provide optimality guarantees and error bounds. It is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Anh-Dzung Doan , Michele Sasdelli , David Suter , Tat-Jun Chin

We study a randomized quadrature algorithm to approximate the integral of periodic functions defined over the high-dimensional unit cube. Recent work by Kritzer, Kuo, Nuyens and Ullrich (2019) shows that rank-1 lattice rules with a randomly…

Numerical Analysis · Mathematics 2023-04-28 Josef Dick , Takashi Goda , Kosuke Suzuki

We investigate the unconstrained global optimization of functions with low effective dimensionality, that are constant along certain (unknown) linear subspaces. Extending the technique of random subspace embeddings in [Wang et al., Bayesian…

Optimization and Control · Mathematics 2020-03-24 Coralia Cartis , Adilet Otemissov

Next generation deep neural networks for classification hosted on embedded platforms will rely on fast, efficient, and accurate learning algorithms. Initialization of weights in learning networks has a great impact on the classification…

Machine Learning · Computer Science 2016-07-21 Julius , Gopinath Mahale , Sumana T. , C. S. Adityakrishna

We present an optimization algorithm that can identify a global minimum of a potentially nonconvex smooth function with high probability, assuming the Gibbs measure of the potential satisfies a logarithmic Sobolev inequality. Our…

Optimization and Control · Mathematics 2025-09-16 Daniel Cortild , Claire Delplancke , Nadia Oudjane , Juan Peypouquet

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

High dimension low sample size statistical analysis is important in a wide range of applications. In such situations, the highly appealing discrimination method, support vector machine, can be improved to alleviate data piling at the…

Optimization and Control · Mathematics 2017-08-18 Xin Yee Lam , J. S. Marron , Defeng Sun , Kim-Chuan Toh

We establish minimax optimal rates of convergence for estimation in a high dimensional additive model assuming that it is approximately sparse. Our results reveal an interesting phase transition behavior universal to this class of high…

Statistics Theory · Mathematics 2015-03-11 Ming Yuan , Ding-Xuan Zhou

We discuss the computational complexity of solving linear programming problems by means of an analog computer. The latter is modeled by a dynamical system which converges to the optimal vertex solution. We analyze various probability…

Other Condensed Matter · Physics 2007-05-23 Yaniv S. Avizrats , Joshua Feinberg , Shmuel Fishman

Maximum weight matching is one of the most fundamental combinatorial optimization problems with a wide range of applications in data mining and bioinformatics. Developing distributed weighted matching algorithms is challenging due to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-06 Sepehr Assadi , MohammadHossein Bateni , Vahab Mirrokni

Density estimation plays a key role in many tasks in machine learning, statistical inference, and visualization. The main bottleneck in high-dimensional density estimation is the prohibitive computational cost and the slow convergence rate.…

Machine Learning · Computer Science 2021-10-22 Liang Ding , Lu Zou , Wenjia Wang , Shahin Shahrampour , Rui Tuo

Second-order optimization methods, such as cubic regularized Newton methods, are known for their rapid convergence rates; nevertheless, they become impractical in high-dimensional problems due to their substantial memory requirements and…

Optimization and Control · Mathematics 2024-01-09 Ruichen Jiang , Parameswaran Raman , Shoham Sabach , Aryan Mokhtari , Mingyi Hong , Volkan Cevher

In this paper, we scale evolutionary algorithms to high-dimensional optimization problems that deceptively possess a low effective dimensionality (certain dimensions do not significantly affect the objective function). To this end, an…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Yaqing Hou , Mingyang Sun , Abhishek Gupta , Yaochu Jin , Haiyin Piao , Hongwei Ge , Qiang Zhang

In this paper, we study the efficient numerical integration of functions with sharp gradients and cusps. An adaptive integration algorithm is presented that systematically improves the accuracy of the integration of a set of functions. The…

Numerical Analysis · Mathematics 2021-11-09 S. E. Mousavi , J. E. Pask , N. Sukumar

Based on an idea in Hironaka's proof of resolution of singularities, we present an algorithmic smoothness test for algebraic varieties. The test is inherently parallel and does not involve the calculation of codimension-sized minors of the…

Algebraic Geometry · Mathematics 2018-01-24 Janko Boehm , Anne Frühbis-Krüger