English
Related papers

Related papers: Big Holes in Big Data: A Monte Carlo Algorithm for…

200 papers

High-dimensional big data appears in many research fields such as image recognition, biology and collaborative filtering. Often, the exploration of such data by classic algorithms is encountered with difficulties due to `curse of…

Machine Learning · Computer Science 2016-07-13 Amit Bermanis , Aviv Rotbart , Moshe Salhov , Amir Averbuch

Efficient indexing and searching of high dimensional data has been an area of active research due to the growing exploitation of high dimensional data and the vulnerability of traditional search methods to the curse of dimensionality. This…

Information Retrieval · Computer Science 2015-05-13 Yu Zhong

In this paper we present novel algorithms for several multidimensional data processing problems. We consider problems related to the computation of restricted clusters and of the diameter of a set of points using a new distance function. We…

Data Structures and Algorithms · Computer Science 2010-09-14 Mugurel Ionut Andreica , Eliana-Dina Tirsa

Data extraction algorithms on data hypercubes, or datacubes, are traditionally only capable of cutting boxes of data along the datacube axes. For many use cases however, this is not a sufficient approach and returns more data than users…

Information Retrieval · Computer Science 2023-06-21 Mathilde Leuridan , James Hawkes , Simon Smart , Emanuele Danovaro , Tiago Quintino

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

Many inverse problems in nuclear fusion and high-energy astrophysics research, such as the optimization of tokamak reactor geometries or the inference of black hole parameters from interferometric images, necessitate high-dimensional…

Machine Learning · Computer Science 2025-05-09 Jonathan Gorard , Ammar Hakim , Hong Qin , Kyle Parfrey , Shantenu Jha

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

While deep learning excels in natural image and language processing, its application to high-dimensional data faces computational challenges due to the dimensionality curse. Current large-scale data tools focus on business-oriented…

Machine Learning · Computer Science 2025-07-01 Chen Zhang

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

In this note, we study a concatenation of quasi-Monte Carlo and plain Monte Carlo rules for high-dimensional numerical integration in weighted function spaces. In particular, we consider approximating the integral of periodic functions…

Numerical Analysis · Mathematics 2022-06-27 Takashi Goda

We consider the problem of deciding whether a highly incomplete signal lies within a given subspace. This problem, Matched Subspace Detection, is a classical, well-studied problem when the signal is completely observed. High- dimensional…

Information Theory · Computer Science 2011-01-25 Laura Balzano , Bejamin Recht , Robert Nowak

In this paper we construct multidimensional codes with high dimension. The codes can correct high dimensional errors which have the form of either small clusters, or confined to an area with a small radius. We also consider small number of…

Information Theory · Computer Science 2010-04-27 Eitan Yaakobi , Tuvi Etzion

Tensor completion is a problem of filling the missing or unobserved entries of partially observed tensors. Due to the multidimensional character of tensors in describing complex datasets, tensor completion algorithms and their applications…

Machine Learning · Statistics 2018-05-04 Qingquan Song , Hancheng Ge , James Caverlee , Xia Hu

A rectangular layout $\mathcal{L}$ is a rectangle partitioned into disjoint smaller rectangles so that no four smaller rectangles meet at the same point. Rectangular layouts were originally used as floorplans in VLSI design to represent…

Computational Geometry · Computer Science 2016-09-19 Jiun-Jie Wang

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung

We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in $\mathbb{R}^d$ with $d$ large. For low dimensional problems, one of the most popular numerical procedures for…

Computation · Statistics 2014-12-12 Alex Beskos , Dan Crisan , Ajay Jasra , Kengo Kamatani , Yan Zhou

In the paper, we consider the problem of searching for the Largest empty rectangle in a 2D map, and the one-dimensional version of the problem is the problem of searching for the largest empty segment. We present a quantum algorithm for the…

Quantum Physics · Physics 2025-12-04 Kamil Khadiev , Vladislav Remidovskii , Timur Bikmullin , Aliya Khadieva

Monte Carlo methods are widely used in particle physics to integrate and sample probability distributions (differential cross sections or decay rates) on multi-dimensional phase spaces. We present a Neural Network (NN) algorithm optimized…

High Energy Physics - Phenomenology · Physics 2020-10-21 Matthew D. Klimek , Maxim Perelstein

We study the problem of computing a convex region with bounded area and diameter that contains the maximum number of points from a given point set $P$. We show that this problem can be solved in $O(n^6k)$ time and $O(n^3k)$ space, where $n$…

Computational Geometry · Computer Science 2025-07-08 Gianmarco Picarella , Marc van Kreveld , Frank Staals , Sjoerd de Vries

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa