English
Related papers

Related papers: Noisy data clusters are hollow

200 papers

Recent research on the dynamics of certain fluid dynamical instabilities shows that when there is a slow invariant manifold subject to fast timescale instability the dynamics are extremely sensitive to noise. The behaviour of such systems…

adap-org · Physics 2009-10-30 G. D. Lythe , M. R. E. Proctor

Spectral clustering is one of the most prominent clustering approaches. The distance-based similarity is the most widely used method for spectral clustering. However, people have already noticed that this is not suitable for multi-scale…

Machine Learning · Computer Science 2020-09-11 Hengrui Wang , Yubo Zhang , Mingzhi Chen , Tong Yang

We introduce a manifold analysis technique for neural network representations. Normalized Space Alignment (NSA) compares pairwise distances between two point clouds derived from the same source and having the same size, while potentially…

Machine Learning · Computer Science 2024-11-08 Danish Ebadulla , Aditya Gulati , Ambuj Singh

We introduce a new regression framework designed to deal with large-scale, complex data that lies around a low-dimensional manifold with noises. Our approach first constructs a graph representation, referred to as the skeleton, to capture…

Machine Learning · Computer Science 2026-03-17 Zeyu Wei , Yen-Chi Chen

This paper presents a clustering technique that reduces the susceptibility to data noise by learning and clustering the data-distribution and then assigning the data to the cluster of its distribution. In the process, it reduces the impact…

Machine Learning · Computer Science 2023-03-15 Rahmat Adesunkanmi , Ratnesh Kumar

Most compressed sensing algorithms do not account for the effect of saturation in noisy compressed measurements, though saturation is an important consequence of the limited dynamic range of existing sensors. The few algorithms that handle…

Machine Learning · Computer Science 2021-02-09 Shuvayan Banerjee , Radhe Srivastava , Ajit Rajwade

We consider the problem of detecting a small subset of defective items from a large set via non-adaptive "random pooling" group tests. We consider both the case when the measurements are noiseless, and the case when the measurements are…

Information Theory · Computer Science 2011-07-25 Chun Lam Chan , Pak Hou Che , Sidharth Jaggi , Venkatesh Saligrama

Understanding how information can efficiently spread in distributed systems under noisy communications is a fundamental question in both biological research and artificial system design. When agents are able to control whom they interact…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-11 Niccolò D'Archivio , Amos Korman , Emanuele Natale , Robin Vacus

We present a framework to generate watertight mesh representations in an unsupervised manner from noisy point clouds of complex, heterogeneous objects with free-form surfaces. The resulting meshes are ready to use in applications like…

Robotics · Computer Science 2016-09-06 Tobias Fromm , Christian A. Mueller , Andreas Birk

Physics-constrained data-driven computing is an emerging hybrid approach that integrates universal physical laws with data-driven models of experimental data for scientific computing. A new data-driven simulation approach coupled with a…

Computational Engineering, Finance, and Science · Computer Science 2020-04-22 Qizhi He , Jiun-Shyan Chen

Given a set of $n$ points in a $d$-dimensional space, we seek to compute the skyline, i.e., those points that are not strictly dominated by any other point, using few comparisons between elements. We adopt the noisy comparison model…

Data Structures and Algorithms · Computer Science 2020-04-02 Benoît Groz , Frederik Mallmann-Trenn , Claire Mathieu , Victor Verdugo

Consider the noisy underdetermined system of linear equations: y=Ax0 + z0, with n x N measurement matrix A, n < N, and Gaussian white noise z0 ~ N(0,\sigma^2 I). Both y and A are known, both x0 and z0 are unknown, and we seek an…

Statistics Theory · Mathematics 2015-03-14 David L. Donoho , Arian Maleki , Andrea Montanari

Particle simulations confined by sharp walls usually develop an oscillatory density profile. For some applications, most notably soft matter liquids, this behavior is often unrealistic and one expects a monotonic density climb instead. To…

Computational Physics · Physics 2016-11-02 Airidas Korolkovas

We introduce the qudit Noisy Stabilizer Formalism, a framework for efficiently describing the evolution of stabilizer states in prime-power dimensions subject to generalized Pauli-diagonal noise under Clifford operations and generalized…

Quantum Physics · Physics 2025-08-11 Paul Aigner , Maria Flors Mor-Ruiz , Wolfgang Dür

Popular clustering algorithms based on usual distance functions (e.g., Euclidean distance) often suffer in high dimension, low sample size (HDLSS) situations, where concentration of pairwise distances has adverse effects on their…

Methodology · Statistics 2019-05-03 Soham Sarkar , Anil K. Ghosh

The wealth of data being gathered about humans and their surroundings drives new machine learning applications in various fields. Consequently, more and more often, classifiers are trained using not only numerical data but also complex data…

Machine Learning · Computer Science 2022-04-13 Maciej Piernik , Dariusz Brzezinski , Pawel Zawadzki

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

Deep neural networks (DNN) with a huge number of adjustable parameters remain largely black boxes. To shed light on the hidden layers of DNN, we study supervised learning by a DNN of width $N$ and depth $L$ consisting of $NL$ perceptrons…

Disordered Systems and Neural Networks · Physics 2023-08-01 Hajime Yoshino

The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are…

Machine Learning · Statistics 2015-08-24 Reinhard Heckel , Helmut Bölcskei

During a surface acquisition process using 3D scanners, noise is inevitable and an important step in geometry processing is to remove these noise components from these surfaces (given as points-set or triangulated mesh). The noise-removal…

Graphics · Computer Science 2022-05-16 Sunil Kumar Yadav , Martin Skrodzki , Eric Zimmermann , Konrad Polthier