English
Related papers

Related papers: Noisy data clusters are hollow

200 papers

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

Quantum computation has made considerable progress in the last decade with multiple emerging technologies providing proof-of-principle experimental demonstrations of such calculations. However, these experimental demonstrations of quantum…

Quantum Physics · Physics 2022-09-27 Samudra Dasgupta , Travis S. Humble

We consider the problem of clustering noisy finite-length observations of stationary ergodic random processes according to their generative models without prior knowledge of the model statistics and the number of generative models. Two…

Machine Learning · Computer Science 2017-09-29 Michael Tschannen , Helmut Bölcskei

In multi-view clustering, different views may have different confidence levels when learning a consensus representation. Existing methods usually address this by assigning distinctive weights to different views. However, due to noisy nature…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Yanbo Fan , Jian Liang , Ran He , Bao-Gang Hu , Siwei Lyu

We consider the problem of clustering in the presence of noise. That is, when on top of cluster structure, the data also contains a subset of \emph{unstructured} points. Our goal is to detect the clusters despite the presence of many…

Machine Learning · Computer Science 2018-08-28 Shrinu Kushagra , Yaoliang Yu , Shai Ben-David

Manifold learning is a central task in modern statistics and data science. Many datasets (cells, documents, images, molecules) can be represented as point clouds embedded in a high dimensional ambient space, however the degrees of freedom…

Machine Learning · Statistics 2025-02-18 Stephen Zhang , Gilles Mordant , Tetsuya Matsumoto , Geoffrey Schiebinger

In label-noise learning, estimating the transition matrix has attracted more and more attention as the matrix plays an important role in building statistically consistent classifiers. However, it is very challenging to estimate the…

Machine Learning · Computer Science 2022-06-08 De Cheng , Tongliang Liu , Yixiong Ning , Nannan Wang , Bo Han , Gang Niu , Xinbo Gao , Masashi Sugiyama

Registration of 3D point clouds is a fundamental task in several applications of robotics and computer vision. While registration methods such as iterative closest point and variants are very popular, they are only locally optimal. There…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Rangaprasad Arun Srivatsan , Tejas Zodage , Howie Choset

Clustering real world data often faced with curse of dimensionality, where real world data often consist of many dimensions. Multidimensional data clustering evaluation can be done through a density-based approach. Density approaches based…

Databases · Computer Science 2010-12-30 Rahmat Widia Sembiring , Jasni Mohamad Zain

This paper presents an analysis of the concept of capacity for noisy computations, i.e. algorithms implemented by unreliable computing devices (e.g. noisy Turing Machines). The capacity of a noisy computation is defined and justified by…

Information Theory · Computer Science 2011-05-17 Francois Simon

Detecting arbitrarily shaped clusters in high-dimensional noisy data is challenging for current clustering methods. We introduce SHADE (Structure-preserving High-dimensional Analysis with Density-based Exploration), the first deep…

Machine Learning · Computer Science 2024-10-10 Anna Beer , Pascal Weber , Lukas Miklautz , Collin Leiber , Walid Durani , Christian Böhm , Claudia Plant

Spatial process models popular in geostatistics often represent the observed data as the sum of a smooth underlying process and white noise. The variation in the white noise is attributed to measurement error, or micro-scale variability,…

Statistics Theory · Mathematics 2023-02-14 Wenpin Tang , Lu Zhang , Sudipto Banerjee

Forest canopies have been shown to alter the dynamics of flows over complex terrain. Deficiencies have been found when tall canopies are represented in numerical simulations by an increase in roughness length at the surface. Methods of…

Atmospheric and Oceanic Physics · Physics 2021-06-16 John Tolladay , Charles Chemel

Density based spatial clustering of points in $\mathbb{R}^n$ has a myriad of applications in a variety of industries. We generalise this problem to the density based clustering of lines in high-dimensional spaces, keeping in mind there…

Machine Learning · Computer Science 2024-10-04 Akanksha Das , Malay Bhattacharyya

A considerable amount of research is concerned with the generation of realistic sensor data. LiDAR point clouds are generated by complex simulations or learned generative models. The generated data is usually exploited to enable or improve…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Larissa T. Triess , Christoph B. Rist , David Peter , J. Marius Zöllner

We propose a new framework that formulates point cloud registration as a denoising diffusion process from noisy transformation to object transformation. During training stage, object transformation diffuses from ground-truth transformation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yue Wu , Yongzhe Yuan , Xiaolong Fan , Xiaoshui Huang , Maoguo Gong , Qiguang Miao

We critically examine how well the evolution of large-scale density perturbations is followed in cosmological $N$-body simulations. We first run a large volume simulation and perform a mode-by-mode analysis in three-dimensional Fourier…

Understanding how neural systems efficiently process information through distributed representations is a fundamental challenge at the interface of neuroscience and machine learning. Recent approaches analyze the statistical and geometrical…

Neurons and Cognition · Quantitative Biology 2025-04-01 Francesca Mignacco , Chi-Ning Chou , SueYeon Chung

This work derives and validates a noise model that encapsulates deadtime of non-paralyzable detectors with random photon arrivals to enable advanced processing, like maximum-likelihood estimation, of high resolution atmospheric lidar…

Signal Processing · Electrical Eng. & Systems 2025-06-12 Grant J. Kirchhoff , Matthew Hayman , Willem J. Marais , Jeffrey P. Thayer , Rory A. Barton-Grimley

With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources…

Information Theory · Computer Science 2018-01-22 Yi Janet Lu