English
Related papers

Related papers: Staying on the Manifold: Geometry-Aware Noise Inje…

200 papers

3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments, which obstructs downstream tasks such as surface reconstruction, rendering and so on. Previous works mostly infer the displacement of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Shitong Luo , Wei Hu

Likelihood-based deep generative models have recently been shown to exhibit pathological behaviour under the manifold hypothesis as a consequence of using high-dimensional densities to model data with low-dimensional structure. In this…

Modern generative modeling methods have demonstrated strong performance in learning complex data distributions from clean samples. In many scientific and imaging applications, however, clean samples are unavailable, and only noisy or…

Machine Learning · Computer Science 2026-05-29 Willem Diepeveen , Oscar Leong

A major focus in designing methods for learning distributions defined on manifolds is to alleviate the need to implicitly learn the manifold so that learning can concentrate on the data distribution within the manifold. However,…

Machine Learning · Computer Science 2026-03-04 Alona Levy-Jurgenson , Alvaro Prat , James Cuin , Yee Whye Teh

We propose Audio Noise Awareness using Visuals of Indoors for NAVIgation for quieter robot path planning. While humans are naturally aware of the noise they make and its impact on those around them, robots currently lack this awareness. A…

Robotics · Computer Science 2024-10-25 Vidhi Jain , Rishi Veerapaneni , Yonatan Bisk

We investigate the impact of entropy change in deep learning systems by noise injection at different levels, including the embedding space and the image. The series of models that employ our methodology are collectively known as Noisy…

Artificial Intelligence · Computer Science 2025-09-09 Xiaowei Yu , Zhe Huang , Minheng Chen , Lu Zhang , Tianming Liu , Dajiang Zhu

Transfer learning under domain shift remains a fundamental challenge due to the divergence between source and target data manifolds. In this paper, we propose MAADA (Manifold-Aware Adversarial Data Augmentation), a novel framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Hana Satou , Alan Mitkiy , Emma Collins , Finn Kingston

Data noising is an effective technique for regularizing neural network models. While noising is widely adopted in application domains such as vision and speech, commonly used noising primitives have not been developed for discrete…

Machine Learning · Computer Science 2017-03-09 Ziang Xie , Sida I. Wang , Jiwei Li , Daniel Lévy , Aiming Nie , Dan Jurafsky , Andrew Y. Ng

The noise in stochastic gradient descent (SGD) provides a crucial implicit regularization effect for training overparameterized models. Prior theoretical work largely focuses on spherical Gaussian noise, whereas empirical studies…

Machine Learning · Computer Science 2020-06-19 Jeff Z. HaoChen , Colin Wei , Jason D. Lee , Tengyu Ma

Injecting noise within gradient descent has several desirable features, such as smoothing and regularizing properties. In this paper, we investigate the effects of injecting noise before computing a gradient step. We demonstrate that small…

Machine Learning · Computer Science 2023-01-24 Antonio Orvieto , Anant Raj , Hans Kersting , Francis Bach

Quantum metrology promises precision beyond classical limits, yet environmental noise typically degrades the quantum resources required for such enhancement. In this work, we investigate frequency estimation in noisy continuous-variable…

Quantum Physics · Physics 2026-05-08 Ayan Patra , Manju , Aditi Sen De , Matteo G. A. Paris

Onboard electrostatic suspension inertial sensors are important applications for gravity satellites and space gravitational wave detection missions, and it is important to suppress noise in the measurement signal. Due to the complex…

Geophysics · Physics 2023-05-12 Zhilan Yang , Haoyue Zhang , Peng Xu , Ziren Luo

Theoretical analysis of the error landscape of deep neural networks has garnered significant interest in recent years. In this work, we theoretically study the importance of noise in the trajectories of gradient descent towards optimal…

Machine Learning · Computer Science 2018-07-24 Adepu Ravi Sankar , Vishwak Srinivasan , Vineeth N Balasubramanian

The gradient noise of SGD is considered to play a central role in the observed strong generalization abilities of deep learning. While past studies confirm that the magnitude and the covariance structure of gradient noise are critical for…

Machine Learning · Computer Science 2020-06-22 Jingfeng Wu , Wenqing Hu , Haoyi Xiong , Jun Huan , Vladimir Braverman , Zhanxing Zhu

Understanding generalization in deep neural networks is an active area of research. A promising avenue of exploration has been that of margin measurements: the shortest distance to the decision boundary for a given sample or that sample's…

Machine Learning · Computer Science 2024-05-29 Coenraad Mouton

Several data analysis techniques employ similarity relationships between data points to uncover the intrinsic dimension and geometric structure of the underlying data-generating mechanism. In this paper we work under the model assumption…

Machine Learning · Statistics 2019-04-09 Nicolas Garcia Trillos , Daniel Sanz-Alonso , Ruiyi Yang

The effectiveness of fingerprint-based authentication systems on good quality fingerprints is established long back. However, the performance of standard fingerprint matching systems on noisy and poor quality fingerprints is far from…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Indu Joshi , Ayush Utkarsh , Riya Kothari , Vinod K Kurmi , Antitza Dantcheva , Sumantra Dutta Roy , Prem Kumar Kalra

The integration of contextual embeddings into the optimization processes of large language models is an advancement in natural language processing. The Context-Aware Neural Gradient Mapping framework introduces a dynamic gradient adjustment…

Computation and Language · Computer Science 2025-04-25 David Boldo , Lily Pemberton , Gabriel Thistledown , Jacob Fairchild , Felix Kowalski

The presence of noise is the primary challenge in realizing fault-tolerant quantum computers. In this work, we introduce and experimentally validate a novel strategy to circumvent noise by exploiting the phenomenon of metastability, where a…

Quantum Physics · Physics 2026-05-28 Antonio Sannia , Pratik Sathe , Luis Pedro García-Pintos

Automatically learning features, especially robust features, has attracted much attention in the machine learning community. In this paper, we propose a new method to learn non-linear robust features by taking advantage of the data manifold…

Machine Learning · Computer Science 2017-05-29 Yanan Li , Donghui Wang