English
Related papers

Related papers: PANDA: AdaPtive Noisy Data Augmentation for Regula…

200 papers

Stochastic dynamical systems with slow or metastable behavior evolve, on long time scales, on an unknown low-dimensional manifold in high-dimensional ambient space. Building a reduced simulator from short-burst ambient ensembles is a…

Machine Learning · Computer Science 2026-04-20 Sean Hill , Felix X. -F. Ye

Estimating signals underlying noisy data is a significant problem in statistics and engineering. Numerous estimators are available in the literature, depending on the observation model and estimation criterion. This paper introduces a…

Methodology · Statistics 2023-05-09 Woo Min Kim , Sutanoy Dasgupta , Anuj Srivastava

Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state-of-the-art results in image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Ekin D. Cubuk , Barret Zoph , Jonathon Shlens , Quoc V. Le

Regularization for optimization is a crucial technique to avoid overfitting in machine learning. In order to obtain the best performance, we usually train a model by tuning the regularization parameters. It becomes costly, however, when a…

Machine Learning · Computer Science 2020-08-18 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

Previous work has examined the ability of larger capacity neural networks to generalize better than smaller ones, even without explicit regularizers, by analyzing gradient based algorithms such as GD and SGD. The presence of noise and its…

Machine Learning · Computer Science 2020-05-27 Arushi Gupta

Existing analysis of AdaGrad and other adaptive methods for smooth convex optimization is typically for functions with bounded domain diameter. In unconstrained problems, previous works guarantee an asymptotic convergence rate without an…

Machine Learning · Computer Science 2023-10-05 Zijian Liu , Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

Fine-tuning diffusion models via online reinforcement learning (RL) has shown great potential for enhancing text-to-image alignment. However, since precisely specifying a ground-truth objective for visual tasks remains challenging, the…

Machine Learning · Computer Science 2026-01-01 Haoran He , Yuxiao Ye , Jie Liu , Jiajun Liang , Zhiyong Wang , Ziyang Yuan , Xintao Wang , Hangyu Mao , Pengfei Wan , Ling Pan

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

Methodology · Statistics 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

Anomaly detection methods strive to discover patterns that differ from the norm in a semantic way. This goal is ambiguous as a data point differing from the norm by an attribute e.g., age, race or gender, may be considered anomalous by some…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Niv Cohen , Jonathan Kahana , Yedid Hoshen

This paper presents Bundle Network, a learning-based algorithm inspired by the Bundle Method for convex non-smooth minimization problems. Unlike classical approaches that rely on heuristic tuning of a regularization parameter, our method…

Optimization and Control · Mathematics 2025-09-30 Francesca Demelas , Joseph Le Roux , Antonio Frangioni , Mathieu Lacroix , Emiliano Traversi , Roberto Wolfler Calvo

Anomaly detection (AD) plays a vital role across a wide range of domains, but its performance might deteriorate when applied to target domains with limited data. Domain Adaptation (DA) offers a solution by transferring knowledge from a…

Machine Learning · Statistics 2025-08-12 Tran Tuan Kiet , Nguyen Thang Loi , Vo Nguyen Le Duy

Data augmentation methods usually apply the same augmentation (or a mix of them) to all the training samples. For example, to perturb data with noise, the noise is sampled from a Normal distribution with a fixed standard deviation, for all…

Identifying anomalous instances in tabular data is essential for improving data reliability and maintaining system stability. Due to the scarcity of ground-truth anomaly labels, existing methods mainly rely on unsupervised anomaly detection…

Artificial Intelligence · Computer Science 2026-04-21 Wei Huang , Yuxuan Xiong , Hezhe Qiao , Yu-Ming Shang , Xiangling Fu , Guansong Pang

Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Julio Silva-Rodríguez , Valery Naranjo , Jose Dolz

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

Machine Learning · Computer Science 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs but is challenged by complex, multi-faceted distributional shifts. Existing methods attempt to reduce distributional shifts by aligning…

Machine Learning · Computer Science 2026-03-19 Wei Chen , Xingyu Guo , Shuang Li , Zhao Zhang , Yan Zhong , Fuzhen Zhuang , Deqing wang

Although unsupervised domain adaptation methods have achieved remarkable performance in semantic scene segmentation in visual perception for self-driving cars, these approaches remain impractical in real-world use cases. In practice, the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Thanh-Dat Truong , Pierce Helton , Ahmed Moustafa , Jackson David Cothren , Khoa Luu