English
Related papers

Related papers: Improving the Convergence Properties of the Data A…

200 papers

When statistical analyses consider multiple data sources, Markov melding provides a method for combining the source-specific Bayesian models. Markov melding joins together submodels that have a common quantity. One challenge is that the…

Methodology · Statistics 2022-03-17 Andrew A. Manderson , Robert J. B. Goudie

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet…

Methodology · Statistics 2021-06-22 Jingyu He , Nicholas Polson , Jianeng Xu

Data augmentation refers to the process of applying a series of transformations or expansions to original data to generate new samples, thereby increasing the diversity and quantity of the data, effectively improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Hao Zhang , Shuaijie Zhang , Renbin Zou

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

Data augmentation improves the convergence of iterative algorithms, such as the EM algorithm and Gibbs sampler by introducing carefully designed latent variables. In this article, we first propose a data augmentation scheme for the…

Methodology · Statistics 2022-07-06 Linda S. L. Tan

We propose a divide-and-conquer (DAC) algorithm for constrained convex optimization over networks, where the global objective is the sum of local objectives attached to individual agents. The algorithm is fully distributed: each iteration…

Optimization and Control · Mathematics 2025-10-03 Nazar Emirov , Guohui Song , Qiyu Sun

As Deep Neural Networks have achieved thrilling breakthroughs in the past decade, data augmentations have garnered increasing attention as regularization techniques when massive labeled data are unavailable. Among existing augmentations,…

Machine Learning · Computer Science 2025-04-24 Xin Jin , Hongyu Zhu , Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Chang Yu , Huafeng Qin , Stan Z. Li

Bayesian additive regression trees have seen increased interest in recent years due to their ability to combine machine learning techniques with principled uncertainty quantification. The Bayesian backfitting algorithm used to fit BART…

Machine Learning · Statistics 2022-02-22 Antonio R. Linero

Subspace clustering is the classical problem of clustering a collection of data samples that approximately lie around several low-dimensional subspaces. The current state-of-the-art approaches for this problem are based on the…

Machine Learning · Computer Science 2023-01-26 Maryam Abdolali , Nicolas Gillis

Diffusion maps is a manifold learning algorithm widely used for dimensionality reduction. Using a sample from a distribution, it approximates the eigenvalues and eigenfunctions of associated Laplace-Beltrami operators. Theoretical bounds on…

Statistics Theory · Mathematics 2021-04-09 Caroline L. Wormell , Sebastian Reich

Recently, data augmentation (DA) has emerged as a method for leveraging domain knowledge to inexpensively generate additional data in reinforcement learning (RL) tasks, often yielding substantial improvements in data efficiency. While prior…

Machine Learning · Computer Science 2024-03-19 Nicholas E. Corrado , Josiah P. Hanna

In this paper, we derive optimality results for greedy Bayesian-network search algorithms that perform single-edge modifications at each step and use asymptotically consistent scoring criteria. Our results extend those of Meek (1997) and…

Artificial Intelligence · Computer Science 2013-01-07 David Maxwell Chickering , Christopher Meek

We study the convergence of the Augmented Decomposition Algorithm (ADA) proposed in [32] for solving multi-block separable convex minimization problems subject to linear constraints. We show that the global convergence rate of the exact ADA…

Optimization and Control · Mathematics 2018-08-28 Hongsheng Liu , Shu Lu

We consider selfadjoint operators obtained by pasting a finite number of boundary relations with one-dimensional boundary space. A typical example of such an operator is the Schr\"odinger operator on a star-graph with a finite number of…

Spectral Theory · Mathematics 2023-10-17 Sergey Simonov , Harald Woracek

Data augmentation is a powerful mechanism in equivariant machine learning, encouraging symmetry by training networks to produce consistent outputs under transformed inputs. Yet, effective augmentation typically requires the underlying…

Machine Learning · Computer Science 2026-02-13 Eduardo Santos-Escriche , Ya-Wei Eileen Lin , Stefanie Jegelka

Deep learning has revolutionized the performance of classification, but meanwhile demands sufficient labeled data for training. Given insufficient data, while many techniques have been developed to help combat overfitting, the challenge…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Xiaofeng Zhang , Zhangyang Wang , Dong Liu , Qing Ling

The performance of learning models heavily relies on the availability and adequacy of training data. To address the dataset adequacy issue, researchers have extensively explored data augmentation (DA) as a promising approach. DA generates…

Computation and Language · Computer Science 2023-08-22 Dania Refai , Saleh Abo-Soud , Mohammad Abdel-Rahman

Dual averaging and gradient descent with their stochastic variants stand as the two canonical recipe books for first-order optimization: Every modern variant can be viewed as a descendant of one or the other. In the convex regime, these…

Optimization and Control · Mathematics 2025-05-28 Tuo Liu , El Mehdi Saad , Wojciech Kotłowski , Francesco Orabona

In recent years, one of the most popular techniques in the computer vision community has been the deep learning technique. As a data-driven technique, deep model requires enormous amounts of accurately labelled training data, which is often…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zihan Yang , Richard O. Sinnott , James Bailey , Qiuhong Ke

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas