English
Related papers

Related papers: A Note on Automatic Data Transformation

200 papers

This article considers change point testing and estimation for a sequence of high-dimensional data. In the case of testing for a mean shift for high-dimensional independent data, we propose a new test which is based on $U$-statistic in Chen…

Statistics Theory · Mathematics 2021-08-10 Runmin Wang , Changbo Zhu , Stanislav Volgushev , Xiaofeng Shao

Optimization algorithms appear in the core calculations of numerous Artificial Intelligence (AI) and Machine Learning methods, as well as Engineering and Business applications. Following recent works on the theoretical deficiencies of AI, a…

Optimization and Control · Mathematics 2024-10-29 Nikolaos P. Bakas , Vagelis Plevris , Andreas Langousis , Savvas A. Chatzichristofis

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon

Interpreting data is central to modern research. Large language models (LLMs) show promise in providing such natural language interpretations of data, yet simple feature extraction methods such as prompting often fail to produce accurate…

Artificial Intelligence · Computer Science 2025-05-30 Michal Bravansky , Vaclav Kubon , Suhas Hariharan , Robert Kirk

Transforming a random variable to improve its normality leads to a followup test for whether the transformed variable follows a normal distribution. Previous work has shown that the Anderson Darling test for normality suffers from…

Methodology · Statistics 2024-09-23 Douglas M Hawkins

The principal goal of data science is to derive meaningful information from data. To do this, data scientists develop a space of analytic possibilities and from it reach their information goals by using their knowledge of the domain, the…

Non-Gaussian statistics are a challenge for data assimilation. Linear methods oversimplify the problem, yet fully nonlinear methods are often too expensive to use in practice. The best solution usually lies between these extremes.…

Computation · Statistics 2026-03-20 Berent Å. S. Lunde , Maximilian Ramgraber

Approximate Bayesian computation performs approximate inference for models where likelihood computations are expensive or impossible. Instead simulations from the model are performed for various parameter values and accepted if they are…

Computation · Statistics 2015-12-16 Dennis Prangle

In the real world, experimental data are rarely, if ever, distributed as a normal (Gaussian) distribution. As an example, a large set of data--such as the cross sections for particle scattering as a function of energy contained in the…

Data Analysis, Statistics and Probability · Physics 2009-11-11 Martin M. Block

Graph domain adaptation (GDA) is a fundamental task in graph machine learning, with techniques like shift-robust graph neural networks (GNNs) and specialized training procedures to tackle the distribution shift problem. Although these…

Machine Learning · Computer Science 2025-10-27 Ting-Wei Li , Ruizhong Qiu , Hanghang Tong

The accuracy of probability distributions inferred using machine-learning algorithms heavily depends on data availability and quality. In practical applications it is therefore fundamental to investigate the robustness of a statistical…

Machine Learning · Statistics 2018-10-01 Christiane Goergen , Manuele Leonelli

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both…

Machine Learning · Computer Science 2020-03-05 Chenlin Meng , Yang Song , Jiaming Song , Stefano Ermon

In this paper, we present a new parametrization to perform direct data-driven analysis and controller synthesis for the error-in-variables case. To achieve this, we employ the Sherman-Morrison-Woodbury formula to transform the problem into…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Felix Brändle , Frank Allgöwer

Symbolic data analysis (SDA) is an emerging area of statistics concerned with understanding and modelling data that takes distributional form (i.e. symbols), such as random lists, intervals and histograms. It was developed under the premise…

Computation · Statistics 2020-04-09 Boris Beranger , Huan Lin , Scott A. Sisson

In recent years, many data augmentation techniques have been proposed to increase the diversity of input data and reduce the risk of overfitting on deep neural networks. In this work, we propose an easy-to-implement and model-free data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Kun He , Chang Liu , Stephen Lin , John E. Hopcroft

We introduce marginalization models (MAMs), a new family of generative models for high-dimensional discrete data. They offer scalable and flexible generative modeling by explicitly modeling all induced marginal distributions.…

Machine Learning · Computer Science 2024-10-08 Sulin Liu , Peter J. Ramadge , Ryan P. Adams

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Data-driven and adaptive control approaches face the problem of introducing sudden distributional shifts beyond the distribution of data encountered during learning. Therefore, they are prone to invalidating the very assumptions used in…

Systems and Control · Electrical Eng. & Systems 2025-08-25 Mohammad Ramadan , Evan Toler , Mihai Anitescu

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

This paper introduces a general method to approximate the convolution of an arbitrary program with a Gaussian kernel. This process has the effect of smoothing out a program. Our compiler framework models intermediate values in the program…

Graphics · Computer Science 2017-06-06 Yuting Yang , Connelly Barnes