English
Related papers

Related papers: The alpha-beta divergence for real and complex dat…

200 papers

This paper makes a deep study of regular two-distance sets. A set of unit vectors $X$ in Euclidean space $\RR^n$ is said to be regular two-distance set if the inner product of any pair of its vectors is either $\alpha$ or $\beta$, and the…

Functional Analysis · Mathematics 2019-10-17 Peter G. Casazza , Tin T. Tran , Janet C. Tremain

Our world is ambiguous and this is reflected in the data we use to train our algorithms. This is particularly true when we try to model natural processes where collected data is affected by noisy measurements and differences in measurement…

Machine Learning · Computer Science 2023-07-19 Jörg K. H. Franke , Frederic Runge , Frank Hutter

We study the fundamental question of how informative a dataset is for solving a given decision-making task. In our setting, the dataset provides partial information about unknown parameters that influence task outcomes. Focusing on linear…

Optimization and Control · Mathematics 2025-05-29 Omar Bennouna , Amine Bennouna , Saurabh Amin , Asuman Ozdaglar

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

We prove limit theorems of an entirely new type for certain long memory regularly varying stationary infinitely divisible random processes. These theorems involve multiple phase transitions governed by how long the memory is. Apart from one…

Probability · Mathematics 2018-05-23 Gennady Samorodnitsky , Yizao Wang

The Jensen-Shannon divergence is a renown bounded symmetrization of the Kullback-Leibler divergence which does not require probability densities to have matching supports. In this paper, we introduce a vector-skew generalization of the…

Information Theory · Computer Science 2020-10-01 Frank Nielsen

Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach, the goal of the…

Machine Learning · Computer Science 2025-02-28 Fernando Martin-Maroto , Nabil Abderrahaman , David Mendez , Gonzalo G. de Polavieja

In this paper we empirically evaluate biased methods for alpha-divergence minimization. In particular, we focus on how the bias affects the final solutions found, and how this depends on the dimensionality of the problem. We find that (i)…

Machine Learning · Computer Science 2021-05-17 Tomas Geffner , Justin Domke

A general conversion strategy by involving a shifted parameter $\theta$ is proposed to construct high-order accuracy difference formulas for fractional calculus operators. By converting the second-order backward difference formula with such…

Numerical Analysis · Mathematics 2022-04-13 Baoli Yin , Guoyu Zhang , Yang Liu , Hong Li

Given a graph $G = (V,E)$, an $(\alpha, \beta)$-ruling set is a subset $S \subseteq V$ such that the distance between any two vertices in $S$ is at least $\alpha$, and the distance between any vertex in $V$ and the closest vertex in $S$ is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-03 Alkida Balliu , Sebastian Brandt , Dennis Olivetti

Preserving the robustness of the procedure has, at the present time, become almost a default requirement for statistical data analysis. Since efficiency at the model and robustness under misspecification of the model are often in conflict,…

Statistics Theory · Mathematics 2019-10-29 Saptarshi Roy , Kaustav Chakraborty , Somnath Bhadra , Ayanendranath Basu

While deep learning models often achieve strong task performance, their successes are hampered by their inability to disentangle spurious correlations from causative factors, such as when they use protected attributes (e.g., race, gender,…

Machine Learning · Computer Science 2020-11-17 Kurtis Evan David , Qiang Liu , Ruth Fong

Numerical analysts might be expected to pay close attention to a branch of complexity theory called information-based complexity theory (IBCT), which produces an abundance of impressive results about the quest for approximate solutions to…

Numerical Analysis · Mathematics 2025-10-20 Beresford N. Parlett

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

In compositional data analysis an observation is a vector containing non-negative values, only the relative sizes of which are considered to be of interest. Without loss of generality, a compositional vector can be taken to be a vector of…

Methodology · Statistics 2015-06-18 Michail Tsagris , Simon Preston , Andrew T. A. Wood

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

Preprocessing forms an oft-neglected foundation for a wide range of statistical and scientific analyses. However, it is rife with subtleties and pitfalls. Decisions made in preprocessing constrain all later analyses and are typically…

Statistics Theory · Mathematics 2013-09-27 Alexander W. Blocker , Xiao-Li Meng

It has been argued persuasively that, in order to evaluate climate models, the probability distributions of model output need to be compared to the corresponding empirical distributions of observed data. Distance measures between…

Methodology · Statistics 2013-07-17 Thordis L. Thorarinsdottir , Tilmann Gneiting , Nadine Gissibl

Model selection is a cornerstone of statistical inference, where information criteria are widely employed to balance model fit and complexity. However, classical likelihood-based criteria are often highly sensitive to contamination,…

Methodology · Statistics 2026-03-26 Udita Goswami , Shuvashree Mondal