English
Related papers

Related papers: Fully lifted \emph{blirp} interpolation -- a large…

200 papers

Normalizing flows define a probability distribution by an explicit invertible transformation $\boldsymbol{\mathbf{z}}=f(\boldsymbol{\mathbf{x}})$. In this work, we present implicit normalizing flows (ImpFlows), which generalize normalizing…

Machine Learning · Statistics 2021-03-18 Cheng Lu , Jianfei Chen , Chongxuan Li , Qiuhao Wang , Jun Zhu

The notion of interpolation and extrapolation is fundamental in various fields from deep learning to function approximation. Interpolation occurs for a sample $x$ whenever this sample falls inside or on the boundary of the given dataset's…

Machine Learning · Computer Science 2021-11-02 Randall Balestriero , Jerome Pesenti , Yann LeCun

Many of today's probabilistic programming languages (PPLs) have brittle inference performance: the performance of the underlying inference algorithm is very sensitive to the precise way in which the probabilistic program is written. A…

Artificial Intelligence · Computer Science 2023-02-22 Ellie Y. Cheng , Todd Millstein , Guy Van den Broeck , Steven Holtzen

For any hyperbolic rational map and any net of Borel probability measures on the space of Borel probability measures on the Julia set, we show that this net satisfies a strong form of the large deviation principle with a rate function given…

Dynamical Systems · Mathematics 2009-05-13 Henri Comman

We present a new rational approximation algorithm based on the empirical interpolation method for interpolating a family of parametrized functions to rational polynomials with invariant poles, leading to efficient numerical algorithms for…

Numerical Analysis · Mathematics 2025-01-23 Aidi Li , Yuwen Li

We put forward an adaptive alpha (Type I Error) that decreases as the information grows, for hypothesis tests in which nested linear models are compared. A less elaborate adaptation was already presented in \citet{PP2014} for comparing…

Methodology · Statistics 2021-01-06 D. Vélez , M. E. Pérez , L. R. Pericchi

As climate change intensifies, the shift to cleaner energy sources becomes increasingly urgent. With wind energy production set to accelerate, reliable wind probabilistic forecasts are essential to ensure its efficient use. However, since…

Machine Learning · Computer Science 2024-10-08 Jean-Sébastien Giroux , Simon-Philippe Breton , Julie Carreau

An intense activity is nowadays devoted to the definition of models capturing the properties of complex networks. Among the most promising approaches, it has been proposed to model these graphs via their clique incidence bipartite graphs.…

Discrete Mathematics · Computer Science 2021-03-09 Matthieu Latapy , Thi Ha Duong Phan , Christophe Crespelle , Thanh Qui Nguyen

Many complex systems occurring in the natural or social sciences or economics are frequently described on a microscopic level, e.g., by lattice- or agent-based models. To analyze the states of such systems and their bifurcation structure on…

Adaptation and Self-Organizing Systems · Physics 2020-10-07 Clemens Willers , Uwe Thiele , Andrew J. Archer , David J. B. Lloyd , Oliver Kamps

Lifted inference reduces the complexity of inference in relational probabilistic models by identifying groups of constants (or atoms) which behave symmetric to each other. A number of techniques have been proposed in the literature for…

Artificial Intelligence · Computer Science 2018-07-10 Vishal Sharma , Noman Ahmed Sheikh , Happy Mittal , Vibhav Gogate , Parag Singla

Non-Independent and Identically Distributed (non-IID) data in Federated Learning (FL) causes client drift issues, leading to slower convergence and reduced model performance. While existing approaches mitigate this issue in Centralized FL…

Machine Learning · Computer Science 2025-01-07 Chao Feng , Hongjie Guan , Alberto Huertas Celdrán , Jan von der Assen , Gérôme Bovet , Burkhard Stiller

We examine the necessity of interpolation in overparameterized models, that is, when achieving optimal predictive risk in machine learning problems requires (nearly) interpolating the training data. In particular, we consider simple…

Machine Learning · Statistics 2022-06-17 Chen Cheng , John Duchi , Rohith Kuditipudi

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

Interpolative and CUR decompositions involve "natural bases" of row and column subsets, or skeletons, of a given matrix that approximately span its row and column spaces. These low-rank decompositions preserve properties such as sparsity or…

Numerical Analysis · Mathematics 2023-10-17 Katherine J. Pearce , Chao Chen , Yijun Dong , Per-Gunnar Martinsson

One method to generate random permutations involves using Gaussian elimination with partial pivoting (GEPP) on a random matrix $A$ and storing the permutation matrix factor $P$ from the resulting GEPP factorization $PA=LU$. We are…

Probability · Mathematics 2024-11-19 John Peca-Medlin , Chenyang Zhong

Clustering is a fundamental task in unsupervised learning. The focus of this paper is the Correlation Clustering functional which combines positive and negative affinities between the data points. The contribution of this paper is two fold:…

Computer Vision and Pattern Recognition · Computer Science 2011-12-14 Shai Bagon , Meirav Galun

In the era of deep learning, understanding over-fitting phenomenon becomes increasingly important. It is observed that carefully designed deep neural networks achieve small testing error even when the training error is close to zero. One…

Machine Learning · Statistics 2018-12-04 Yue Xing , Qifan Song , Guang Cheng

Identifying leading measurement units from a large collection is a common inference task in various domains of large-scale inference. Testing approaches, which measure evidence against a null hypothesis rather than effect magnitude, tend to…

Methodology · Statistics 2020-11-17 Nicholas C. Henderson , Michael A. Newton

Conventional predictive modeling of parametric relationships in manufacturing processes is limited by the subjectivity of human expertise and intuition on the one hand and by the cost and time of experimental data generation on the other…

Computation and Language · Computer Science 2025-06-26 Kiarash Naghavi Khanghah , Anandkumar Patel , Rajiv Malhotra , Hongyi Xu

Machine learning models achieve state-of-the-art performance across domains, yet their lack of interpretability limits safe deployment in high-stakes settings. Counterfactual explanations are widely used to provide actionable "what-if"…

Machine Learning · Computer Science 2025-11-18 Nawid Keshtmand , Roussel Desmond Nzoyem , Jeffrey Nicholas Clark