English
Related papers

Related papers: Fully lifted \emph{blirp} interpolation -- a large…

200 papers

Mixup style data augmentation algorithms have been widely adopted in various tasks as implicit network regularization on representation learning to improve model generalization, which can be achieved by a linear interpolation of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Kangjun Liu , Ke Chen , Lihua Guo , Yaowei Wang , Kui Jia

We present a new technique for the interpolation of discretely-sampled non-negat ive scalar fields across regions of missing data. Any set of basis functions can be used, though the method is fastest when they are close to orthogonal. We…

Astrophysics · Physics 2007-05-23 Will Saunders , Bill E. Ballinger

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Its extensions mostly focus on the definition of interpolation and the space (input or feature) where it…

Machine Learning · Computer Science 2023-11-10 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Hybrid continuous-discrete models naturally represent many real-world applications in robotics, finance, and environmental engineering. Inference with large-scale models is challenging because relational structures deteriorate rapidly…

Machine Learning · Computer Science 2012-10-19 Jaesik Choi , Eyal Amir

Discrete statistical models supported on labelled event trees can be specified using so-called interpolating polynomials which are generalizations of generating functions. These admit a nested representation. A new algorithm exploits the…

Statistics Theory · Mathematics 2017-05-29 Christiane Görgen , Anna Bigatti , Eva Riccomagno , Jim Q. Smith

Data augmentation with \textbf{Mixup} has been proven an effective method to regularize the current deep neural networks. Mixup generates virtual samples and corresponding labels at once through linear interpolation. However, this one-stage…

Machine Learning · Computer Science 2022-06-07 Xiangjin Xie , Yangning Li , Wang Chen , Kai Ouyang , Li Jiang , Haitao Zheng

Mixup, a recent proposed data augmentation method through linearly interpolating inputs and modeling targets of random samples, has demonstrated its capability of significantly improving the predictive accuracy of the state-of-the-art…

Computation and Language · Computer Science 2019-05-23 Hongyu Guo , Yongyi Mao , Richong Zhang

Superposition -- when a neural network represents more ``features'' than it has dimensions -- seems to pose a serious challenge to mechanistically interpreting current AI systems. Existing theory work studies \emph{representational}…

Machine Learning · Computer Science 2024-08-13 Kaarel Hänni , Jake Mendel , Dmitry Vaintrob , Lawrence Chan

For classifying digital whole slide images in the absence of pixel level annotation, typically multiple instance learning methods are applied. Due to the generic applicability, such methods are currently of very high interest in the…

Mixup, a simple data augmentation method that randomly mixes two data points via linear interpolation, has been extensively applied in various deep learning applications to gain better generalization. However, the theoretical underpinnings…

Machine Learning · Computer Science 2023-03-16 Difan Zou , Yuan Cao , Yuanzhi Li , Quanquan Gu

Lifted probabilistic inference algorithms exploit regularities in the structure of graphical models to perform inference more efficiently. More specifically, they identify groups of interchangeable variables and perform inference once per…

Artificial Intelligence · Computer Science 2014-02-05 Nima Taghipour , Daan Fierens , Jesse Davis , Hendrik Blockeel

In our companion paper \cite{Stojnicgscomp16} we introduce a collection of fairly powerful statistical comparison results. They relate to a general comparison concept and its an upgrade that we call lifting procedure. Here we provide a…

Probability · Mathematics 2016-12-28 Mihailo Stojnic

An adaptive interpolation scheme is proposed to accurately calculate the wideband responses in electromagnetic simulations. In the proposed scheme, the sampling points are first carefully divided into several groups based on their responses…

Computational Engineering, Finance, and Science · Computer Science 2022-03-14 Kai Zhu , Jinhui Wang , Shunchuan Yang

Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Given a finite number of samples of a continuous set-valued function F, mapping an interval to compact subsets of the real line, we develop good approximations of F, which can be computed efficiently.

Numerical Analysis · Mathematics 2022-09-01 Qusay Muzaffar , Nira Dyn , David Levin

A particularly successful role for Inductive Logic Programming (ILP) is as a tool for discovering useful relational features for subsequent use in a predictive model. Conceptually, the case for using ILP to construct relational features…

Machine Learning · Computer Science 2014-09-12 Haimonti Dutta , Ashwin Srinivasan

We study algorithmic aspects of finding $n$-dimensional \emph{positive} and \emph{negative} Hopfield ($\pm$Hop) model ground state free energies. This corresponds to classical maximization of random positive/negative semi-definite quadratic…

Disordered Systems and Neural Networks · Physics 2025-07-31 Mihailo Stojnic

Linear position interpolation helps pre-trained models using rotary position embeddings (RoPE) to extrapolate to longer sequence lengths. We propose using linear position interpolation to extend the extrapolation range of models using…

Computation and Language · Computer Science 2023-10-23 Faisal Al-Khateeb , Nolan Dey , Daria Soboleva , Joel Hestness

Salient facts of sociopolitical events are distilled into quadruples following a format of subject, relation, object, and timestamp. Machine learning methods, such as graph neural networks (GNNs) and recurrent neural networks (RNNs), have…

Computation and Language · Computer Science 2024-12-03 Libo Zhang , Yue Ning

There has been a great deal of recent interest in methods for performing lifted inference; however, most of this work assumes that the first-order model is given as input to the system. Here, we describe lifted inference algorithms that…

Artificial Intelligence · Computer Science 2012-05-14 Prithviraj Sen , Amol Deshpande , Lise Getoor