English
Related papers

Related papers: Embedding Space Interpolation Beyond Mini-Batch, B…

200 papers

Determining sentence pair similarity is crucial for various NLP tasks. A common technique to address this is typically evaluated on a continuous semantic textual similarity scale from 0 to 5. However, based on a linguistic observation in…

Computation and Language · Computer Science 2024-06-06 Wuttikorn Ponwitayarat , Peerat Limkonchotiwat , Ekapol Chuangsuwanich , Sarana Nutanong

Data augmentation is an effective technique to improve the generalization of deep neural networks. However, previous data augmentation methods usually treat the augmented samples equally without considering their individual impacts on the…

Machine Learning · Computer Science 2021-03-17 Mingyang Yi , Lu Hou , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

Data augmentation is an essential technique for improving recognition accuracy in object recognition using deep learning. Methods that generate mixed data from multiple data sets, such as mixup, can acquire new diversity that is not…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Shungo Fujii , Yasunori Ishii , Kazuki Kozuka , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

In this work, we first propose a fully differentiable Many-to-Many (M2M) splatting framework to interpolate frames efficiently. Given a frame pair, we estimate multiple bidirectional flows to directly forward warp the pixels to the desired…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Ping Hu , Simon Niklaus , Lu Zhang , Stan Sclaroff , Kate Saenko

Interpolators are unstable. For example, the mininum $\ell_2$ norm least square interpolator exhibits unbounded test errors when dealing with noisy data. In this paper, we study how ensemble stabilizes and thus improves the generalization…

Machine Learning · Statistics 2023-09-08 Mingqi Wu , Qiang Sun

Mix-based augmentation has been proven fundamental to the generalization of deep vision models. However, current augmentations only mix samples at the current data batch during training, which ignores the possible knowledge accumulated in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Lingfeng Yang , Xiang Li , Borui Zhao , Renjie Song , Jian Yang

Mixture models are powerful statistical models used in many applications ranging from density estimation to clustering and classification. When dealing with mixture models, there are many issues that the experimenter should be aware of and…

Machine Learning · Statistics 2015-07-23 Reshad Hosseini , Mohamadreza Mash'al

One little-explored frontier of image generation and editing is the task of interpolating between two input images, a feature missing from all currently deployed image generation pipelines. We argue that such a feature can expand the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Clinton J. Wang , Polina Golland

Spectral variability in hyperspectral images can result from factors including environmental, illumination, atmospheric and temporal changes. Its occurrence may lead to the propagation of significant estimation errors in the unmixing…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Ricardo Augusto Borsoi , Tales Imbiriba , José Carlos Moreira Bermudez

Despite the success of mixup in data augmentation, its applicability to natural language processing (NLP) tasks has been limited due to the discrete and variable-length nature of natural languages. Recent studies have thus relied on…

Computation and Language · Computer Science 2021-12-30 Yekyung Kim , Seohyeong Jeong , Kyunghyun Cho

Data mixing (e.g., Mixup, Cutmix, ResizeMix) is an essential component for advancing recognition models. In this paper, we focus on studying its effectiveness in the self-supervised setting. By noticing the mixed images that share the same…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Sucheng Ren , Huiyu Wang , Zhengqi Gao , Shengfeng He , Alan Yuille , Yuyin Zhou , Cihang Xie

Finding well-defined clusters in data represents a fundamental challenge for many data-driven applications, and largely depends on good data representation. Drawing on literature regarding representation learning, studies suggest that one…

Machine Learning · Computer Science 2020-11-05 Daniel Lutscher , Ali el Hassouni , Maarten Stol , Mark Hoogendoorn

For many use cases, combining information from different datasets can be of interest to improve a machine learning model's performance, especially when the number of samples from at least one of the datasets is small. However, a potential…

Machine Learning · Statistics 2023-05-17 Thu Nguyen , Rabindra Khadka , Nhan Phan , Anis Yazidi , Pål Halvorsen , Michael A. Riegler

In the era of big data, we first need to manage the data, which requires us to find missing data or predict the trend, so we need operations including interpolation and data fitting. Interpolation is a process to discover deducing new data…

Numerical Analysis · Mathematics 2022-08-26 Yijie Xu , Runqi Xu

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Yangbin Chen , Yun Ma , Tom Ko , Jianping Wang , Qing Li

Meta-Learning has emerged as a research direction to better transfer knowledge from related tasks to unseen but related tasks. However, Meta-Learning requires many training tasks to learn representations that transfer well to unseen tasks;…

Computation and Language · Computer Science 2022-10-13 Surya Kant Sahu

Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called RandoMix. RandoMix is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Calibrating a multiclass predictor, that outputs a distribution over labels, is particularly challenging due to the exponential number of possible prediction values. In this work, we propose a new definition of calibration error that…

Machine Learning · Computer Science 2025-09-30 Konstantina Bairaktari , Huy L. Nguyen

Improved EM strategies, based on the idea of efficient data augmentation (Meng and van Dyk 1997, 1998), are presented for ML estimation of mixture proportions. The resulting algorithms inherit the simplicity, ease of implementation, and…

Computation · Statistics 2010-02-22 Yaming Yu

Text embeddings, i.e. vector representations of entire texts, play an important role in many NLP applications, such as retrieval-augmented generation, clustering, or visualizing collections of texts for data exploration. Currently,…

Computation and Language · Computer Science 2026-03-17 Rita González-Márquez , Philipp Berens , Dmitry Kobak