English
Related papers

Related papers: MSMix:An Interpolation-Based Text Data Augmentatio…

200 papers

Advanced data augmentation strategies have widely been studied to improve the generalization ability of deep learning models. Regional dropout is one of the popular solutions that guides the model to focus on less discriminative parts by…

Machine Learning · Computer Science 2021-07-28 A. F. M. Shahab Uddin , Mst. Sirazam Monira , Wheemyung Shin , TaeChoong Chung , Sung-Ho Bae

Learning in weight spaces, where neural networks process the weights of other deep neural networks, has emerged as a promising research direction with applications in various fields, from analyzing and editing neural fields and implicit…

Mixed Sample Regularization (MSR), such as MixUp or CutMix, is a powerful data augmentation strategy to generalize convolutional neural networks. Previous empirical analysis has illustrated an orthogonal performance gain between MSR and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yiqing Shen , Liwu Xu , Yuzhe Yang , Yaqian Li , Yandong Guo

Data augmentation is a necessity to enhance data efficiency in deep learning. For vision-language pre-training, data is only augmented either for images or for text in previous works. In this paper, we present MixGen: a joint data…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Xiaoshuai Hao , Yi Zhu , Srikar Appalaraju , Aston Zhang , Wanqian Zhang , Bo Li , Mu Li

As Deep Neural Networks have achieved thrilling breakthroughs in the past decade, data augmentations have garnered increasing attention as regularization techniques when massive labeled data are unavailable. Among existing augmentations,…

Machine Learning · Computer Science 2025-04-24 Xin Jin , Hongyu Zhu , Siyuan Li , Zedong Wang , Zicheng Liu , Juanxi Tian , Chang Yu , Huafeng Qin , Stan Z. Li

With the rapid development of deep learning, automatic modulation recognition (AMR), as an important task in cognitive radio, has gradually transformed from traditional feature extraction and classification to automatic classification by…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Xinjie Xu , Zhuangzhi Chen , Dongwei Xu , Huaji Zhou , Shanqing Yu , Shilian Zheng , Qi Xuan , Xiaoniu Yang

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

Missing data imputation, which aims to impute the missing values in the raw datasets to achieve the completeness of datasets, is crucial for modern data-driven models like large language models (LLMs) and has attracted increasing interest…

Machine Learning · Computer Science 2025-01-07 Jianwei Wang , Kai Wang , Ying Zhang , Wenjie Zhang , Xiwei Xu , Xuemin Lin

We propose a novel image sampling method for differentiable image transformation in deep neural networks. The sampling schemes currently used in deep learning, such as Spatial Transformer Networks, rely on bilinear interpolation, which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Wei Jiang , Weiwei Sun , Andrea Tagliasacchi , Eduard Trulls , Kwang Moo Yi

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Model merging aims to integrate multiple task-specific models into a unified model that inherits the capabilities of the task-specific models, without additional training. Existing model merging methods often lack consideration of the…

Computation and Language · Computer Science 2025-08-07 Yue Zhou , Yi Chang , Yuan Wu

Raven's Progressive Matrices (RPMs) are frequently used in testing human's visual reasoning ability. Recent advances of RPM-like datasets and solution models partially address the challenges of visually understanding the RPM questions and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Wentao He , Jianfeng Ren , Ruibin Bai

This contribution introduces a novel signal extrapolation algorithm and its application to image error concealment. The signal extrapolation is carried out by iteratively generating a model of the signal suffering from distortion. Thereby,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Jürgen Seiler , André Kaup

This paper proposes a non-data-driven deep neural network for spectral image recovery problems such as denoising, single hyperspectral image super-resolution, and compressive spectral imaging reconstruction. Unlike previous methods, the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Tatiana Gelvez-Barrera , Jorge Bacca , Henry Arguello

In recent years, various deep learning techniques have been exploited in side channel attacks, with the anticipation of obtaining more appreciable attack results. Most of them concentrate on improving network architectures or putting…

Cryptography and Security · Computer Science 2024-01-18 Zhimin Luo , Mengce Zheng , Ping Wang , Minhui Jin , Jiajia Zhang , Honggang Hu

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

Machine Learning · Computer Science 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

MixUp is a data augmentation strategy where additional samples are generated during training by combining random pairs of training samples and their labels. However, selecting random pairs is not potentially an optimal choice. In this work,…

Computation and Language · Computer Science 2022-05-09 Seo Yeon Park , Cornelia Caragea

Learning mappings of data on manifolds is an important topic in contemporary machine learning, with applications in astrophysics, geophysics, statistical physics, medical diagnosis, biochemistry, 3D object analysis. This paper studies the…

Numerical Analysis · Mathematics 2020-07-21 Guido Montúfar , Yu Guang Wang

Despite the success of mixup in data augmentation, its applicability to natural language processing (NLP) tasks has been limited due to the discrete and variable-length nature of natural languages. Recent studies have thus relied on…

Computation and Language · Computer Science 2021-12-30 Yekyung Kim , Seohyeong Jeong , Kyunghyun Cho

The rise in internet usage has led to the generation of massive amounts of data, resulting in the adoption of various supervised and semi-supervised machine learning algorithms, which can effectively utilize the colossal amount of data to…