English
Related papers

Related papers: Provably Learning Diverse Features in Multi-View D…

200 papers

Few-shot learning aims to classify unseen classes with a few training examples. While recent works have shown that standard mini-batch training with a carefully designed training strategy can improve generalization ability for unseen…

Machine Learning · Computer Science 2021-03-02 Jin-Woo Seo , Hong-Gyu Jung , Seong-Whan Lee

Data augmentation is a cornerstone of the machine learning pipeline, yet its theoretical underpinnings remain unclear. Is it merely a way to artificially augment the data set size? Or is it about encouraging the model to satisfy certain…

Machine Learning · Computer Science 2022-09-22 Ruoqi Shen , Sébastien Bubeck , Suriya Gunasekar

When deep learning is applied to visual object recognition, data augmentation is often used to generate additional training data without extra labeling cost. It helps to reduce overfitting and increase the performance of the algorithm. In…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Alexey Dosovitskiy , Jost Tobias Springenberg , Thomas Brox

Mixup is a well-established data augmentation technique, which can extend the training distribution and regularize the neural networks by creating ''mixed'' samples based on the label-equivariance assumption, i.e., a proportional mixup of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zongbo Han , Tianchi Xie , Bingzhe Wu , Qinghua Hu , Changqing Zhang

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

There is growing interest in the challenging visual perception task of learning from long-tailed class distributions. The extreme class imbalance in the training dataset biases the model to prefer recognizing majority class data over…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jae Soon Baik , In Young Yoon , Jun Won Choi

Multiple instance learning exhibits a powerful approach for whole slide image-based diagnosis in the absence of pixel- or patch-level annotations. In spite of the huge size of hole slide images, the number of individual slides is often…

Finetuning on domain-specific data is a well-established method for enhancing LLM performance on downstream tasks. Training on each dataset produces a new set of model weights, resulting in a multitude of checkpoints saved in-house or on…

Machine Learning · Computer Science 2026-03-12 Sofia Maria Lo Cicero Vaina , Artem Chumachenko , Max Ryabinin

Feature selection can facilitate the learning of mixtures of discrete random variables as they arise, e.g. in crowdsourcing tasks. Intuitively, not all workers are equally reliable but, if the less reliable ones could be eliminated, then…

Machine Learning · Statistics 2017-11-28 Vincent Zhao , Steven W. Zucker

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

User data confidentiality protection is becoming a rising challenge in the present deep learning research. Without access to data, conventional data-driven model compression faces a higher risk of performance degradation. Recently, some…

Machine Learning · Computer Science 2022-01-28 Yuhang Li , Feng Zhu , Ruihao Gong , Mingzhu Shen , Xin Dong , Fengwei Yu , Shaoqing Lu , Shi Gu

Obtaining object response maps is one important step to achieve weakly-supervised semantic segmentation using image-level labels. However, existing methods rely on the classification task, which could result in a response map only attending…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yu-Ting Chang , Qiaosong Wang , Wei-Chih Hung , Robinson Piramuthu , Yi-Hsuan Tsai , Ming-Hsuan Yang

MixUp is an effective data augmentation method to regularize deep neural networks via random linear interpolations between pairs of samples and their labels. It plays an important role in model regularization, semi-supervised learning and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Zhijun Mai , Guosheng Hu , Dexiong Chen , Fumin Shen , Heng Tao Shen

Mixup data augmentation approaches have been applied for various tasks of deep learning to improve the generalization ability of deep neural networks. Some existing approaches CutMix, SaliencyMix, etc. randomly replace a patch in one image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Huafeng Qin , Xin Jin , Hongyu Zhu , Hongchao Liao , Mounîm A. El-Yacoubi , Xinbo Gao

Domain generalization (DG) aims to learn a generalizable model from multiple training domains such that it can perform well on unseen target domains. A popular strategy is to augment training data to benefit generalization through methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Wang Lu , Jindong Wang , Han Yu , Lei Huang , Xiang Zhang , Yiqiang Chen , Xing Xie

In recent years, various deep learning techniques have been exploited in side channel attacks, with the anticipation of obtaining more appreciable attack results. Most of them concentrate on improving network architectures or putting…

Cryptography and Security · Computer Science 2024-01-18 Zhimin Luo , Mengce Zheng , Ping Wang , Minhui Jin , Jiajia Zhang , Honggang Hu

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

In this work, we propose data augmentation via pairwise mixup across subgroups to improve group fairness. Many real-world applications of machine learning systems exhibit biases across certain groups due to under-representation or training…

Machine Learning · Statistics 2023-09-14 Madeline Navarro , Camille Little , Genevera I. Allen , Santiago Segarra

Data augmentation is now an essential part of the image training process, as it effectively prevents overfitting and makes the model more robust against noisy datasets. Recent mixing augmentation strategies have advanced to generate the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minsoo Kang , Suhyun Kim