English
Related papers

Related papers: SUMix: Mixup with Semantic and Uncertain Informati…

200 papers

Existing pretraining data mixing methods for large language models (LLMs) typically follow a domain-wise methodology, a top-down process that first determines domain weights and then performs uniform data sampling across each domain.…

Computation and Language · Computer Science 2025-03-04 Xiangyu Xi , Deyang Kong , Jian Yang , Jiawei Yang , Zhengyu Chen , Wei Wang , Jingang Wang , Xunliang Cai , Shikun Zhang , Wei Ye

Data augmentation is one of the regularization strategies for the training of deep learning models, which enhances generalizability and prevents overfitting, leading to performance improvement. Although researchers have proposed various…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Juhwan Choi , YoungBin Kim

In computational pathology, researchers often face challenges due to the scarcity of labeled pathology datasets. Data augmentation emerges as a crucial technique to mitigate this limitation. In this study, we introduce an efficient data…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jiamu Wang , Jin Tae Kwak

This paper introduces MixDiff, a new self-supervised learning (SSL) pre-training framework that combines real and synthetic images. Unlike traditional SSL methods that predominantly use real images, MixDiff uses a variant of Stable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Reza Akbarian Bafghi , Nidhin Harilal , Claire Monteleoni , Maziar Raissi

Combining complementary information from multiple modalities is intuitively appealing for improving the performance of learning-based approaches. However, it is challenging to fully leverage different modalities due to practical challenges…

Machine Learning · Statistics 2018-05-31 Kuan Liu , Yanen Li , Ning Xu , Prem Natarajan

Based on the observation that semantic segmentation errors are partially predictable, we propose a compact formulation using confusion statistics of the trained classifier to refine (re-estimate) the initial pixel label hypotheses. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 James W. Davis , Christopher Menart , Muhammad Akbar , Roman Ilin

State-of-the-art video action classifiers often suffer from overfitting. They tend to be biased towards specific objects and scene cues, rather than the foreground action content, leading to sub-optimal generalization performances. Recent…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Sangdoo Yun , Seong Joon Oh , Byeongho Heo , Dongyoon Han , Jinhyung Kim

Semi-supervised techniques have removed the barriers of large scale labelled set by exploiting unlabelled data to improve the performance of a model. In this paper, we propose a semi-supervised deep multi-task classification and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 R. M. Saad Bashir , Talha Qaiser , Shan E Ahmed Raza , Nasir M. Rajpoot

Patch-level data augmentation techniques such as Cutout and CutMix have demonstrated significant efficacy in enhancing the performance of vision tasks. However, a comprehensive theoretical understanding of these methods remains elusive. In…

Machine Learning · Computer Science 2024-11-01 Junsoo Oh , Chulhee Yun

Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved. However, in real-world scenarios, due to the limited accessible training pairs, large models exhibit…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ruicheng Feng , Jinjin Gu , Yu Qiao , Chao Dong

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Generalizable person re-identification (Re-ID) aims to recognize individuals across unseen cameras and environments. While existing methods rely heavily on limited labeled multi-camera data, we propose DynaMix, a novel method that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Timur Mamedov , Anton Konushin , Vadim Konushin

A recently-proposed technique called self-adaptive training augments modern neural networks by allowing them to adjust training labels on the fly, to avoid overfitting to samples that may be mislabeled or otherwise non-representative. By…

Machine Learning · Computer Science 2020-06-16 Daniel Chiu , Franklyn Wang , Scott Duke Kominers

Respiratory sound classification plays a pivotal role in diagnosing respiratory diseases. While deep learning models have shown success with various respiratory sound datasets, our experiments indicate that models trained on one dataset…

Sound · Computer Science 2025-01-03 Shijia Ge , Weixiang Zhang , Shuzhao Xie , Baixu Yan , Zhi Wang

Recently contrastive learning has shown significant progress in learning visual representations from unlabeled data. The core idea is training the backbone to be invariant to different augmentations of an instance. While most methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Xiaoyang Guo , Tianhao Zhao , Yutian Lin , Bo Du

In computer vision, depth estimation is crucial for domains like robotics, autonomous vehicles, augmented reality, and virtual reality. Integrating semantics with depth enhances scene understanding through reciprocal information sharing.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Md Awsafur Rahman , Shaikh Anowarul Fattah

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Modern person re-identification (Re-ID) methods have a weak generalization ability and experience a major accuracy drop when capturing environments change. This is because existing multi-camera Re-ID datasets are limited in size and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Timur Mamedov , Anton Konushin , Vadim Konushin

The rise in internet usage has led to the generation of massive amounts of data, resulting in the adoption of various supervised and semi-supervised machine learning algorithms, which can effectively utilize the colossal amount of data to…

Semi-Supervised Learning (SSL) algorithms have shown great potential in training regimes when access to labeled data is scarce but access to unlabeled data is plentiful. However, our experiments illustrate several shortcomings that prior…

Machine Learning · Computer Science 2019-12-19 Varun Nair , Javier Fuentes Alonso , Tony Beltramelli