English
Related papers

Related papers: MixDiff: Mixing Natural and Synthetic Images for R…

200 papers

Despite substantial progress in the field of deep learning, overfitting persists as a critical challenge, and data augmentation has emerged as a particularly promising approach due to its capacity to enhance model generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Wen Liang , Youzhi Liang , Jianguo Jia

Self-Supervised Learning (SSL) has become a prominent approach for acquiring visual representations across various tasks, yet its application in fine-grained visual recognition (FGVR) is challenged by the intricate task of distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zihu Wang , Lingqiao Liu , Scott Ricardo Figueroa Weston , Samuel Tian , Peng Li

We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this problem, we propose a new SSL pipeline, consisting of first…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Zhaowei Cai , Avinash Ravichandran , Paolo Favaro , Manchen Wang , Davide Modolo , Rahul Bhotika , Zhuowen Tu , Stefano Soatto

Self-supervised learning (SSL) applied to natural images has demonstrated a remarkable ability to learn meaningful, low-dimension representations without labels, resulting in models that are adaptable to many different tasks. Until now,…

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

We present an approach to enhancing the realism of synthetic images. The images are enhanced by a convolutional network that leverages intermediate representations produced by conventional rendering pipelines. The network is trained via a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Stephan R. Richter , Hassan Abu AlHaija , Vladlen Koltun

Clients in a distributed or federated environment will often hold data skewed towards differing subsets of labels. This scenario, referred to as heterogeneous or non-iid federated learning, has been shown to significantly hinder model…

Machine Learning · Computer Science 2024-09-23 Kyle Sang , Tahseen Rabbani , Furong Huang

Deep learning has led to remarkable advances in computer vision. Even so, today's best models are brittle when presented with variations that differ even slightly from those seen during training. Minor shifts in the pose, color, or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Mark Ibrahim , Diane Bouchacourt , Ari Morcos

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Machine Learning · Computer Science 2024-06-05 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

Do we need active learning? The rise of strong deep semi-supervised methods raises doubt about the usability of active learning in limited labeled data settings. This is caused by results showing that combining semi-supervised learning…

Machine Learning · Computer Science 2023-08-17 Sandra Gilhuber , Rasmus Hvingelby , Mang Ling Ada Fok , Thomas Seidl

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhe Huang , Xiaowei Yu , Dajiang Zhu , Michael C. Hughes

State-of-the-art face recognition networks are often computationally expensive and cannot be used for mobile applications. Training lightweight face recognition models also requires large identity-labeled datasets. Meanwhile, there are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Medical image analysis suffers from a shortage of data, whether annotated or not. This becomes even more pronounced when it comes to 3D medical images. Self-Supervised Learning (SSL) can partially ease this situation by using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Fei Gao , Siwen Wang , Fandong Zhang , Hong-Yu Zhou , Yizhou Wang , Churan Wang , Gang Yu , Yizhou Yu

While self-supervised representation learning (SSL) has received widespread attention from the community, recent research argue that its performance will suffer a cliff fall when the model size decreases. The current method mainly relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yuting Gao , Jia-Xin Zhuang , Shaohui Lin , Hao Cheng , Xing Sun , Ke Li , Chunhua Shen

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass of unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2021-09-09 Ozan Ciga , Tony Xu , Anne L. Martel