English
Related papers

Related papers: Utilizing the Mean Teacher with Supcontrast Loss f…

200 papers

Punctuation is critical in understanding natural language text. Currently, most automatic speech recognition (ASR) systems do not generate punctuation, which affects the performance of downstream tasks, such as intent detection and slot…

Computation and Language · Computer Science 2023-03-07 Qiushi Huang , Tom Ko , H Lilian Tang , Xubo Liu , Bo Wu

Table detection, a pivotal task in document analysis, aims to precisely recognize and locate tables within document images. Although deep learning has shown remarkable progress in this realm, it typically requires an extensive dataset of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Iqraa Ehsan , Tahira Shehzadi , Didier Stricker , Muhammad Zeshan Afzal

We propose a semi-supervised network for wide-angle portraits correction. Wide-angle images often suffer from skew and distortion affected by perspective distortion, especially noticeable at the face regions. Previous deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Fushun Zhu , Shan Zhao , Peng Wang , Hao Wang , Hua Yan , Shuaicheng Liu

In recent years, impressive performance of deep learning technology has been recognized in Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR). Since a large amount of annotated data is required in this technique, it poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yikui Zhai , Wenlve Zhou , Bing Sun , Jingwen Li , Qirui Ke , Zilu Ying , Junying Gan , Chaoyun Mai , Ruggero Donida Labati , Vincenzo Piuri , Fabio Scotti

Cross-domain object detection is challenging, because object detection model is often vulnerable to data variance, especially to the considerable domain shift between two distinctive domains. In this paper, we propose a new Unbiased Mean…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jinhong Deng , Wen Li , Yuhua Chen , Lixin Duan

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Despite the success of contrastive learning in Music Information Retrieval, the inherent ambiguity of contrastive self-supervision presents a challenge. Relying solely on augmentation chains and self-supervised positive sampling strategies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Julien Guinot , Elio Quinton , György Fazekas

Foundational vision models, such as the Segment Anything Model (SAM), have achieved significant breakthroughs through extensive pre-training on large-scale visual datasets. Despite their general success, these models may fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Ke Zhou , Zhongwei Qiu , Dongmei Fu

Supervised contrastive learning (SupCon) has proven to be a powerful alternative to the standard cross-entropy loss for classification of multi-class balanced datasets. However, it struggles to learn well-conditioned representations of…

Machine Learning · Computer Science 2025-03-24 David Mildenberger , Paul Hager , Daniel Rueckert , Martin J Menten

Semi-supervised learning (SSL) has long been proved to be an effective technique to construct powerful models with limited labels. In the existing literature, consistency regularization-based methods, which force the perturbed samples to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Xihong Yang , Xiaochang Hu , Sihang Zhou , Xinwang Liu , En Zhu

Knowledge distillation is a popular technique for transferring the knowledge from a large teacher model to a smaller student model by mimicking. However, distillation by directly aligning the feature maps between teacher and student may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Ziwei Liu , Yongtao Wang , Xiaojie Chu

Underwater images often exhibit poor quality, distorted color balance and low contrast due to the complex and intricate interplay of light, water, and objects. Despite the significant contributions of previous underwater enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Weiwen Chen , Yingtie Lei , Shenghong Luo , Ziyang Zhou , Mingxian Li , Chi-Man Pun

Unsupervised domain adaptation object detection (UDAOD) research on Detection Transformer(DETR) mainly focuses on feature alignment and existing methods can be divided into two kinds, each of which has its unresolved issues. One-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Weixi Weng , Chun Yuan

Data-efficient domain adaptation with only a few labelled data is desired for many robotic applications, e.g., in grasping detection, the inference skill learned from a grasping dataset is not universal enough to directly apply on various…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Haiyue Zhu , Yiting Li , Fengjun Bai , Wenjie Chen , Xiaocong Li , Jun Ma , Chek Sing Teo , Pey Yuen Tao , Wei Lin

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

There is extensive interest in metric learning methods for image retrieval. Many metric learning loss functions focus on learning a correct ranking of training samples, but strongly overfit semantically inconsistent labels and require a…

Machine Learning · Computer Science 2023-06-05 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

To efficiently deploy strong, often pre-trained feature extractors, recent Industrial Anomaly Detection and Segmentation (IADS) methods process low-resolution images, e.g., 224x224 pixels, obtained by downsampling the original input images.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Alex Costanzino , Pierluigi Zama Ramirez , Giuseppe Lisanti , Luigi Di Stefano

Speech Emotion Recognition (SER) is a challenging task due to limited data and blurred boundaries of certain emotions. In this paper, we present a comprehensive approach to improve the SER performance throughout the model lifecycle,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Xuechen Wang , Shiwan Zhao , Yong Qin

Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a…

Machine Learning · Computer Science 2019-10-25 David Berthelot , Nicholas Carlini , Ian Goodfellow , Nicolas Papernot , Avital Oliver , Colin Raffel

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin