English
Related papers

Related papers: Blind Biological Sequence Denoising with Self-Supe…

200 papers

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Semi-supervised object detection (SSOD) aims to facilitate the training and deployment of object detectors with the help of a large amount of unlabeled data. Though various self-training based and consistency-regularization based SSOD…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Binghui Chen , Pengyu Li , Xiang Chen , Biao Wang , Lei Zhang , Xian-Sheng Hua

Semantic segmentation of various tissue and nuclei types in histology images is fundamental to many downstream tasks in the area of computational pathology (CPath). In recent years, Deep Learning (DL) methods have been shown to perform well…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Raja Muhammad Saad Bashir , Talha Qaiser , Shan E Ahmed Raza , Nasir M. Rajpoot

Learning sentence embeddings often requires a large amount of labeled data. However, for most tasks and domains, labeled data is seldom available and creating it is expensive. In this work, we present a new state-of-the-art unsupervised…

Computation and Language · Computer Science 2021-09-13 Kexin Wang , Nils Reimers , Iryna Gurevych

Coherent noise regularly plagues seismic recordings, causing artefacts and uncertainties in products derived from down-the-line processing and imaging tasks. The outstanding capabilities of deep learning in denoising of natural and medical…

Geophysics · Physics 2022-06-02 Sixiu Liu , Claire Birnie , Tariq Alkhalifah

Neural networks trained on biased datasets tend to inadvertently learn spurious correlations, hindering generalization. We formally prove that (1) samples that exhibit spurious correlations lie on a lower rank manifold relative to the ones…

Machine Learning · Computer Science 2024-11-07 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Abhra Chaudhuri , Anjan Dutta

Motivation: Next generation methods of DNA sequencing produce relatively high rate of reading errors, which interfere with de novo genome assembly of newly sequenced organisms and particularly affect the quality of SNP detection important…

Genomics · Quantitative Biology 2019-07-31 Oleg Fokin , Anastasia Bakulina , Igor Seledtsov , Victor Solovyev

In this work, we propose a novel straightforward method for medical volume and sequence segmentation with limited annotations. To avert laborious annotating, the recent success of self-supervised learning(SSL) motivates the pre-training on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zejian Chen , Wei Zhuo , Tianfu Wang , Wufeng Xue , Dong Ni

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) considers a more practical scenario, where unlabeled data and…

Machine Learning · Computer Science 2024-04-16 Yang Yu , Danruo Deng , Furui Liu , Yueming Jin , Qi Dou , Guangyong Chen , Pheng-Ann Heng

Cell type identification from single-cell transcriptomic data is a common goal of single-cell RNA sequencing (scRNAseq) data analysis. Neural networks have been employed to identify cell types from scRNAseq data with high performance.…

Genomics · Quantitative Biology 2020-05-11 Xishuang Dong , Shanta Chowdhury , Uboho Victor , Xiangfang Li , Lijun Qian

In this work, we observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks (e.g., semantic segmentation). We refer to this phenomenon as Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

We propose a novel self-supervised image blind denoising approach in which two neural networks jointly predict the clean signal and infer the noise distribution. Assuming that the noisy observations are independent conditionally to the…

Machine Learning · Computer Science 2021-02-17 Jean Ollion , Charles Ollion , Elisabeth Gassiat , Luc Lehéricy , Sylvain Le Corff

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sotirios Konstantakos , Jorgen Cani , Ioannis Mademlis , Despina Ioanna Chalkiadaki , Yuki M. Asano , Efstratios Gavves , Georgios Th. Papadopoulos

Deep learning based methods hold state-of-the-art results in low-level image processing tasks, but remain difficult to interpret due to their black-box construction. Unrolled optimization networks present an interpretable alternative to…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

The success of deep learning has been witnessed as a promising technique for computer-aided biomedical image analysis, due to end-to-end learning framework and availability of large-scale labelled samples. However, in many cases of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Pengyi Zhang , Yunxin Zhong , Yulin Deng , Xiaoying Tang , Xiaoqiong Li

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

Machine Learning · Computer Science 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue