English
Related papers

Related papers: Augmenting Variational Autoencoders with Sparse La…

200 papers

Deep neural network models trained on large labeled datasets are the state-of-the-art in a large variety of computer vision tasks. In many applications, however, labeled data is expensive to obtain or requires a time consuming manual…

Machine Learning · Computer Science 2017-12-01 Sergey Tulyakov , Andrew Fitzgibbon , Sebastian Nowozin

As tons of photos are being uploaded to public websites (e.g., Flickr, Bing, and Google) every day, learning from web data has become an increasingly popular research direction because of freely available web resources, which is also…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Li Niu , Qingtao Tang , Ashok Veeraraghavan , Ashu Sabharwal

Semi-supervised learning is sought for leveraging the unlabelled data when labelled data is difficult or expensive to acquire. Deep generative models (e.g., Variational Autoencoder (VAE)) and semisupervised Generative Adversarial Networks…

Machine Learning · Computer Science 2019-05-09 Xiang Zhang , Lina Yao , Feng Yuan

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

Machine Learning · Computer Science 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based auto encoders have shown great potential in detecting anomalies in medical images. However, state-of-the-art…

Machine Learning · Computer Science 2018-12-17 David Zimmerer , Simon A. A. Kohl , Jens Petersen , Fabian Isensee , Klaus H. Maier-Hein

Semi-supervised learning leverages unlabeled data to enhance model performance, addressing the limitations of fully supervised approaches. Among its strategies, pseudo-supervision has proven highly effective, typically relying on one or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Negin Ghamsarian , Sahar Nasirihaghighi , Klaus Schoeffmann , Raphael Sznitman

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

In this study, the effects of different class labels created as a result of multiple conceptual meanings on localization using Weakly Supervised Learning presented on Car Dataset. In addition, the generated labels are included in the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Cenk Bircanoglu

In this paper, we introduce a unique variant of the denoising Auto-Encoder and combine it with the perceptual loss to classify images in an unsupervised manner. The proposed method, called Pseudo Labelling, consists of first applying a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Aymene Mohammed Bouayed , Karim Atif , Rachid Deriche , Abdelhakim Saim

Sparse Autoencoders (SAEs) are increasingly used to interpret foundation models, but their role as an actionable intervention space remains less understood, especially in vision. We study whether sparse visual features can be used not only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gerasimos Chatzoudis , Zhuowei Li , Gemma E. Moran , Hao Wang , Dimitris N. Metaxas

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

We propose the application of a semi-supervised learning method to improve the performance of acoustic modelling for automatic speech recognition based on deep neural net- works. As opposed to unsupervised initialisation followed by…

Machine Learning · Statistics 2016-10-04 Akash Kumar Dhaka , Giampiero Salvi

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE, a pure ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Haojie Yu , Kang Zhao , Xiaoming Xu

Variational Autoencoder based Bayesian Optimization (VAE-BO) has demonstrated its excellent performance in addressing high-dimensional structured optimization problems. However, current mainstream methods overlook the potential of utilizing…

Machine Learning · Computer Science 2023-12-29 Taicai Chen , Yue Duan , Dong Li , Lei Qi , Yinghuan Shi , Yang Gao

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

The biomedical literature provides a rich source of knowledge such as protein-protein interactions (PPIs), drug-drug interactions (DDIs) and chemical-protein interactions (CPIs). Biomedical relation extraction aims to automatically extract…

Computation and Language · Computer Science 2019-01-21 Yijia Zhang , Zhiyong Lu

In recent years, deep discriminative models have achieved extraordinary performance on supervised learning tasks, significantly outperforming their generative counterparts. However, their success relies on the presence of a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Gaurav Pandey , Ambedkar Dukkipati

Understanding the internal organization of neural networks remains a fundamental challenge in deep learning interpretability. We address this challenge by exploring a novel Sparse Mixture of Experts Variational Autoencoder (SMoE-VAE)…

Machine Learning · Computer Science 2025-09-15 Strahinja Nikolic , Ilker Oguz , Demetri Psaltis

Traditional approaches for Visual Question Answering (VQA) require large amount of labeled data for training. Unfortunately, such large scale data is usually not available for medical domain. In this paper, we propose a novel medical VQA…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Binh D. Nguyen , Thanh-Toan Do , Binh X. Nguyen , Tuong Do , Erman Tjiputra , Quang D. Tran

Digitalization leads to data transparency for production systems that we can benefit from with data-driven analysis methods like neural networks. For example, automated anomaly detection enables saving resources and optimizing the…

Machine Learning · Computer Science 2021-06-23 Tom Hammerbacher , Markus Lange-Hegermann , Gorden Platz