English
Related papers

Related papers: Adaptation of Autoencoder for Sparsity Reduction F…

200 papers

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

This study investigates the use of unsupervised word embeddings and sequence features for sample representation in an active learning framework built to extract clinical concepts from clinical free text. The objective is to further reduce…

Computation and Language · Computer Science 2016-11-16 Mahnoosh Kholghi , Lance De Vine , Laurianne Sitbon , Guido Zuccon , Anthony Nguyen

In audio processing applications, the generation of expressive sounds based on high-level representations demonstrates a high demand. These representations can be used to manipulate the timbre and influence the synthesis of creative…

Sound · Computer Science 2023-01-19 Anastasia Natsiou , Luca Longo , Sean O'Leary

Unsupervised discovery of latent representations, in addition to being useful for density modeling, visualisation and exploratory data analysis, is also increasingly important for learning features relevant to discriminative tasks.…

Machine Learning · Statistics 2011-10-27 Jasper Snoek , Ryan Prescott Adams , Hugo Larochelle

In human neuroscience, machine learning can help reveal lower-dimensional neural representations relevant to subjects' behavior. However, state-of-the-art models typically require large datasets to train, so are prone to overfitting on…

Recurrent models for sequences have been recently successful at many tasks, especially for language modeling and machine translation. Nevertheless, it remains challenging to extract good representations from these models. For instance, even…

Machine Learning · Computer Science 2018-01-31 Łukasz Kaiser , Samy Bengio

We discuss the similarities and differences between training an auto-encoder to minimize the reconstruction error, and training the same auto-encoder to compress the data via a generative model. Minimizing a codelength for the data using an…

Neural and Evolutionary Computing · Computer Science 2015-01-26 Yann Ollivier

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

The autoencoder is an artificial neural network model that learns hidden representations of unlabeled data. With a linear transfer function it is similar to the principal component analysis (PCA). While both methods use weight vectors for…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Ya Ju Fan

Recent advances in explainable machine learning have highlighted the potential of sparse autoencoders in uncovering mono-semantic features in densely encoded embeddings. While most research has focused on Large Language Model (LLM)…

Computation and Language · Computer Science 2025-02-04 Daniel Pluth , Yu Zhou , Vijay K. Gurbani

Efficient querying and retrieval of healthcare data is posing a critical challenge today with numerous connected devices continuously generating petabytes of images, text, and internet of things (IoT) sensor data. One approach to…

Machine Learning · Computer Science 2023-02-28 Sazia Mahfuz , Farhana Zulkernine

We propose a novel deep learning model for classifying medical images in the setting where there is a large amount of unlabelled medical data available, but labelled data is in limited supply. We consider the specific case of classifying…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Antonia Creswell , Alison Pouplin , Anil A Bharath

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

Sparse representation has attracted great attention because it can greatly save storage resources and find representative features of data in a low-dimensional space. As a result, it may be widely applied in engineering domains including…

Neural and Evolutionary Computing · Computer Science 2022-11-09 Chunming Jiang , Yilei Zhang

Deep neural networks suffer from the major limitation of catastrophic forgetting old tasks when learning new ones. In this paper we focus on class incremental continual learning in semantic segmentation, where new categories are made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Umberto Michieli , Pietro Zanuttigh

We propose a novel machine learning strategy for studying neuroanatomical shape variation. Our model works with volumetric binary segmentation images, and requires no pre-processing such as the extraction of surface points or a mesh. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Evan M. Yu , Mert R. Sabuncu

This paper concerns the use of objectness measures to improve the calibration performance of Convolutional Neural Networks (CNNs). CNNs have proven to be very good classifiers and generally localize objects well; however, the loss functions…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ujwal Krothapalli , A. Lynn Abbott

This paper introduces SEMISE, a novel method for representation learning in medical imaging that combines self-supervised and supervised learning. By leveraging both labeled and augmented data, SEMISE addresses the challenge of data…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Dung T. Tran , Hung Vu , Anh Tran , Hieu Pham , Hong Nguyen , Phong Nguyen

Lossy compression has become an important technique to reduce data size in many domains. This type of compression is especially valuable for large-scale scientific data, whose size ranges up to several petabytes. Although Autoencoder-based…

Machine Learning · Computer Science 2024-07-03 Hieu Le , Jian Tao

Autoencoders learn data representations (codes) in such a way that the input is reproduced at the output of the network. However, it is not always clear what kind of properties of the input data need to be captured by the codes. Kernel…

Machine Learning · Statistics 2018-07-24 Michael Kampffmeyer , Sigurd Løkse , Filippo M. Bianchi , Robert Jenssen , Lorenzo Livi