English
Related papers

Related papers: Distributed Evolution of Deep Autoencoders

200 papers

Feedforward neural networks are widely used as universal predictive models to fit data distribution. Common gradient-based learning, however, suffers from many drawbacks making the training process ineffective and time-consuming.…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Neuro-Evolution is a field of study that has recently gained significantly increased traction in the deep learning community. It combines deep neural networks and evolutionary algorithms to improve and/or automate the construction of neural…

Neural and Evolutionary Computing · Computer Science 2020-10-05 Marijn van Knippenberg , Vlado Menkovski , Sergio Consoli

This paper deals with the distributed processing in the search for an optimum classification model using evolutionary product unit neural networks. For this distributed search we used a cluster of computers. Our objective is to obtain a…

Neural and Evolutionary Computing · Computer Science 2012-05-16 A. J. Tallón-Ballesteros , P. A. Gutiérrez-Peña , C. Hervás-Martínez

A probability distribution allows practitioners to uncover hidden structure in the data and build models to solve supervised learning problems using limited data. The focus of this report is on Variational autoencoders, a method to learn…

Machine Learning · Computer Science 2022-06-22 Vasanth Kalingeri

This study proposes an automated data mining framework based on autoencoders and experimentally verifies its effectiveness in feature extraction and data dimensionality reduction. Through the encoding-decoding structure, the autoencoder can…

Machine Learning · Computer Science 2024-12-04 Yaxin Liang , Xinshi Li , Xin Huang , Ziqi Zhang , Yue Yao

This study introduces a novel theoretical framework, the Stacked Autoencoder Evolution Hypothesis, which proposes that biological evolutionary systems operate through multi-layered self-encoding and decoding processes, analogous to stacked…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Hiroyuki Iizuka

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The…

Machine Learning · Computer Science 2018-03-06 Sohil Atul Shah , Vladlen Koltun

Autoencoders have emerged as a useful framework for unsupervised learning of internal representations, and a wide variety of apparently conceptually disparate regularization techniques have been proposed to generate useful features. Here we…

Neural and Evolutionary Computing · Computer Science 2014-06-10 Ben Poole , Jascha Sohl-Dickstein , Surya Ganguli

With the inexorable digitalisation of the modern world, every subset in the field of technology goes through major advancements constantly. One such subset is digital images which are ever so popular. Images can not always be as visually…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Prashanth Venkataraman

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

Machine Learning · Computer Science 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Autoencoders are a common building block of Deep Learning architectures, where they are mainly used for representation learning. They have also been successfully used in Collaborative Filtering (CF) recommender systems to predict missing…

Information Retrieval · Computer Science 2020-01-14 Pegah Sagheb Haghighi , Olurotimi Seton , Olfa Nasraoui

Autoencoders offer a general way of learning low-dimensional, non-linear representations from data without labels. This is achieved without making any particular assumptions about the data type or other domain knowledge. The generality and…

Machine Learning · Computer Science 2025-05-27 Collin Leiber , Lukas Miklautz , Claudia Plant , Christian Böhm

This paper proposes a theoretical framework on the mechanism of autoencoders. To the encoder part, under the main use of dimensionality reduction, we investigate its two fundamental properties: bijective maps and data disentangling. The…

Machine Learning · Computer Science 2022-12-13 Changcun Huang

In many machine learning tasks, learning a good representation of the data can be the key to building a well-performant solution. This is because most learning algorithms operate with the features in order to find models for the data. For…

Machine Learning · Computer Science 2020-05-22 David Charte , Francisco Charte , María J. del Jesus , Francisco Herrera

High-content screening uses large collections of unlabeled cell image data to reason about genetics or cell biology. Two important tasks are to identify those cells which bear interesting phenotypes, and to identify sub-populations enriched…

Machine Learning · Computer Science 2015-01-08 Lee Zamparo , Zhaolei Zhang

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

Disentangled distributed representations of data are desirable for machine learning, since they are more expressive and can generalize from fewer examples. However, for complex data, the distributed representations of multiple objects…

Machine Learning · Computer Science 2016-01-21 Klaus Greff , Rupesh Kumar Srivastava , Jürgen Schmidhuber

We propose split-brain autoencoders, a straightforward modification of the traditional autoencoder architecture, for unsupervised representation learning. The method adds a split to the network, resulting in two disjoint sub-networks. Each…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Richard Zhang , Phillip Isola , Alexei A. Efros

Feature descriptors involved in image processing are generally manually chosen and high dimensional in nature. Selecting the most important features is a very crucial task for systems like facial expression recognition. This paper…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Muhammad Usman , Siddique Latif , Junaid Qadir

Deep neural networks usually benefit from unsupervised pre-training, e.g. auto-encoders. However, the classifier further needs supervised fine-tuning methods for good discrimination. Besides, due to the limits of full-connection, the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Hailin Shi , Xiangyu Zhu , Zhen Lei , Shengcai Liao , Stan Z. Li