English
Related papers

Related papers: Generative approach to unsupervised deep local lea…

200 papers

The ability to predict future states of the environment is a central pillar of intelligence. At its core, effective prediction requires an internal model of the world and an understanding of the rules by which the world changes. Here, we…

Machine Learning · Computer Science 2016-01-21 William Lotter , Gabriel Kreiman , David Cox

We propose a new method for embedding graphs while preserving directed edge information. Learning such continuous-space vector representations (or embeddings) of nodes in a graph is an important first step for using network information…

Machine Learning · Computer Science 2017-09-15 Sami Abu-El-Haija , Bryan Perozzi , Rami Al-Rfou

In this paper, we treat the image generation task using an autoencoder, a representative latent model. Unlike many studies regularizing the latent variable's distribution by assuming a manually specified prior, we approach the image…

Machine Learning · Computer Science 2021-08-27 Jaeyoung Yoo , Hojun Lee , Nojun Kwak

Generative learning is a powerful tool for representation learning, and shows particular promise for problems in biomedical imaging. However, in this context, sampling from the distribution is secondary to finding representations of real…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Simon Myles Thomas

Supervised training of neural networks for classification is typically performed with a global loss function. The loss function provides a gradient for the output layer, and this gradient is back-propagated to hidden layers to dictate an…

Machine Learning · Statistics 2019-05-09 Arild Nøkland , Lars Hiller Eidnes

Generating realistic graph-structured data is challenging due to discrete structures, variable sizes, and class-specific connectivity patterns that resist conventional generative modelling. While recent graph generation methods employ…

Machine Learning · Computer Science 2026-02-02 Seyedeh Ava Razi Razavi , James Sargant , Sheridan Houghten , Renata Dividino

Different layouts can characterize different aspects of the same graph. Finding a "good" layout of a graph is thus an important task for graph visualization. In practice, users often visualize a graph in multiple layouts by using different…

Social and Information Networks · Computer Science 2019-10-16 Oh-Hyun Kwon , Kwan-Liu Ma

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

The rise of machine learning has fueled the discovery of new materials and, especially, metamaterials--truss lattices being their most prominent class. While their tailorable properties have been explored extensively, the design of…

Computational Engineering, Finance, and Science · Computer Science 2024-04-17 Li Zheng , Konstantinos Karapiperis , Siddhant Kumar , Dennis M. Kochmann

We propose a novel locally adaptive learning estimator for enhancing the inter- and intra- discriminative capabilities of Deep Neural Networks, which can be used as improved loss layer for semantic image segmentation tasks. Most loss layers…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Jinjiang Guo , Pengyuan Ren , Aiguo Gu , Jian Xu , Weixin Wu

Graph convolutional networks (GCNs) have been widely used for representation learning on graph data, which can capture structural patterns on a graph via specifically designed convolution and readout operations. In many graph classification…

Machine Learning · Computer Science 2020-10-13 Wenfeng Liu , Maoguo Gong , Zedong Tang , A. K. Qin

We present an approach that combines automatic features learned by convolutional neural networks (CNN) and handcrafted features computed by the bag-of-visual-words (BOVW) model in order to achieve state-of-the-art results in facial…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Mariana-Iuliana Georgescu , Radu Tudor Ionescu , Marius Popescu

Deep directed generative models have attracted much attention recently due to their generative modeling nature and powerful data representation ability. In this paper, we review different structures of deep directed generative models and…

Machine Learning · Computer Science 2017-10-16 Siqi Nie , Meng Zheng , Qiang Ji

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

We introduce a principled approach for unsupervised structure learning of deep neural networks. We propose a new interpretation for depth and inter-layer connectivity where conditional independencies in the input distribution are encoded…

Machine Learning · Statistics 2018-10-18 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Guy Koren , Gal Novik

Deep learning approaches heavily rely on high-quality human supervision which is nonetheless expensive, time-consuming, and error-prone, especially for image segmentation task. In this paper, we propose a method to automatically synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Yu Yang , Hakan Bilen , Qiran Zou , Wing Yin Cheung , Xiangyang Ji

In recent years generative models of visual data have made a great progress, and now they are able to produce images of high quality and diversity. In this work we study representations learnt by a GAN generator. First, we show that these…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Danil Galeev , Konstantin Sofiiuk , Danila Rukhovich , Mikhail Romanov , Olga Barinova , Anton Konushin

Reconciling symbolic and distributed representations is a crucial challenge that can potentially resolve the limitations of current deep learning. Remarkable advances in this direction have been achieved recently via generative…

Machine Learning · Computer Science 2021-02-09 Jindong Jiang , Sungjin Ahn

Graph convolutional networks (GCNs) enable end-to-end learning on graph structured data. However, many works assume a given graph structure. When the input graph is noisy or unavailable, one approach is to construct or learn a latent graph…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Avishkar Saha , Oscar Mendez , Chris Russell , Richard Bowden