English
Related papers

Related papers: A Generative Model for Deep Convolutional Learning

200 papers

We introduce a new method for training deep Boltzmann machines jointly. Prior methods of training DBMs require an initial learning pass that trains the model greedily, one layer at a time, or do not perform well on classification tasks. In…

Machine Learning · Statistics 2013-05-02 Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

In this paper, a novel multi-view methodology for graph-based neural networks is proposed. A systematic and methodological adaptation of the key concepts of classical deep learning methods such as convolution, pooling and multi-view…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Nikolas Adaloglou , Nicholas Vretos , Petros Daras

Generative models are known to be difficult to assess. Recent works, especially on generative adversarial networks (GANs), produce good visual samples of varied categories of images. However, the validation of their quality is still…

Machine Learning · Computer Science 2019-09-25 Timothée Lesort , Andrei Stoain , Jean-François Goudou , David Filliat

The rapid advancement of generative models has empowered modern AI systems to comprehend and produce highly sophisticated content, even achieving human-level performance in specific domains. However, these models are fundamentally…

Neural networks are prone to catastrophic forgetting when trained incrementally on different tasks. Popular incremental learning methods mitigate such forgetting by retaining a subset of previously seen samples and replaying them during the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Kevin Thandiackal , Tiziano Portenier , Andrea Giovannini , Maria Gabrani , Orcun Goksel

Learning from Demonstrations, the field that proposes to learn robot behavior models from data, is gaining popularity with the emergence of deep generative models. Although the problem has been studied for years under names such as…

Building models capable of generating structured output is a key challenge for AI and robotics. While generative models have been explored on many types of data, little work has been done on synthesizing lidar scans, which play a key role…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Lucas Caccia , Herke van Hoof , Aaron Courville , Joelle Pineau

Clustering artworks is difficult for several reasons. On the one hand, recognizing meaningful patterns in accordance with domain knowledge and visual perception is extremely difficult. On the other hand, applying traditional clustering and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Giovanna Castellano , Gennaro Vessio

Taking inspiration from biological evolution, we explore the idea of "Can deep neural networks evolve naturally over successive generations into highly efficient deep neural networks?" by introducing the notion of synthesizing new highly…

Computer Vision and Pattern Recognition · Computer Science 2017-02-08 Mohammad Javad Shafiee , Akshaya Mishra , Alexander Wong

Modern deep neural networks are well known to be brittle in the face of unknown data instances and recognition of the latter remains a challenge. Although it is inevitable for continual-learning systems to encounter such unseen concepts,…

Machine Learning · Computer Science 2022-04-04 Martin Mundt , Iuliia Pliushch , Sagnik Majumder , Yongwon Hong , Visvanathan Ramesh

Deep generative models that learn from the distribution of natural protein sequences and structures may enable the design of new proteins with valuable functions. While the majority of today's models focus on generating either sequences or…

Biomolecules · Quantitative Biology 2024-10-03 Chentong Wang , Sarah Alamdari , Carles Domingo-Enrich , Ava Amini , Kevin K. Yang

Self-supervised pre-trained models such as HuBERT and WavLM leverage unlabeled speech data for representation learning and offer significantly improve for numerous downstream tasks. Despite the success of these methods, their large memory…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Yingying Gao , Shilei Zhang , Zihao Cui , Yanhan Xu , Chao Deng , Junlan Feng

We present an approach for continual learning (CL) that is based on fully probabilistic (or generative) models of machine learning. In contrast to, e.g., GANs that are "generative" in the sense that they can generate samples, fully…

Machine Learning · Computer Science 2021-04-20 Benedikt Pfülb , Alexander Gepperth , Benedikt Bagus

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

In this paper, we propose a very concise deep learning approach for collaborative filtering that jointly models distributional representation for users and items. The proposed framework obtains better performance when compared against…

Information Retrieval · Computer Science 2015-02-17 Zhang Junlin , Cai Heng , Huang Tongwen , Xue Huiping

We describe a probabilistic (generative) view of affinity matrices along with inference algorithms for a subclass of problems associated with data clustering. This probabilistic view is helpful in understanding different models and…

Machine Learning · Computer Science 2012-12-12 Romer Rosales , Brendan J. Frey

Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead…

Machine Learning · Computer Science 2022-02-18 Emilien Dupont , Yee Whye Teh , Arnaud Doucet

This article presents the first results from using a learning classifier system capable of performing adaptive computation with deep neural networks. Individual classifiers within the population are composed of two neural networks. The…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Richard J. Preen , Larry Bull

In recent times, Vision-Language Models (VLMs) have been trained under two predominant paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) to tackle various complex tasks, yet issues such as hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Wei Chow , Juncheng Li , Qifan Yu , Kaihang Pan , Hao Fei , Zhiqi Ge , Shuai Yang , Siliang Tang , Hanwang Zhang , Qianru Sun

Recently, generated images could reach very high quality, even human eyes could not tell them apart from real images. Although there are already some methods for detecting generated images in current forensic community, most of these…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinsheng Xuan , Bo Peng , Wei Wang , Jing Dong