English
Related papers

Related papers: Deep Linear Probe Generators for Weight Space Lear…

200 papers

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

Diffusion models are generative models that have shown significant advantages compared to other generative models in terms of higher generation quality and more stable training. However, the computational need for training diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Gulcin Baykal , Halil Faruk Karagoz , Taha Binhuraib , Gozde Unal

Since upcoming telescopes will observe thousands of strong lensing systems, creating fully-automated analysis pipelines for these images becomes increasingly important. In this work, we make a step towards that direction by developing the…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-03 Marco Chianese , Adam Coogan , Paul Hofma , Sydney Otten , Christoph Weniger

Transfer learning with a small amount of target data is an effective and common approach to adapting a pre-trained model to distribution shifts. In some situations, target data labels may be expensive to obtain, so we may only have access…

Machine Learning · Computer Science 2023-05-26 Annie S. Chen , Yoonho Lee , Amrith Setlur , Sergey Levine , Chelsea Finn

Deep learning has been recently applied to many problems in wireless communications including modulation classification and symbol decoding. Many of the existing end-to-end learning approaches demonstrated robustness to signal distortions…

Signal Processing · Electrical Eng. & Systems 2020-09-15 Samer Hanna , Chris Dick , Danijela Cabric

Learning useful representations is a key ingredient to the success of modern machine learning. Currently, representation learning mostly relies on embedding data into Euclidean space. However, recent work has shown that data in some domains…

Machine Learning · Computer Science 2019-10-17 Denis Mazur , Vage Egiazarian , Stanislav Morozov , Artem Babenko

Identifying the obstacle space is crucial for path planning. However, generating an accurate obstacle space remains a significant challenge due to various sources of uncertainty, including motion, behavior, and perception limitations. Even…

Robotics · Computer Science 2025-09-30 Jun Xiang , Jun Chen

We give algorithms with provable guarantees that learn a class of deep nets in the generative model view popularized by Hinton and others. Our generative model is an $n$ node multilayer neural net that has degree at most $n^{\gamma}$ for…

Machine Learning · Computer Science 2013-10-25 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

The brain processes information through many layers of neurons. This deep architecture is representationally powerful, but it complicates learning by making it hard to identify the responsible neurons when a mistake is made. In machine…

Neurons and Cognition · Quantitative Biology 2014-11-04 Timothy P. Lillicrap , Daniel Cownden , Douglas B. Tweed , Colin J. Akerman

We introduce DeepProbLog, a probabilistic logic programming language that incorporates deep learning by means of neural predicates. We show how existing inference and learning techniques can be adapted for the new language. Our experiments…

Artificial Intelligence · Computer Science 2018-12-13 Robin Manhaeve , Sebastijan Dumančić , Angelika Kimmig , Thomas Demeester , Luc De Raedt

This paper presents a novel online learning method that aims at finding a separator hyperplane between data points labelled as either positive or negative. Since weights and biases of artificial neurons can directly be related to…

Machine Learning · Computer Science 2023-09-13 Ákos Hajnal

Deep reinforcement learning has advanced greatly and applied in many areas. In this paper, we explore the vulnerability of deep reinforcement learning by proposing a novel generative model for creating effective adversarial examples to…

Machine Learning · Computer Science 2023-12-21 Xiangjuan Li , Feifan Li , Yang Li , Quan Pan

Despite the success of Generative Adversarial Networks (GANs), their training suffers from several well-known problems, including mode collapse and difficulties learning a disconnected set of manifolds. In this paper, we break down the…

Machine Learning · Computer Science 2021-06-21 Mohammadreza Armandpour , Ali Sadeghian , Chunyuan Li , Mingyuan Zhou

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora

Neural network models have a reputation for being black boxes. We propose to monitor the features at every layer of a model and measure how suitable they are for classification. We use linear classifiers, which we refer to as "probes",…

Machine Learning · Statistics 2018-11-26 Guillaume Alain , Yoshua Bengio

We address the problem of compressed sensing using a deep generative prior model and consider both linear and learned nonlinear sensing mechanisms, where the nonlinear one involves either a fully connected neural network or a convolutional…

Machine Learning · Computer Science 2021-05-26 Vinayak Killedar , Praveen Kumar Pokala , Chandra Sekhar Seelamantula

Recent advances in deep learning led to novel generative modeling techniques that achieve unprecedented quality in generated samples and performance in learning complex distributions in imaging data. These new models in medical image…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Xiaoran Chen , Nick Pawlowski , Martin Rajchl , Ben Glocker , Ender Konukoglu

Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework…

Machine Learning · Computer Science 2020-10-12 Sameera Ramasinghe , Kanchana Ranasinghe , Salman Khan , Nick Barnes , Stephen Gould

The discriminative approach to classification using deep neural networks has become the de-facto standard in various fields. Complementing recent reservations about safety against adversarial examples, we show that conventional…

Machine Learning · Computer Science 2018-07-25 William Wang , Angelina Wang , Aviv Tamar , Xi Chen , Pieter Abbeel

Even though Deep Neural Networks are extremely powerful for image restoration tasks, they have several limitations. They are poorly understood and suffer from strong biases inherited from the training sets. One way to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Raphael Achddou , Yann Gousseau , Saïd Ladjal , Sabine Süsstrunk