English
Related papers

Related papers: Learning finite-dimensional coding schemes with no…

200 papers

Learning in Deep Neural Networks (DNN) takes place by minimizing a non-convex high-dimensional loss function, typically by a stochastic gradient descent (SGD) strategy. The learning process is observed to be able to find good minimizers…

Machine Learning · Computer Science 2020-03-12 Carlo Baldassi , Fabrizio Pittorino , Riccardo Zecchina

Graphical models and factor analysis are well-established tools in multivariate statistics. While these models can be both linked to structures exhibited by covariance and precision matrices, they are generally not jointly leveraged within…

Machine Learning · Statistics 2023-08-02 Alexandre Hippert-Ferrer , Florent Bouchard , Ammar Mian , Titouan Vayer , Arnaud Breloy

In this paper, we propose a robust subspace-constrained quadratic model (SCQM) for learning low-dimensional structure from high-dimensional data. Building upon the subspace-constrained quadratic matrix factorization (SQMF) framework, the…

Machine Learning · Computer Science 2026-05-21 Zheng Zhai , Xiaohui Li

Many learning-based approaches have difficulty scaling to unseen data, as the generality of its learned prior is limited to the scale and variations of the training samples. This holds particularly true with 3D learning tasks, given the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Mingyue Yang , Yuxin Wen , Weikai Chen , Yongwei Chen , Kui Jia

Propagating input uncertainty through non-linear Gaussian process (GP) mappings is intractable. This hinders the task of training GPs using uncertain and partially observed inputs. In this paper we refer to this task as "semi-described…

Machine Learning · Statistics 2015-09-04 Andreas Damianou , Neil D. Lawrence

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

The ability to predict future states of the environment is a central pillar of intelligence. At its core, effective prediction requires an internal model of the world and an understanding of the rules by which the world changes. Here, we…

Machine Learning · Computer Science 2016-01-21 William Lotter , Gabriel Kreiman , David Cox

State-of-the-art learned reconstruction methods often rely on black-box modules that, despite their strong performance, raise questions about their interpretability and robustness. Here, we build on a recently proposed image reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Joshua Schulz , David Schote , Christoph Kolbitsch , Kostas Papafitsoros , Andreas Kofler

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 Kai Zhang , Luc Van Gool , Radu Timofte

We show that an optimal finite element mesh refinement algorithm for a prototypical elliptic PDE can be learned by a recurrent neural network with a fixed number of trainable parameters independent of the desired accuracy and the input…

Numerical Analysis · Mathematics 2020-08-10 Jan Bohn , Michael Feischl

We describe a novel end-to-end approach using Machine Learning to reconstruct the power spectrum of cosmological density perturbations at high redshift from observed quasar spectra. State-of-the-art cosmological simulations of structure…

Cosmology and Nongalactic Astrophysics · Physics 2021-07-21 Maria Han Veiga , Xi Meng , Oleg Y. Gnedin , Nickolay Y. Gnedin , Xun Huan

Sparse coding algorithm is an learning algorithm mainly for unsupervised feature for finding succinct, a little above high - level Representation of inputs, and it has successfully given a way for Deep learning. Our objective is to use High…

Machine Learning · Computer Science 2014-04-08 R. Vidya , Dr. G. M. Nasira , R. P. Jaia Priyankka

Autonomous mapping of unknown environments is a critical challenge, particularly in scenarios where time is limited. Multi-agent systems can enhance efficiency through collaboration, but the scalability of motion-planning algorithms remains…

Robotics · Computer Science 2026-01-06 Sriram Rajasekar , Ashwini Ratnoo

Critical aspects of computational imaging systems, such as experimental design and image priors, can be optimized through deep networks formed by the unrolled iterations of classical model-based reconstructions (termed physics-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Michael Kellman , Kevin Zhang , Jon Tamir , Emrah Bostan , Michael Lustig , Laura Waller

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

We prove a sampling theorem for infinite-dimensional Paley-Wiener spaces on graphs which allows for stable frame reconstruction. We prove that all sampling sets for a fixed Paley-Wiener space are complements of lambda-sets (i.e. sets where…

Functional Analysis · Mathematics 2026-05-29 Filippo Giannoni

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

We propose a scheme for recycling Gaussian random vectors into structured matrices to approximate various kernel functions in sublinear time via random embeddings. Our framework includes the Fastfood construction as a special case, but also…

Machine Learning · Computer Science 2016-05-31 Krzysztof Choromanski , Vikas Sindhwani

The large spatial/frequency scale of hyperspectral and airborne magnetic and gravitational data causes memory issues when using convolutional neural networks for (sub-) surface characterization. Recently developed fully reversible networks…

Geophysics · Physics 2020-03-18 Bas Peters , Eldad Haber , Keegan Lensink