English
Related papers

Related papers: Module-based regularization improves Gaussian grap…

200 papers

Deep generative models can emulate the perceptual properties of complex image datasets, providing a latent representation of the data. However, manipulating such representation to perform meaningful and controllable transformations in the…

Machine Learning · Computer Science 2019-12-13 Michel Besserve , Arash Mehrjou , Rémy Sun , Bernhard Schölkopf

Several data analysis techniques employ similarity relationships between data points to uncover the intrinsic dimension and geometric structure of the underlying data-generating mechanism. In this paper we work under the model assumption…

Machine Learning · Statistics 2019-04-09 Nicolas Garcia Trillos , Daniel Sanz-Alonso , Ruiyi Yang

When adopting a model-based formulation, solving inverse problems encountered in multiband imaging requires to define spatial and spectral regularizations. In most of the works of the literature, spectral information is extracted from the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Min Zhao , Nicolas Dobigeon , Jie Chen

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

We provide a study of how induced model sparsity can help achieve compositional generalization and better sample efficiency in grounded language learning problems. We consider simple language-conditioned navigation problems in a grid world…

Computation and Language · Computer Science 2022-07-07 Sam Spilsbury , Alexander Ilin

Inspired from human cognition, machine learning systems are gradually revealing advantages of sparser and more modular architectures. Recent work demonstrates that not only do some modular architectures generalize well, but they also lead…

Machine Learning · Computer Science 2022-06-07 Sarthak Mittal , Yoshua Bengio , Guillaume Lajoie

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Learning models that offer robust out-of-distribution generalization and fast adaptation is a key challenge in modern machine learning. Modelling causal structure into neural networks holds the promise to accomplish robust zero and few-shot…

Machine Learning · Computer Science 2022-06-10 Nino Scherrer , Anirudh Goyal , Stefan Bauer , Yoshua Bengio , Nan Rosemary Ke

Despite huge successes on a wide range of tasks, neural networks are known to sometimes struggle to generalise to unseen data. Many approaches have been proposed over the years to promote the generalisation ability of neural networks,…

Machine Learning · Computer Science 2026-02-02 Christiaan P. Opperman , Anna S. Bosman , Katherine M. Malan

Simulating sample correlation matrices is important in many areas of statistics. Approaches such as generating Gaussian data and finding their sample correlation matrix or generating random uniform $[-1,1]$ deviates as pairwise correlations…

Statistics Theory · Mathematics 2013-12-09 Johanna Hardin , Stephan Ramon Garcia , David Golan

Conditional Gaussian graphical models (cGGM) are a recent reparametrization of the multivariate linear regression model which explicitly exhibits $i)$ the partial covariances between the predictors and the responses, and $ii)$ the partial…

Methodology · Statistics 2014-09-26 Julien Chiquet , Tristan Mary-Huard , Stéphane Robin

Greedy layer-wise or module-wise training of neural networks is compelling in constrained and on-device settings where memory is limited, as it circumvents a number of problems of end-to-end back-propagation. However, it suffers from a…

Machine Learning · Computer Science 2023-10-06 Skander Karkar , Ibrahim Ayed , Emmanuel de Bézenac , Patrick Gallinari

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization.…

Statistics Theory · Mathematics 2023-02-15 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

Many complex tasks can be decomposed into simpler, independent parts. Discovering such underlying compositional structure has the potential to enable compositional generalization. Despite progress, our most powerful systems struggle to…

Gaussian Graphical Models (GGMs) are popular tools for studying network structures. However, many modern applications such as gene network discovery and social interactions analysis often involve high-dimensional noisy data with outliers or…

Machine Learning · Statistics 2015-10-30 Eunho Yang , Aurélie C. Lozano

Gaussian Graphical Models provide a convenient framework for representing dependencies between variables. Recently, this tool has received a high interest for the discovery of biological networks. The literature focuses on the case where a…

Methodology · Statistics 2010-05-13 Julien Chiquet , Yves Grandvalet , Christophe Ambroise

"Module networks" are a framework to learn gene regulatory networks from expression data using a probabilistic model in which coregulated genes share the same parameters and conditional distributions. We present a method to infer ensembles…

Quantitative Methods · Quantitative Biology 2009-04-09 Tom Michoel , Riet De Smet , Anagha Joshi , Kathleen Marchal , Yves Van de Peer

A graphical model is a statistical model that is associated to a graph whose nodes correspond to variables of interest. The edges of the graph reflect allowed conditional dependencies among the variables. Graphical models admit…

Methodology · Statistics 2016-06-09 Mathias Drton , Marloes H. Maathuis

Graphs have become pervasive tools to represent information and datasets with irregular support. However, in many cases, the underlying graph is either unavailable or naively obtained, calling for more advanced methods to its estimation.…

Signal Processing · Electrical Eng. & Systems 2023-03-14 Andrei Buciulea , Antonio G. Marques

\textit{Graph neural networks} (GNNs) are effective models for many dynamical systems consisting of entities and relations. Although most GNN applications assume a single type of entity and relation, many situations involve multiple types…

Machine Learning · Computer Science 2023-10-12 Ferran Alet , Erica Weng , Tomás Lozano Pérez , Leslie Pack Kaelbling