English
Related papers

Related papers: LARGE: A Locally Adaptive Regularization Approach …

200 papers

Laplacian regularized stratified models (LRSM) are models that utilize the explicit or implicit network structure of the sub-problems as defined by the categorical features called strata (e.g., age, region, time, forecast horizon, etc.),…

Machine Learning · Statistics 2023-05-05 Ziheng Cheng , Junzi Zhang , Akshay Agrawal , Stephen Boyd

Time-series datasets are central in machine learning with applications in numerous fields of science and engineering, such as biomedicine, Earth observation, and network analysis. Extensive research exists on state-space models (SSMs),…

Machine Learning · Computer Science 2024-06-17 Emilie Chouzenoux , Victor Elvira

In neuroscience, researchers seek to uncover the connectivity of neurons from large-scale neural recordings or imaging; often people employ graphical model selection and estimation techniques for this purpose. But, existing technologies can…

Machine Learning · Statistics 2021-04-14 Minjie Wang , Genevera I. Allen

In additive models with many nonparametric components, a number of regularized estimators have been proposed and proven to attain various error bounds under different combinations of sparsity and fixed smoothness conditions. Some of these…

Statistics Theory · Mathematics 2020-11-16 Yisha Yao , Cun-Hui Zhang

Large scale, streaming datasets are ubiquitous in modern machine learning. Streaming algorithms must be scalable, amenable to incremental training and robust to the presence of non-stationarity. In this work consider the problem of learning…

Machine Learning · Statistics 2017-12-15 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

This paper considers a high-dimensional linear regression problem where there are complex correlation structures among predictors. We propose a graph-constrained regularization procedure, named Sparse Laplacian Shrinkage with the Graphical…

Methodology · Statistics 2019-04-10 Yuehan Yang , Siwei Xia , Hu Yang

Low-rank approximation models of data matrices have become important machine learning and data mining tools in many fields including computer vision, text mining, bioinformatics and many others. They allow for embedding high-dimensional…

Machine Learning · Computer Science 2020-10-19 Penglong Zhai , Shihua Zhang

Gaussian Graphical Models (GGMs) have wide-ranging applications in machine learning and the natural and social sciences. In most of the settings in which they are applied, the number of observed samples is much smaller than the dimension…

Machine Learning · Computer Science 2020-03-10 Jonathan Kelner , Frederic Koehler , Raghu Meka , Ankur Moitra

We propose an L1-penalized algorithm for fitting high-dimensional generalized linear mixed models. Generalized linear mixed models (GLMMs) can be viewed as an extension of generalized linear models for clustered observations. This…

Computation · Statistics 2014-06-03 Jürg Schelldorfer , Lukas Meier , Peter Bühlmann

The Gaussian graphical model (GGM) incorporates an undirected graph to represent the conditional dependence between variables, with the precision matrix encoding partial correlation between pair of variables given the others. To achieve…

Methodology · Statistics 2023-07-03 Yueqi Qian , Xianghong Hu , Can Yang

We consider the task of estimating a Gaussian graphical model in the high-dimensional setting. The graphical lasso, which involves maximizing the Gaussian log likelihood subject to an l1 penalty, is a well-studied approach for this task. We…

Machine Learning · Statistics 2013-07-23 Kean Ming Tan , Daniela Witten , Ali Shojaie

Neuroimaging is the growing area of neuroscience devoted to produce data with the goal of capturing processes and dynamics of the human brain. We consider the problem of inferring the brain connectivity network from time dependent…

Methodology · Statistics 2021-05-28 Saverio Ranciati , Alberto Roverato , Alessandra Luati

Technological advances have led to a proliferation of structured big data that have matrix-valued covariates. We are specifically motivated to build predictive models for multi-subject neuroimaging data based on each subject's brain imaging…

Methodology · Statistics 2015-05-15 Yue Hu , Genevera I. Allen

We introduce Graphical TREX (GTREX), a novel method for graph estimation in high-dimensional Gaussian graphical models. By conducting neighborhood selection with TREX, GTREX avoids tuning parameters and is adaptive to the graph topology. We…

Machine Learning · Statistics 2014-10-28 Johannes Lederer , Christian Müller

Graphical models are frequently used to explore networks, such as genetic networks, among a set of variables. This is usually carried out via exploring the sparsity of the precision matrix of the variables under consideration. Penalized…

Applications · Statistics 2009-08-17 Jianqing Fan , Yang Feng , Yichao Wu

This work proposes an adaptive trace lasso regularized L1-norm based graph cut method for dimensionality reduction of Hyperspectral images, called as `Trace Lasso-L1 Graph Cut' (TL-L1GC). The underlying idea of this method is to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Ramanarayan Mohanty , S L Happy , Nilesh Suthar , Aurobinda Routray

The partial correlation graphical LASSO (PCGLASSO) is a penalised likelihood method for Gaussian graphical models which provides scale invariant sparse estimation of the precision matrix and improves upon the popular graphical LASSO method.…

Methodology · Statistics 2025-10-30 Jack Storror Carter , Cesare Molinari

Robots have been used in all sorts of automation, and yet the design of robots remains mainly a manual task. We seek to provide design tools to automate the design of robots themselves. An important challenge in robot design automation is…

Robotics · Computer Science 2022-09-26 Jiaheng Hu , Julian Whiman , Howie Choset

Regularization is widely used in statistics and machine learning to prevent overfitting and gear solution towards prior information. In general, a regularized estimation problem minimizes the sum of a loss function and a penalty term. The…

Computation · Statistics 2012-01-18 Hua Zhou , Yichao Wu

Convex optimization is an essential tool for modern data analysis, as it provides a framework to formulate and solve many problems in machine learning and data mining. However, general convex optimization solvers do not scale well, and…

Social and Information Networks · Computer Science 2015-07-02 David Hallac , Jure Leskovec , Stephen Boyd