English
Related papers

Related papers: Rejoinder: Latent variable graphical model selecti…

200 papers

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

Economists specify high-dimensional models to address heterogeneity in empirical studies with complex big data. Estimation of these models calls for optimization techniques to handle a large number of parameters. Convex problems can be…

Computation · Statistics 2019-08-06 Zhan Gao , Zhentao Shi

Estimation of model uncertainty can help improve the explainability of Graph Convolutional Networks and the accuracy of the models at the same time. Uncertainty can also be used in critical applications to verify the results of the model by…

Machine Learning · Computer Science 2025-07-03 Illia Oleksiienko , Juho Kanniainen , Alexandros Iosifidis

Non-convex optimization plays a key role in a growing number of machine learning applications. This motivates the identification of specialized structure that enables sharper theoretical analysis. One such identified structure is…

Optimization and Control · Mathematics 2023-06-06 Qiang Fu , Dongchu Xu , Ashia Wilson

To address three important issues involved in latent variable models (LVMs), including capturing infrequent patterns, achieving small-sized but expressive models and alleviating overfitting, several studies have been devoted to…

Machine Learning · Computer Science 2017-11-27 Pengtao Xie , Jun Zhu , Eric P. Xing

The paper gives a systematic study of the approximate versions of three greedy-type algorithms that are widely used in convex optimization. By approximate version we mean the one where some of evaluations are made with an error. Importance…

Machine Learning · Statistics 2014-12-11 Vladimir Temlyakov

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

Machine Learning · Statistics 2017-12-22 Christian Donner , Manfred Opper

Promising results have driven a recent surge of interest in continuous optimization methods for Bayesian network structure learning from observational data. However, there are theoretical limitations on the identifiability of underlying…

This work deals with the generation of theoretical correlation matrices with specific sparsity patterns, associated to graph structures. We present a novel approach based on convex optimization, offering greater flexibility compared to…

Signal Processing · Electrical Eng. & Systems 2025-09-03 Ali Fahkar , Kévin Polisano , Irène Gannaz , Sophie Achard

This paper considers linear model selection when the response is vector-valued and the predictors are randomly observed. We propose a new approach that decouples statistical inference from the selection step in a "post-inference model…

Methodology · Statistics 2016-06-07 David Puelz , P. Richard Hahn , Carlos Carvalho

In this paper, we consider online convex optimization (OCO) with time-varying loss and constraint functions. Specifically, the decision maker chooses sequential decisions based only on past information, meantime the loss and constraint…

Optimization and Control · Mathematics 2022-05-20 Haoyang Liu , Xiantao Xiao , Liwei Zhang

This paper develops online algorithms to track solutions of time-varying constrained optimization problems. Particularly, resembling workhorse Kalman filtering-based approaches for dynamical systems, the proposed methods involve…

Optimization and Control · Mathematics 2021-11-29 Andrea Simonetto , Emiliano Dall'Anese

Fr\'echet regression has received considerable attention to model metric-space valued responses that are complex and non-Euclidean data, such as probability distributions and vectors on the unit sphere. However, existing Fr\'echet…

Methodology · Statistics 2025-04-08 Jiaying Weng , Kai Tan , Cheng Wang , Zhou Yu

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

Rejoinder to ``Microarrays, Empirical Bayes and the Two-Groups Model'' [arXiv:0808.0572]

Methodology · Statistics 2008-08-06 Bradley Efron

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

In this effort, we propose a convex optimization approach based on weighted $\ell_1$-regularization for reconstructing objects of interest, such as signals or images, that are sparse or compressible in a wavelet basis. We recover the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Joseph Daws , Armenak Petrosyan , Hoang Tran , Clayton G. Webster

Rejoinder: Fisher Lecture: Dimension Reduction in Regression [arXiv:0708.3774]

Methodology · Statistics 2009-09-29 R. Dennis Cook

Devising efficient algorithms that track the optimizers of continuously varying convex optimization problems is key in many applications. A possible strategy is to sample the time-varying problem at constant rate and solve the resulting…

Optimization and Control · Mathematics 2017-11-28 Andrea Simonetto

Discussion of "Likelihood Inference for Models with Unobservables: Another View" by Youngjo Lee and John A. Nelder [arXiv:1010.0303]

Methodology · Statistics 2010-10-06 Xiao-Li Meng