English
Related papers

Related papers: An ADMM approach for multi-response regression wit…

200 papers

Thanks to its versatility, its simplicity, and its fast convergence, ADMM is among the most widely used approaches for solving a convex problem in distributed form. However, making it running efficiently is an art that requires a fine…

Optimization and Control · Mathematics 2019-07-10 Tomaso Erseghe

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa

Various methodological options exist on evaluating differences in both subgroups and the overall population. Most desirable is the simultaneous study of multiple endpoints in several populations. We investigate a newer method using multiple…

Applications · Statistics 2020-07-23 Charlotte Vogel , Frank Schaarschmidt , Christian Ritz , Franz Koenig , Ludwig A. Hothorn

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

For many algorithms, parameter tuning remains a challenging and critical task, which becomes tedious and infeasible in a multi-parameter setting. Multi-penalty regularization, successfully used for solving undetermined sparse regression of…

Machine Learning · Statistics 2017-10-12 Markus Grasmair , Timo Klock , Valeriya Naumova

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Luke Lozenski , Michael T. McCann , Brendt Wohlberg

Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction method of multipliers (ADMM). Many recent efforts have been…

Machine Learning · Computer Science 2018-02-27 Rui Zhu , Di Niu , Zongpeng Li

Collaborative transportation of heavy payloads via loco-manipulation is a challenging yet essential capability for legged robots operating in complex, unstructured environments. Centralized planning methods, e.g., holistic trajectory…

Robotics · Computer Science 2026-03-10 Ziyi Zhou , Pengyuan Shu , Ruize Cao , Yuntian Zhao , Ye Zhao

Self-evaluation, a model's ability to assess the correctness of its own output, is crucial for Large Multimodal Models (LMMs) to achieve self-improvement in multi-turn conversations, yet largely absent in foundation models. Recent work has…

Machine Learning · Computer Science 2025-08-14 Wenkai Wang , Hongcan Guo , Zheqi Lv , Shengyu Zhang

In randomized trials with continuous-valued outcomes the goal is often to estimate the difference in average outcomes between two treatment groups. However, the outcome in some trials is longitudinal, meaning that multiple measurements of…

Methodology · Statistics 2021-09-21 Alejandro Schuler

Sparse covariance matrices play crucial roles by encoding the interdependencies between variables in numerous fields such as genetics and neuroscience. Despite substantial studies on sparse covariance matrices, existing methods face several…

Methodology · Statistics 2026-03-03 Rakheon Kim , Irina Gaynanova

We address regularised versions of the Expectation-Maximisation (EM) algorithm for Generalised Linear Mixed Models (GLMM) in the context of panel data (measured on several individuals at different time-points). A random response y is…

Methodology · Statistics 2019-08-21 Jocelyn Chauvet , Catherine Trottier , Xavier Bry

Consider the problem of estimating average treatment effects when a large number of covariates are used to adjust for possible confounding through outcome regression and propensity score models. The conventional approach of model building…

Statistics Theory · Mathematics 2018-01-31 Zhiqiang Tan

Randomized experiments are the gold standard for causal inference, and justify simple comparisons across treatment groups. Regression adjustment provides a convenient way to incorporate covariate information for additional efficiency. This…

Methodology · Statistics 2022-10-25 Anqi Zhao , Peng Ding

Current deep regression models usually learn in a point-wise way that treats each sample as an independent input, neglecting the relative ordering among different data. Consequently, the regression model could neglect the data's…

Machine Learning · Computer Science 2025-02-11 Fuhang Liang , Rucong Xu , Deng Lin

While Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities across diverse domains, their application to specialized anomaly detection (AD) remains constrained by domain adaptation challenges. Existing Group Relative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jingyi Liao , Yongyi Su , Rong-Cheng Tu , Zhao Jin , Wenhao Sun , Yiting Li , Dacheng Tao , Xun Xu , Xulei Yang

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

Machine Learning · Computer Science 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

In scientific applications, multivariate observations often come in tandem with temporal or spatial covariates, with which the underlying signals vary smoothly. The standard approaches such as principal component analysis and factor…

Statistics Theory · Mathematics 2019-10-15 Mark Koudstaal , Dengdeng Yu , Dehan Kong , Fang Yao

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames