English
Related papers

Related papers: Variable Clustering via Distributionally Robust No…

200 papers

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

Recent approaches to distributed model fitting rely heavily on consensus ADMM, where each node solves small sub-problems using only local data. We propose iterative methods that solve {\em global} sub-problems over an entire distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-10 Tom Goldstein , Gavin Taylor , Kawika Barabin , Kent Sayre

Clustering is a fundamental problem in many scientific applications. Standard methods such as $k$-means, Gaussian mixture models, and hierarchical clustering, however, are beset by local minima, which are sometimes drastically suboptimal.…

Machine Learning · Statistics 2015-12-14 Eric C. Chi , Kenneth Lange

Convex clustering has recently garnered increasing interest due to its attractive theoretical and computational properties, but its merits become limited in the face of high-dimensional data. In such settings, pairwise affinity terms that…

Methodology · Statistics 2021-04-02 Saptarshi Chakraborty , Jason Xu

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

Machine Learning · Computer Science 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

Multivariate time-dependent data, where multiple features are observed over time for a set of individuals, are increasingly widespread in many application domains. To model these data we need to account for relations among both time…

Methodology · Statistics 2021-04-08 Alessandro Casa , Charles Bouveyron , Elena Erosheva , Giovanna Menardi

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

Identifying spatially contiguous clusters and repeated spatial patterns (RSP) characterized by similar underlying distributions that are spatially apart is a key challenge in modern spatial statistics. Existing constrained clustering…

Methodology · Statistics 2026-04-23 Rajitha Senanayake , Pratheepa Jeganathan

In this work, we seek to exploit the deep structure of multi-modal data to robustly exploit the group subspace distribution of the information using the Convolutional Neural Network (CNN) formalism. Upon unfolding the set of subspaces…

Machine Learning · Computer Science 2022-04-27 Sally Ghanem , Hamid Krim

In this paper, we consider the regularized multi-response regression problem where there exists some structural relation within the responses and also between the covariates and a set of modifying variables. To handle this problem, we…

Methodology · Statistics 2025-10-17 Theophilus Quachie Asenso , Manuela Zucknick

The recent deployment of multi-agent networks has enabled the distributed solution of learning problems, where agents cooperate to train a global model without sharing their local, private data. This work specifically targets some prevalent…

Optimization and Control · Mathematics 2024-08-20 Nicola Bastianello , Diego Deplano , Mauro Franceschelli , Karl H. Johansson

Cluster-randomized experiments are widely used due to their logistical convenience and policy relevance. To analyze them properly, we must address the fact that the treatment is assigned at the cluster level instead of the individual level.…

Methodology · Statistics 2021-08-06 Fangzhou Su , Peng Ding

We propose a distributionally robust formulation of the traditional risk parity portfolio optimization problem. Distributional robustness is introduced by targeting the discrete probabilities attached to each observation used during…

Optimization and Control · Mathematics 2021-10-14 Giorgio Costa , Roy H. Kwon

In this paper, we focus on a data-driven risk-averse multistage stochastic programming (RMSP) model considering distributional robustness. We optimize the RMSP over the worst-case distribution within an ambiguity set of probability…

Optimization and Control · Mathematics 2017-08-29 Jianqiu Huang , Kezhuo Zhou , Yongpei Guan

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

Clustering consists of grouping together samples giving their similar properties. The problem of modeling simultaneously groups of samples and features is known as Co-Clustering. This paper introduces ROCCO - a Robust Continuous…

Machine Learning · Computer Science 2018-02-15 Xiao He , Luis Moreira-Matias

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg

We consider the robust multi-dimensional scaling (RMDS) problem in this paper. The goal is to localize point locations from pairwise distances that may be corrupted by outliers. Inspired by classic MDS theories, and nonconvex works for the…

Machine Learning · Statistics 2025-01-07 Tong Deng , Tianming Wang

Robust clustering of high-dimensional data is an important topic because clusters in real datasets are often heavy-tailed and/or asymmetric. Traditional approaches to model-based clustering often fail for high dimensional data, e.g., due to…

Methodology · Statistics 2024-06-07 Alexa A. Sochaniwsky , Michael P. B. Gallaugher , Yang Tang , Paul D. McNicholas

Multi-view clustering leverages consistent and complementary information across multiple views to provide more comprehensive insights than single-view analysis. However, the heterogeneity and redundancy of multi-view data pose significant…

Optimization and Control · Mathematics 2025-08-12 Xiangru Xing , Yan Li , Xin Wang , Huangyue Chen , Xianchao Xiu