English
Related papers

Related papers: Variable Clustering via Distributionally Robust No…

200 papers

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

Optimization and Control · Mathematics 2022-11-21 Kaizhao Sun , X. Andy Sun

We introduce a new method for performing clustering with the aim of fitting clusters with different scatters and weights. It is designed by allowing to handle a proportion $\alpha$ of contaminating data to guarantee the robustness of the…

Statistics Theory · Mathematics 2008-12-18 Luis A. García-Escudero , Alfonso Gordaliza , Carlos Matrán , Agustin Mayo-Iscar

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

Methodology · Statistics 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

In this paper, we introduce Adaptive Cluster Lasso(ACL) method for variable selection in high dimensional sparse regression models with strongly correlated variables. To handle correlated variables, the concept of clustering or grouping…

Machine Learning · Statistics 2016-03-14 Niharika Gauraha , Swapan K. Parui

A rank-invariant clustering of variables is introduced that is based on the predictive strength between groups of variables, i.e., two groups are assigned a high similarity if the variables in the first group contain high predictive…

Methodology · Statistics 2023-12-29 Sebastian Fuchs , Yuping Wang

Model-based clustering is a popular approach for clustering multivariate data which has seen applications in numerous fields. Nowadays, high-dimensional data are more and more common and the model-based clustering approach has adapted to…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to…

Optimization and Control · Mathematics 2024-07-24 Rui Gao , Rohit Arora , Yizhe Huang

We solve the compressive sensing problem via convolutional factor analysis, where the convolutional dictionaries are learned {\em in situ} from the compressed measurements. An alternating direction method of multipliers (ADMM) paradigm for…

Machine Learning · Statistics 2017-01-12 Xin Yuan , Yunchen Pu , Lawrence Carin

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

Heavy computational load for solving nonconvex problems for large-scale systems or systems with real-time demands at each sample step has been recognized as one of the reasons for preventing a wider application of nonlinear model predictive…

Optimization and Control · Mathematics 2022-04-19 Yaling Ma , Runze Gao , Li Dai , Jinxian Wu , Yuanqing Xia

We propose a new class of models for variable clustering called Asymptotic Independent block (AI-block) models, which defines population-level clusters based on the independence of the maxima of a multivariate stationary mixing random…

Statistics Theory · Mathematics 2024-07-08 Alexis Boulin , Elena Di Bernardino , Thomas Laloë , Gwladys Toulemonde

In this paper, we study the local convergence of the standard ADMM scheme for a class of nonconvex composite problems arising from modern imaging and machine learning models. This problem is constrained by a closed convex set, while its…

Optimization and Control · Mathematics 2026-03-24 Xiyuan Xie , Lihua Yang , Qia li

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

Grouping observations into homogeneous groups is a recurrent task in statistical data analysis. We consider Gaussian Mixture Models, which are the most famous parametric model-based clustering method. We propose a new robust approach for…

Methodology · Statistics 2022-11-16 Antoine Godichon-Baggioni , Stéphane Robin

Efficient exact algorithms for Discrete Optimization (DO) rely heavily on strong primal and dual bounds. Relaxed Decision Diagrams (DDs) provide a versatile mechanism for deriving such dual bounds by compactly over-approximating the…

Artificial Intelligence · Computer Science 2025-12-18 Mohsen Nafar , Michael Römer , Lin Xie

One of the most widely used techniques for data clustering is agglomerative clustering. Such algorithms have been long used across many different fields ranging from computational biology to social sciences to computer vision in part…

Machine Learning · Computer Science 2014-07-15 Maria-Florina Balcan , Yingyu Liang , Pramod Gupta

Clustering algorithms start with a fixed divergence, which captures the possibly asymmetric distance between a sample and a centroid. In the mixture model setting, the sample distribution plays the same role. When all attributes have the…

Machine Learning · Computer Science 2017-01-10 Mehmet Emin Basbug , Barbara Engelhardt

The iteration dynamics of the coupled cluster equations exhibits a synergistic relationship among the cluster amplitudes. The iteration scheme may be viewed as a multivariate discrete-time propagation of nonlinearly coupled equations, which…

Computational Physics · Physics 2021-09-16 Valay Agarawal , Samrendra Roy , Kapil K. Shrawankar , Mayank Ghogale , S Bharathi , Anchal Yadav , Rahul Maitra

We investigate structured sparsity methods for variable selection in regression problems where the target depends nonlinearly on the inputs. We focus on general nonlinear functions not limiting a priori the function space to additive…

Machine Learning · Statistics 2018-05-17 Magda Gregorová , Alexandros Kalousis , Stéphane Marchand-Maillet