English

A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems

Optimization and Control 2020-05-28 v3 Machine Learning Numerical Analysis Numerical Analysis Computation Machine Learning

Abstract

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM to be efficient is to develop a sparse semismooth Newton method to solve the corresponding subproblems. By using the Kurdyka-{\L}ojasiewicz property exhibited in the underlining problems, we prove that the PMM algorithm converges to a d-stationary point. We also analyze the oracle property of the initial subproblem used in our algorithm. Extensive numerical experiments are presented to demonstrate the high efficiency of the proposed PMM algorithm.

Keywords

Cite

@article{arxiv.1903.11460,
  title  = {A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems},
  author = {Peipei Tang and Chengjing Wang and Defeng Sun and Kim-Chuan Toh},
  journal= {arXiv preprint arXiv:1903.11460},
  year   = {2020}
}

Comments

34 pages, 8 tables

R2 v1 2026-06-23T08:20:56.566Z