English

All unconstrained strongly convex problems are weakly simplicial

Optimization and Control 2021-07-20 v1 Machine Learning

Abstract

A multi-objective optimization problem is CrC^r weakly simplicial if there exists a CrC^r surjection from a simplex onto the Pareto set/front such that the image of each subsimplex is the Pareto set/front of a subproblem, where 0r0\leq r\leq \infty. This property is helpful to compute a parametric-surface approximation of the entire Pareto set and Pareto front. It is known that all unconstrained strongly convex CrC^r problems are Cr1C^{r-1} weakly simplicial for 1r1\leq r \leq \infty. In this paper, we show that all unconstrained strongly convex problems are C0C^0 weakly simplicial. The usefulness of this theorem is demonstrated in a sparse modeling application: we reformulate the elastic net as a non-differentiable multi-objective strongly convex problem and approximate its Pareto set (the set of all trained models with different hyper-parameters) and Pareto front (the set of performance metrics of the trained models) by using a B\'ezier simplex fitting method, which accelerates hyper-parameter search.

Keywords

Cite

@article{arxiv.2106.12704,
  title  = {All unconstrained strongly convex problems are weakly simplicial},
  author = {Yusuke Mizota and Naoki Hamada and Shunsuke Ichiki},
  journal= {arXiv preprint arXiv:2106.12704},
  year   = {2021}
}

Comments

19 pages, 3 figures. In this paper, we give an improvement of the main result on weak simpliciality of arXiv:1912.09328 and its practical application

R2 v1 2026-06-24T03:32:06.340Z