English
Related papers

Related papers: On Subregularity Properties of Set-Valued Mappings…

200 papers

Submodular functions are relevant to machine learning for at least two reasons: (1) some problems may be expressed directly as the optimization of submodular functions and (2) the lovasz extension of submodular functions provides a useful…

Machine Learning · Computer Science 2013-10-09 Francis Bach

Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e.g. multi-task learning and transfer learning. Using local Rademacher complexity and…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Weiping Wang

Continuity of set-valued maps is hereby revisited: after recalling some basic concepts of variational analysis and a short description of the State-of-the-Art, we obtain as by-product two Sard type results concerning local minima of scalar…

Optimization and Control · Mathematics 2011-06-14 Aris Daniilidis , C. H. Jeffrey Pang

Optimization, a key tool in machine learning and statistics, relies on regularization to reduce overfitting. Traditional regularization methods control a norm of the solution to ensure its smoothness. Recently, topological methods have…

Machine Learning · Computer Science 2020-11-11 Arnur Nigmetov , Aditi S. Krishnapriyan , Nicole Sanderson , Dmitriy Morozov

We study groups, exponential groups and ordered groups equipped with valuations. We investigate algebraic and topological features of such valued structures, and apply our findings in order to solve regular equations over groups using…

Group Theory · Mathematics 2025-08-13 Vincent Bagayoko

Conventional ways to solve optimization problems on low-rank matrix sets which appear in great number of applications ignore its underlying structure of an algebraic variety and existence of singular points. This leads to appearance of…

Numerical Analysis · Mathematics 2017-10-04 Valentin Khrulkov , Ivan Oseledets

In this paper we explore the relation between distributionally robust learning and different forms of regularization to enforce robustness of deep neural networks. In particular, starting from a concrete min-max distributionally robust…

Optimization and Control · Mathematics 2022-03-29 Camilo Garcia Trillos , Nicolas Garcia Trillos

Low-rank structures play important role in recent advances of many problems in image science and data science. As a natural extension of low-rank structures for data with nonlinear structures, the concept of the low-dimensional manifold…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Rongjie Lai , Jia Li

We provide regularity results for CR-maps between real hypersurfaces in complex spaces of different dimension with a Levi-degenerate target. We address both the real-analytic and the smooth case. Our results allow immediate applications to…

Complex Variables · Mathematics 2020-06-15 Ilya Kossovskiy , Bernhard Lamel , Ming Xiao

In this thesis, set-valued maps are considered to model the $i-v$ characteristics of semiconductors like diode, and transistor. Using the circuit theory laws, a generalized equation is obtained. The main concern of the thesis is to…

Optimization and Control · Mathematics 2017-04-14 Iman Mehrabinezhad

This paper considers distributed optimization algorithms, with application in binary classification via distributed support-vector-machines (D-SVM) over multi-agent networks subject to some link nonlinearities. The agents solve a…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Mohammadreza Doostmohammadian , Alireza Aghasi , Houman Zarrabi

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed graph structure, and…

Machine Learning · Computer Science 2013-09-27 Kiyohito Nagano , Yoshinobu Kawahara

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal

We present necessary conditions for monotonicity, in one form or another, of fixed point iterations of mappings that violate the usual nonexpansive property. We show that most reasonable notions of linear-type monotonicity of fixed point…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Marc Teboulle , Nguyen H. Thao

This paper deals with shape irregularity issues in discrete topology optimization algorithms whereby the design is created using the automated distribution of material in the design region. Graph theory is employed to derive appropriate…

Information Theory · Computer Science 2025-03-14 Vojtech Neuman , Miloslav Capek , Lukas Jelinek

To facilitate widespread adoption of automated engineering design techniques, existing methods must become more efficient and generalizable. In the field of topology optimization, this requires the coupling of modern optimization methods…

Computational Engineering, Finance, and Science · Computer Science 2024-02-23 Connor N. Mallon , Aaron W. Thornton , Matthew R. Hill , Santiago Badia

Recommendation models mainly deal with categorical variables, such as user/item ID and attributes. Besides the high-cardinality issue, the interactions among such categorical variables are usually long-tailed, with the head made up of…

Machine Learning · Computer Science 2019-05-29 Yihong Chen , Bei Chen , Xiangnan He , Chen Gao , Yong Li , Jian-Guang Lou , Yue Wang

We study set-valued mappings defined by solution sets of parametric systems of equalities and inequalities. We prove Lipschitz-like continuity of these mappings under relaxed constant rank constraint qualification.

Optimization and Control · Mathematics 2019-05-21 Ewa M. Bednarczuk , Leonid I. Minchenko , Krzysztof E. Rutkowski

This paper continues earlier work and is concerned with the inverse problem of parameter identification in variational inequalities of the second kind that does not only treat the parameter linked to a bilinear form, but importantly also…

Optimization and Control · Mathematics 2021-01-01 Joachim Gwinner

This article provides an original understanding of the behavior of a class of graph-oriented semi-supervised learning algorithms in the limit of large and numerous data. It is demonstrated that the intuition at the root of these methods…

Machine Learning · Computer Science 2017-11-10 Xiaoyi Mai , Romain Couillet