English
Related papers

Related papers: On Basic Operations Related to Network Induction o…

200 papers

While much effort has been devoted to deriving and analyzing effective convex formulations of signal processing problems, the gradients of convex functions also have critical applications ranging from gradient-based optimization to optimal…

Machine Learning · Computer Science 2023-03-21 Shreyas Chaudhari , Srinivasa Pranav , José M. F. Moura

We introduce a new class of neural networks designed to be convex functions of their inputs, leveraging the principle that any convex function can be represented as the supremum of the affine functions it dominates. These neural networks,…

Machine Learning · Statistics 2024-11-21 Vincent Lemaire , Gilles Pagès , Christian Yeo

The success of deep neural networks hinges on our ability to accurately and efficiently optimize high-dimensional, non-convex functions. In this paper, we empirically investigate the loss functions of state-of-the-art networks, and how…

Machine Learning · Computer Science 2017-12-11 Daniel Jiwoong Im , Michael Tao , Kristin Branson

We study distributed non-convex optimization on a time-varying multi-agent network. Each node has access to its own smooth local cost function, and the collective goal is to minimize the sum of these functions. We generalize the results…

Optimization and Control · Mathematics 2016-12-06 Tatiana Tatarenko , Behrouz Touri

Deep convolutional networks provide state of the art classifications and regressions results over many high-dimensional problems. We review their architecture, which scatters data with a cascade of linear filter weights and non-linearities.…

Machine Learning · Statistics 2016-04-27 Stéphane Mallat

We consider cooperative multi-agent consensus optimization problems over both static and time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific possibly…

Optimization and Control · Mathematics 2017-06-27 Erfan Yazdandoost Hamedani , Necdet Serhat Aybat

Metric graph properties lie in the heart of the analysis of complex networks, while in this paper we study their convexity through mathematical definition of a convex subgraph. A subgraph is convex if every geodesic path between the nodes…

Social and Information Networks · Computer Science 2018-05-31 Tilen Marc , Lovro Šubelj

Operator monotone functions, introduced by Lowner in 1934, are an important class of real-valued functions. They arise naturally in matrix and operator theory and have various applications in other branches of mathematics and related…

Functional Analysis · Mathematics 2016-11-26 Pattrawut Chansangiam

Two applications of nets are given. The first is an extension of the Bochner integral to arbitrary locally convex spaces, leading to an integration theorye of more general vector valued functions then in the classical approach by Gelfand…

Functional Analysis · Mathematics 2017-09-04 Ralf Beckmann , Anton Deitmar

We introduce a more general discrete fractional operator, given by convex linear combination of the delta and nabla fractional sums. Fundamental properties of the new fractional operator are proved. As particular cases, results on delta and…

Classical Analysis and ODEs · Mathematics 2010-09-21 Nuno R. O. Bastos , Delfim F. M. Torres

We consider discrete metric spaces and we look for non-constant contractions. We introduce the notion of contractive map and we characterize the spaces with non-constant contractive maps. We provide some examples to discussion the possible…

Classical Analysis and ODEs · Mathematics 2010-11-19 Fabio Zucca

This paper introduces a new subtraction operation for convex sets, which defines their difference as a collection of inclusion-minimal convex sets with appropriate definitions of linear operations on them. With these operations the set of…

Optimization and Control · Mathematics 2018-06-18 Evgeni Nurminski , Stan Uryasev

We investigate metric projections and distance functions referring to convex bodies in finite-dimensional normed spaces. For this purpose we identify the vector space with its dual space by using, instead of the usual identification via the…

Metric Geometry · Mathematics 2019-08-26 Vitor Balestro , Horst Martini , Ralph Teixeira

The use of proximal point operators for optimization can be computationally expensive when the dimensionality of a function (i.e., the number of variables) is high. In this study, we sought to reduce the cost of calculating proximal point…

Optimization and Control · Mathematics 2023-12-06 Wen-Liang Hwang , Chang-Wei Yueh

In this paper we show how the superquadratic functions can be used as a tool for researching other types of convex functions like $\phi $-convexity, strong-convexity and uniform convexity. We show how to use inequalities satisfied by…

Functional Analysis · Mathematics 2024-08-15 Shoshana Abramovich

Many economic activities are embedded in networks: sets of agents and the (often) rivalrous relationships connecting them to one another. Input sourcing by firms, interbank lending, scientific research, and job search are four examples,…

Econometrics · Economics 2019-12-16 Bryan S. Graham

We investigate inexact proximity operators for weakly convex functions. To this aim, we derive sum rules for proximal {\epsilon}-subdifferentials, by incorporating the moduli of weak convexity of the functions into the respective formulas.…

Optimization and Control · Mathematics 2024-04-24 Ewa Bednarczuk , Giovanni Bruccola , Gabriele Scrivanti , The Hung Tran

This work is dedicated to foundational aspects of general (nonlinear second order) potential theories and fully nonlinear elliptic PDEs. In particular, we systematically develop the fundamental role played by semiconvex functions as a…

Analysis of PDEs · Mathematics 2025-04-16 Kevin R. Payne , Davide Francesco Redaelli

We consider the minimization of an M-convex function, which is a discrete convexity concept for functions on the integer lattice points. It is known that a minimizer of an Mconvex function can be obtained by the steepest descent algorithm.…

Optimization and Control · Mathematics 2025-03-04 Taihei Oki , Akiyoshi Shioura

This paper introduces a second-order differential inclusion for unconstrained convex optimization. In continuous level, solution existence in proper sense is obtained and exponential decay of a novel Lyapunov function along with the…

Optimization and Control · Mathematics 2022-03-01 Hao Luo