English
Related papers

Related papers: $\Delta$-Nets: Interaction-Based System for Optima…

200 papers

This is a survey paper on applications of mathematics of semirings to numerical analysis and computing. Concepts of universal algorithm and generic program are discussed. Relations between these concepts and mathematics of semirings are…

Numerical Analysis · Mathematics 2010-05-10 G. L. Litvinov , V. P. Maslov , A. Ya. Rodionov , A. N. Sobolevski

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi

The interaction of neural networks with physical equations offers a wide range of applications. We provide a method which enables a neural network to transform objects subject to given physical constraints. Therefore an U-Net architecture…

Artificial Intelligence · Computer Science 2021-03-22 Lukas Harsch , Johannes Burgbacher , Stefan Riedelbauch

Decentralized optimization methods have been in the focus of optimization community due to their scalability, increasing popularity of parallel algorithms and many applications. In this work, we study saddle point problems of sum type,…

Optimization and Control · Mathematics 2021-10-26 Aleksandr Beznosikov , Alexander Rogozin , Dmitry Kovalev , Alexander Gasnikov

Many neural networks exhibit stability in their activation patterns over time in response to inputs from sensors operating under real-world conditions. By capitalizing on this property of natural signals, we propose a Recurrent Neural…

Neural and Evolutionary Computing · Computer Science 2016-12-19 Daniel Neil , Jun Haeng Lee , Tobi Delbruck , Shih-Chii Liu

The Resource $\lambda$-calculus is a variation of the $\lambda$-calculus where arguments can be superposed and must be linearly used. Hence it is a model for linear and non-deterministic programming languages, and the target language of…

Logic in Computer Science · Computer Science 2015-02-18 Marco Solieri

We consider the problem of reserving link capacity in a network in such a way that any of a given set of flow scenarios can be supported. In the optimal capacity reservation problem, we choose the reserved link capacities to minimize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-03 Nicholas Moehle , Xinyue Shen , Zhi-Quan Luo , Stephen Boyd

Graph-cuts are widely used in computer vision. In order to speed up the optimization process and improve the scalability for large graphs, Strandmark and Kahl introduced a splitting method to split a graph into multiple subgraphs for…

Data Structures and Algorithms · Computer Science 2016-11-03 Miao Yu , Shuhan Shen , Zhanyi Hu

This paper develops an algorithmic framework for real-time optimization of distribution-level distributed energy resources (DERs). The proposed framework optimizes the operation of both DERs that are individually controllable and groups of…

Optimization and Control · Mathematics 2019-02-28 Andrey Bernstein , Emiliano Dall'Anese

Confluence in abstract parallel category systems is established for net class-rewriting in iterative closed multilevel quotient graph structures with uncountable node arities by multi-dimensional transducer operations in topological metrics…

Logic in Computer Science · Computer Science 2016-12-26 Seppo Ilari Tirri

In our paper "Uniformity and the Taylor expansion of ordinary lambda-terms" (with Laurent Regnier), we studied a translation of lambda-terms as infinite linear combinations of resource lambda-terms, from a calculus similar to Boudol's…

Logic in Computer Science · Computer Science 2010-01-20 Thomas Ehrhard

The number of parameters in state of the art neural networks has drastically increased in recent years. This surge of interest in large scale neural networks has motivated the development of new distributed training strategies enabling such…

Machine Learning · Computer Science 2022-07-11 Aidan N. Gomez , Oscar Key , Kuba Perlin , Stephen Gou , Nick Frosst , Jeff Dean , Yarin Gal

We show that a constant number of self-attention layers can efficiently simulate, and be simulated by, a constant number of communication rounds of Massively Parallel Computation. As a consequence, we show that logarithmic depth is…

Machine Learning · Computer Science 2024-02-15 Clayton Sanford , Daniel Hsu , Matus Telgarsky

Latent Euclidean embedding models a given network by representing each node in a Euclidean space, where the probability of two nodes sharing an edge is a function of the distances between the nodes. This implies that for two nodes to share…

Social and Information Networks · Computer Science 2019-09-19 Clifford Anderson-Bergman , Phan Nguyen , Jose Cadena Pico

Solving nonlinear SMT problems over real numbers has wide applications in robotics and AI. While significant progress is made in solving quantifier-free SMT formulas in the domain, quantified formulas have been much less investigated. We…

Logic in Computer Science · Computer Science 2018-07-24 Soonho Kong , Armando Solar-Lezama , Sicun Gao

The intention of the present study is to establish general framework for automated problem solving by approaching the task universal algebraically introducing knowledge as realizations of generalized free algebra based nets, graphs with…

Artificial Intelligence · Computer Science 2013-05-27 Seppo Ilari Tirri

We propose a neural embedding algorithm called Network Vector, which learns distributed representations of nodes and the entire networks simultaneously. By embedding networks in a low-dimensional space, the algorithm allows us to compare…

Social and Information Networks · Computer Science 2017-09-11 Hao Wu , Kristina Lerman

In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to…

Systems and Control · Computer Science 2013-12-02 Mathias Bürger , Giuseppe Notarstefano , Frank Allgöwer

Motivated by the increasing shift to multicore computers, recent work has developed language support for responsive parallel applications that mix compute-intensive tasks with latency-sensitive, usually interactive, tasks. These…

Programming Languages · Computer Science 2020-04-07 Stefan K. Muller , Kyle Singer , Noah Goldstein , Umut A. Acar , Kunal Agrawal , I-Ting Angelina Lee

Graph embedding aims at learning a vector-based representation of vertices that incorporates the structure of the graph. This representation then enables inference of graph properties. Existing graph embedding techniques, however, do not…