English
Related papers

Related papers: A Truncation Approach for Fast Computation of Dist…

200 papers

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

Machine Learning · Statistics 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

A new segmentation fusion method is proposed that ensembles the output of several segmentation algorithms applied on a remotely sensed image. The candidate segmentation sets are processed to achieve a consensus segmentation using a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Mete Ozay , Fatos T. Yarman Vural , Sanjeev R. Kulkarni , H. Vincent Poor

The aim of this paper is to numerically solve a diffusion differential problem having time derivative of fractional order. To this end we propose a collocation-Galerkin method that uses the fractional splines as approximating functions. The…

Numerical Analysis · Mathematics 2022-04-27 Laura Pezza , Francesca Pitolli

This paper studies distributed continuous-time optimization for time-varying quadratic cost functions with uncertain parameters. We first propose a centralized adaptive optimization algorithm using partial information of the cost function.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Liangze Jiang , Zheng-Guang Wu , Lei Wang

Recent work by Zymnis et al. proposes an efficient primal-dual interior-point method, using a truncated Newton method, for solving the network utility maximization (NUM) problem. This method has shown superior performance relative to the…

Information Theory · Computer Science 2010-03-23 Danny Bickson , Yoav Tock , Argyris Zymnis , Stephen Boyd , Danny Dolev

In the paper, a novel distributed stochastic approximation algorithm (DSAA) is proposed to seek roots of the sum of local functions, each of which is associated with an agent from the multiple agents connected in a network. At any time,…

Optimization and Control · Mathematics 2019-05-06 Jinlong Lei , Han-Fu Chen

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Composite function minimization captures a wide spectrum of applications in both computer vision and machine learning. It includes bound constrained optimization and cardinality regularized optimization as special cases. This paper proposes…

Optimization and Control · Mathematics 2016-12-08 Ganzhao Yuan , Wei-Shi Zheng , Bernard Ghanem

We describe a simple, efficient method for simulating Hamiltonian dynamics on a quantum computer by approximating the truncated Taylor series of the evolution operator. Our method can simulate the time evolution of a wide variety of…

Quantum Physics · Physics 2015-03-06 Dominic W. Berry , Andrew M. Childs , Richard Cleve , Robin Kothari , Rolando D. Somma

Finding numerical solutions describing bubble nucleation is notoriously difficult in more than one field space dimension. Traditional shooting methods fail because of the extreme non-linearity of field evolution over a macroscopic distance…

General Relativity and Quantum Cosmology · Physics 2017-02-01 Ali Masoumi , Ken D. Olum , Benjamin Shlaer

This paper introduces a novel algorithmic solution for the approximation of a given multivariate function by a nomographic function that is composed of a one-dimensional continuous and monotone outer function and a sum of univariate…

Information Theory · Computer Science 2015-07-14 Steffen Limmer , Jafar Mohammadi , Slawomir Stanczak

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

We survey key techniques and results from approximation theory in the context of uniform approximations to real functions such as e^{-x}, 1/x, and x^k. We then present a selection of results demonstrating how such approximations can be used…

Data Structures and Algorithms · Computer Science 2013-09-20 Sushant Sachdeva , Nisheeth Vishnoi

Calculations of the Fourier transform of a constant quantity over an area or volume defined by polygons (connected vertices) are often useful in modeling wave scattering, or in fourier-space filtering of real-space vector-based volumes and…

Numerical Analysis · Mathematics 2021-04-20 Brian B. Maranville

Building on the previous work of Lee et al. and Ferdinand et al. on coded computation, we propose a sequential approximation framework for solving optimization problems in a distributed manner. In a distributed computation system, latency…

Information Theory · Computer Science 2017-10-26 Jingge Zhu , Ye Pu , Vipul Gupta , Claire Tomlin , Kannan Ramchandran

The problem of computing functions of values at the nodes in a network in a totally distributed manner, where nodes do not have unique identities and make decisions based only on local information, has applications in sensor, peer-to-peer,…

Networking and Internet Architecture · Computer Science 2007-05-23 Damon Mosk-Aoyama , Devavrat Shah

Combining several (sample approximations of) distributions, which we term sub-posteriors, into a single distribution proportional to their product, is a common challenge. Occurring, for instance, in distributed 'big data' problems, or when…

Methodology · Statistics 2023-07-13 Ryan S. Y. Chan , Murray Pollock , Adam M. Johansen , Gareth O. Roberts

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

Recent advances in optimization theory have shown that smooth strongly convex finite sums can be minimized faster than by treating them as a black box "batch" problem. In this work we introduce a new method in this class with a theoretical…

Machine Learning · Computer Science 2014-07-11 Aaron J. Defazio , Tibério S. Caetano , Justin Domke