English
Related papers

Related papers: Application of a Second-order Stochastic Optimizat…

200 papers

The hidden metric space behind complex network topologies is a fervid topic in current network science and the hyperbolic space is one of the most studied, because it seems associated to the structural organization of many real complex…

Physics and Society · Physics 2018-06-20 Alessandro Muscoloni , Carlo Vittorio Cannistraci

Estimation of Distribution Algorithms have been proposed as a new paradigm for evolutionary optimization. This paper focuses on the parallelization of Estimation of Distribution Algorithms. More specifically, the paper discusses how to…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Jiri Ocenasek , Martin Pelikan

Poisson likelihood models have been prevalently used in imaging, social networks, and time series analysis. We propose fast, simple, theoretically-grounded, and versatile, optimization algorithms for Poisson likelihood modeling. The Poisson…

Machine Learning · Computer Science 2016-08-04 Niao He , Zaid Harchaoui , Yichen Wang , Le Song

We approach the development of models and control strategies of susceptible-infected-susceptible (SIS) epidemic processes from the perspective of marked temporal point processes and stochastic optimal control of stochastic differential…

Optimization and Control · Mathematics 2018-12-04 Lars Lorch , Abir De , Samir Bhatt , William Trouleau , Utkarsh Upadhyay , Manuel Gomez-Rodriguez

Differentially private (DP) stochastic convex optimization (SCO) is a fundamental problem, where the goal is to approximately minimize the population risk with respect to a convex loss function, given a dataset of $n$ i.i.d. samples from a…

Machine Learning · Computer Science 2022-05-06 Raef Bassily , Cristóbal Guzmán , Anupama Nandi

Stochastic epidemic models provide an interpretable probabilistic description of the spread of a disease through a population. Yet, fitting these models to partially observed data is a notoriously difficult task due to intractability of the…

Computation · Statistics 2022-10-21 Raphael Morsomme , Jason Xu

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many…

Machine Learning · Statistics 2023-11-27 Shin Matsushima , Hyokun Yun , Xinhua Zhang , S. V. N. Vishwanathan

In this paper, we propose a distributed stochastic second-order proximal method that enables agents in a network to cooperatively minimize the sum of their local loss functions without any centralized coordination. The proposed algorithm,…

Optimization and Control · Mathematics 2022-11-22 Chenyang Qiu , Shanying Zhu , Zichong Ou , Jie Lu

As the acquisition cost of the graphics processing unit (GPU) has decreased, personal computers (PC) can handle optimization problems nowadays. In optimization computing, intelligent swarm algorithms (SIAs) method is suitable for…

Neural and Evolutionary Computing · Computer Science 2021-10-05 Wei-Chang Yeh , Zhenyao Liu , Shi-Yi Tan , Shang-Ke Huang

The aim of paper is to apply two types of particle swarm optimization, global best andlocal best PSO to a constrained maximum likelihood estimation problem in pseudotime anal-ysis, a sub-field in bioinformatics. The results have shown that…

Neural and Evolutionary Computing · Computer Science 2022-10-04 Elvis Cui , Dongyuan Song , Weng Kee Wong

State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification. Deterministic versions of SSMs (e.g. LSTMs) proved extremely successful in modeling complex time series…

The search for the model or ingredients that describe the current vision of our cosmos has led to the creation of a set of highly favorable experiments, and therefore a great flow of information. Due to this torrent of information and the…

Cosmology and Nongalactic Astrophysics · Physics 2025-08-11 Daniel Morales Hernández , Gabriela Garcia-Arroyo , J. Alberto Vazquez

We present the parallel and interacting stochastic approximation annealing (PISAA) algorithm, a stochastic simulation procedure for global optimisation, that extends and improves the stochastic approximation annealing (SAA) by using…

Computation · Statistics 2015-08-21 Georgios Karagiannis , Bledar A. Konomi , Guang Lin , Faming Liang

Particle swarm optimization (PSO) is a search algorithm based on stochastic and population-based adaptive optimization. In this paper, a pathfinding strategy is proposed to improve the efficiency of path planning for a broad range of…

Neural and Evolutionary Computing · Computer Science 2022-06-24 David , Budi Adiperdana

Stochastic approximation (SA) algorithms are widely used in system optimization problems when only noisy measurements of the system are available. This paper studies two types of SA algorithms in a multivariate Kiefer-Wolfowitz setting:…

Optimization and Control · Mathematics 2021-07-28 Yiwen Chen

When performing Bayesian inference using Sequential Monte Carlo (SMC) methods, two considerations arise: the accuracy of the posterior approximation and computational efficiency. To address computational demands, Sequential Monte Carlo…

Machine Learning · Statistics 2025-07-11 Joshua Murphy , Conor Rosato , Andrew Millard , Lee Devlin , Paul Horridge , Simon Maskell

Stochastic compositional optimization (SCO) has attracted considerable attention because of its broad applicability to important real-world problems. However, existing works on SCO assume that the projection within a solution update is…

Optimization and Control · Mathematics 2025-05-27 Shuoguang Yang , Wei You , Zhe Zhang , Ethan X. Fang

In this article, we have proposed an epidemic model by using probability cellular automata theory. The essential mathematical features are analyzed with the help of stability theory. We have given an alternative modelling approach for the…

Cellular Automata and Lattice Gases · Physics 2009-05-30 Jin Zhen , Liu Quanxing , Mainul Haque

This paper proposes a two-stage estimation approach for a spatial misalignment scenario that is motivated by the epidemiological problem of linking pollutant exposures and health outcomes. We use the integrated nested Laplace approximation…

Methodology · Statistics 2022-07-21 Stephen Jun Villejo , Janine B Illian , Ben Swallow

Traditional epidemic detection algorithms make decisions using only local information. We propose a novel approach that explicitly models spatial information fusion from several metapopulations. Our method also takes into account…

Computation · Statistics 2015-09-15 Michael Ludkovski , Katherine Shatskikh