English
Related papers

Related papers: Stochastic Three-Operator Splitting Algorithms for…

200 papers

We investigated the effects of scanning speed, beam configuration, and dose-rate modeling on the FLASH effect in post-mastectomy proton transmission-beam (TB) planning and evaluated whether optimizing the spot-scanning path can enhance…

Consider the problem of minimizing the expected value of a (possibly nonconvex) cost function parameterized by a random (vector) variable, when the expectation cannot be computed accurately (e.g., because the statistics of the random…

Multiagent Systems · Computer Science 2017-12-12 Yang Yang , Gesualdo Scutari , Daniel P. Palomar , Marius Pesavento

We propose a stochastic nonconvex optimization algorithm that achieves almost sure $\tilde{\mathcal{O}}(\epsilon^{-1.5})$ iteration complexity for problems with smooth objective functions and gradients only observable with noise. The…

Optimization and Control · Mathematics 2026-04-30 Yunsoo Ha , Sara Shashaani , Quoc Tran-dinh

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

This paper presents a novel algorithm for solving distribution steering problems featuring nonlinear dynamics and chance constraints. Covariance steering (CS) is an emerging methodology in stochastic optimal control that poses constraints…

Robotics · Computer Science 2025-09-24 Akash Ratheesh , Vincent Pacelli , Augustinos D. Saravanos , Evangelos A. Theodorou

Conventional cancer therapies include surgery, radiation therapy, chemotherapy, and, more recently, immunotherapy. These modalities are often combined to improve the therapeutic index. The general concept of radiation therapy is to increase…

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana

Operator splitting methods have been successfully used in computational sciences, statistics, learning and vision areas to reduce complex problems into a series of simpler subproblems. However, prevalent splitting schemes are mostly…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Risheng Liu , Shichao Cheng , Yi He , Xin Fan , Zhongxuan Luo

Operator splitting schemes are a class of powerful algorithms that solve complicated monotone inclusion and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which all simple pieces of the…

Optimization and Control · Mathematics 2015-07-09 Damek Davis

To increase the training speed of distributed learning, recent years have witnessed a significant amount of interest in developing both synchronous and asynchronous distributed stochastic variance-reduced optimization methods. However, all…

Machine Learning · Computer Science 2022-08-30 Zhuqing Liu , Xin Zhang , Jia Liu

We study stochastic optimization of nonconvex loss functions, which are typical objectives for training neural networks. We propose stochastic approximation algorithms which optimize a series of regularized, nonlinearized losses on large…

Machine Learning · Computer Science 2019-03-12 Weiran Wang , Nathan Srebro

Traditional algorithms for stochastic optimization require projecting the solution at each iteration into a given domain to ensure its feasibility. When facing complex domains, such as positive semi-definite cones, the projection operation…

Machine Learning · Computer Science 2013-04-03 Lijun Zhang , Tianbao Yang , Rong Jin , Xiaofei He

We consider the unconstrained optimization problem whose objective function is composed of a smooth and a non-smooth conponents where the smooth component is the expectation a random function. This type of problem arises in some interesting…

Optimization and Control · Mathematics 2011-07-01 Qihang Lin , Xi Chen , Javier Pena

We study finite-sum nonconvex optimization problems, where the objective function is an average of $n$ nonconvex functions. We propose a new stochastic gradient descent algorithm based on nested variance reduction. Compared with…

Machine Learning · Computer Science 2020-10-20 Dongruo Zhou , Pan Xu , Quanquan Gu

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

This paper studies distributed nonconvex optimization problems with stochastic gradients for a multi-agent system, in which each agent aims to minimize the sum of all agents' cost functions by using local compressed information exchange. We…

Optimization and Control · Mathematics 2024-03-05 Antai Xie , Xinlei Yi , Xiaofan Wang , Ming Cao , Xiaoqiang Ren

We propose a novel stochastic smoothing accelerated gradient (SSAG) method for general constrained nonsmooth convex composite optimization, and analyze the convergence rates. The SSAG method allows various smoothing techniques, and can deal…

Optimization and Control · Mathematics 2026-02-03 Ruyu Wang , Chao Zhang

This paper deals with the classic radiotherapy dose fractionation problem for cancer tumors concerning the following goals: a) To maximize the effect of radiation on the tumor, restricting the effect produced to the organs at risk (healing…

Optimization and Control · Mathematics 2021-02-17 Luis Alberto Fernández , Lucía Fernández

This paper proposes a novel spatiotemporal (ST) fusion framework for satellite images, named Robust Optimization-based Spatiotemporal Fusion (ROSTF). ST fusion is a promising approach to resolve a trade-off between the temporal and spatial…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Ryosuke Isono , Kazuki Naganuma , Shunsuke Ono

Purpose: A novel rotating gamma stereotactic radiosurgery (SRS) system (Galaxy RTi) with real-time image guidance technology has been developed for high-precision SRS and frameless fractionated stereotactic radiotherapy (SRT). This work…

Medical Physics · Physics 2022-10-11 Huan Liu , Ahmed Eldib , Lili Chen , Bin Wang , Shidong Li , Curtis Miyamoto , CM Charlie Ma