English
Related papers

Related papers: Users Guide for SnadiOpt: A Package Adding Automat…

200 papers

Biophysical neural system simulations are among the most computationally demanding scientific applications, and their optimization requires navigating high-dimensional parameter spaces under numerous constraints that impose a binary…

The remarkable success of diffusion and flow-matching models has ignited a surge of works on adapting them at test time for controlled generation tasks. Examples range from image editing to restoration, compression and personalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Or Ronai , Vladimir Kulikov , Tomer Michaeli

Manual engineering of high-performance implementations typically consumes many resources and requires in-depth knowledge of the hardware. Compilers try to address these problems; however, they are limited by design in what they can do. To…

Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface…

A good parallelization strategy can significantly improve the efficiency or reduce the cost for the distributed training of deep neural networks (DNNs). Recently, several methods have been proposed to find efficient parallelization…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-12 Zhenkun Cai , Kaihao Ma , Xiao Yan , Yidi Wu , Yuzhen Huang , James Cheng , Teng Su , Fan Yu

There is an increasing need for algorithms that can accurately detect changepoints in long time-series, or equivalent, data. Many common approaches to detecting changepoints, for example based on penalised likelihood or minimum description…

Methodology · Statistics 2014-09-08 Robert Maidstone , Toby Hocking , Guillem Rigaill , Paul Fearnhead

This paper proposes an open-source distributed solver for solving Sparse Convex Optimization (SCO) problems over computational networks. Motivated by past algorithmic advances in mixed-integer optimization, the Sparse Convex Optimization…

Optimization and Control · Mathematics 2022-11-01 Alireza Olama , Eduardo Camponogara , Jan Kronqvist

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

We describe a software package, TomOpt, developed to optimise the geometrical layout and specifications of detectors designed for tomography by scattering of cosmic-ray muons. The software exploits differentiable programming for the…

PYROBOCOP is a lightweight Python-based package for control and optimization of robotic systems described by nonlinear Differential Algebraic Equations (DAEs). In particular, the package can handle systems with contacts that are described…

Robotics · Computer Science 2021-06-08 Arvind U. Raghunathan , Devesh K. Jha , Diego Romeres

BayesOpt is a library with state-of-the-art Bayesian optimization methods to solve nonlinear optimization, stochastic bandits or sequential experimental design problems. Bayesian optimization is sample efficient by building a posterior…

Machine Learning · Computer Science 2014-05-30 Ruben Martinez-Cantin

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the key issues of…

Machine Learning · Computer Science 2023-11-14 Dogacan Yilmaz , İ. Esra Büyüktahtakın

Multi stage stochastic programs arise in many applications from engineering whenever a set of inventories or stocks has to be valued. Such is the case in seasonal storage valuation of a set of cascaded reservoir chains in hydro management.…

Optimization and Control · Mathematics 2019-12-02 Wim Van-Ackooij , Xavier Warin

In stochastic optimization, a common tool to deal sequentially with large sample is to consider the well-known stochastic gradient algorithm. Nevertheless, since the stepsequence is the same for each direction, this can lead to bad results…

Optimization and Control · Mathematics 2023-03-03 Antoine Godichon-Baggioni , Pierre Tarrago

The core challenge of high-dimensional and expensive black-box optimization (BBO) is how to obtain better performance faster with little function evaluation cost. The essence of the problem is how to design an efficient optimization…

Machine Learning · Computer Science 2023-07-26 Xiaobin Li , Kai Wu , Xiaoyu Zhang , Handing Wang , Jing Liu

Computing derivatives of noisy measurement data is ubiquitous in the physical, engineering, and biological sciences, and it is often a critical step in developing dynamic models or designing control. Unfortunately, the mathematical…

Dynamical Systems · Mathematics 2020-09-09 Floris van Breugel , J. Nathan Kutz , Bingni W. Brunton

A number of problems in relational Artificial Intelligence can be viewed as Stochastic Constraint Optimization Problems (SCOPs). These are constraint optimization problems that involve objectives or constraints with a stochastic component.…

Artificial Intelligence · Computer Science 2018-07-04 Anna L. D. Latour , Behrouz Babaki , Siegfried Nijssen

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

Niching is an important and widely used technique in evolutionary multi-objective optimization. Its applications mainly focus on maintaining diversity and avoiding early convergence to local optimum. Recently, a special class of…

Neural and Evolutionary Computing · Computer Science 2021-02-02 Yiming Peng , Hisao Ishibuchi

Many hyperparameter optimization (HyperOpt) methods assume restricted computing resources and mainly focus on enhancing performance. Here we propose a novel cloud-based HyperOpt (CHOPT) framework which can efficiently utilize shared…

Machine Learning · Computer Science 2018-10-17 Jinwoong Kim , Minkyu Kim , Heungseok Park , Ernar Kusdavletov , Dongjun Lee , Adrian Kim , Ji-Hoon Kim , Jung-Woo Ha , Nako Sung