English
Related papers

Related papers: Assign optimization for algorithmic differentiatio…

200 papers

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

Distributed optimization algorithms are used in a wide variety of problems involving complex network systems where the goal is for a set of agents in the network to solve a network-wide optimization problem via distributed update rules. In…

Optimization and Control · Mathematics 2025-09-23 Liam Hallinan , Ioannis Lestas

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

Optimization and Control · Mathematics 2024-01-17 Michael J. Neely

We propose a novel approach using supervised learning to obtain near-optimal primal solutions for two-stage stochastic integer programming (2SIP) problems with constraints in the first and second stages. The goal of the algorithm is to…

Optimization and Control · Mathematics 2019-12-18 Yoshua Bengio , Emma Frejinger , Andrea Lodi , Rahul Patel , Sriram Sankaranarayanan

In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given…

Numerical Analysis · Mathematics 2022-10-12 Monika Eisenmann , Tony Stillfjord

The operation of large-scale infrastructure networks requires scalable optimization schemes. To guarantee safe system operation, a high degree of feasibility in a small number of iterations is important. Decomposition schemes can help to…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Alexander Engelmann , Sungho Shin , François Pacaud , Victor M. Zavala

Optimizing shapes and topology of physical devices is crucial for both scientific and technological advancements, given its wide-ranging implications across numerous industries and research areas. Innovations in shape and topology…

Computational Physics · Physics 2023-10-02 Alexander Luce , Rasoul Alaee , Fabian Knorr , Florian Marquardt

We study nonlinear regression of real valued data in an individual sequence manner, where we provide results that are guaranteed to hold without any statistical assumptions. We address the convergence and undertraining issues of…

Machine Learning · Computer Science 2014-10-08 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

Stencil loops are a common motif in computations including convolutional neural networks, structured-mesh solvers for partial differential equations, and image processing. Stencil loops are easy to parallelise, and their fast execution is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-08 Jan Hückelheim , Navjot Kukreja , Sri Hari Krishna Narayanan , Fabio Luporini , Gerard Gorman , Paul Hovland

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

Optimization and Control · Mathematics 2016-02-23 Musa Maharramov , Stewart A. Levin

Selecting the fastest algorithm for a specific signal/image processing task is a challenging question. We propose an approach based on the Performance Estimation Problem framework that numerically and automatically computes the worst-case…

Optimization and Control · Mathematics 2024-03-18 Nizar Bousselmi , Nelly Pustelnik , Julien M. Hendrickx , François Glineur

In this paper we consider distributed optimization problems in which the cost function is separable (i.e., a sum of possibly non-smooth functions all sharing a common variable) and can be split into a strongly convex term and a convex one.…

Optimization and Control · Mathematics 2016-09-20 Ivano Notarnicola , Giuseppe Notarstefano

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

This paper introduces a warehouse optimization procedure aimed at enhancing the efficiency of product storage and retrieval. By representing product locations and order flows within a time-evolving graph structure, we employ unsupervised…

Optimization and Control · Mathematics 2025-10-21 Magnus Bengtsson , Jens Wittsten , Jonas Waidringer

Traditionally, DBMSs separate their storage layer from their indexing layer. While the storage layer physically materializes the database and provides low-level access methods to it, the indexing layer on top enables a faster locating of…

Databases · Computer Science 2022-12-07 Felix Schuhknecht , Justus Henneberg

Optimization problems with an auxiliary latent variable structure in addition to the main model parameters occur frequently in computer vision and machine learning. The additional latent variables make the underlying optimization task…

Machine Learning · Computer Science 2020-03-13 Christopher Zach , Huu Le

Most decision tree induction algorithms are based on a greedy top-down recursive partitioning strategy for tree growth. In this paper, we propose several methods for induction of decision trees and their ensembles based on evolutionary…

Neural and Evolutionary Computing · Computer Science 2020-02-04 Evgeny Dolotov , Nikolai Zolotykh

In this paper, a reduced-rank scheme with joint iterative optimization is presented for direction of arrival estimation. A rank-reduction matrix and an auxiliary reduced-rank parameter vector are jointly optimized to calculate the output…

Data Structures and Algorithms · Computer Science 2016-11-17 L. Wang , R. C. de Lamare , M. Haardt

Current subgroup identification methods typically follow a two-step approach: first estimate conditional average treatment effects and then apply thresholding or rule-based procedures to define subgroups. While intuitive, this decoupled…

Machine Learning · Computer Science 2025-08-04 Wenxin Chen , Weishen Pan , Kyra Gan , Fei Wang