English
Related papers

Related papers: TRUST-TECH based Methods for Optimization and Lear…

200 papers

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

We study approaches to robust model-based design of experiments in the context of maximum-likelihood estimation. These approaches provide robustification of model-based methodologies for the design of optimal experiments by accounting for…

Methodology · Statistics 2021-09-03 Anwesh Reddy Gottu Mukkula , Michal Mateáš , Miroslav Fikar , Radoslav Paulen

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

Stochastic optimization of engineering systems is often infeasible due to repeated evaluations of a computationally expensive, high-fidelity simulation. Bi-fidelity methods mitigate this challenge by leveraging a cheaper, approximate model…

Optimization and Control · Mathematics 2025-12-19 Thomas O. Dixon , Geoffrey F. Bomarito , James E. Warner , Alex A. Gorodetsky

Engineers learn from every design they create, building intuition that helps them quickly identify promising solutions for new problems. Topology optimization (TO) - a well-established computational method for designing structures with…

Computational Engineering, Finance, and Science · Computer Science 2025-02-05 Igor Kuszczak , Gawel Kus , Federico Bosi , Miguel A. Bessa

The goal of this tutorial is to introduce key models, algorithms, and open questions related to the use of optimization methods for solving problems arising in machine learning. It is written with an INFORMS audience in mind, specifically…

Machine Learning · Statistics 2017-07-03 Frank E. Curtis , Katya Scheinberg

Optimization networks are a new methodology for holistically solving interrelated problems that have been developed with combinatorial optimization problems in mind. In this contribution we revisit the core principles of optimization…

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

We develop a trust-region method for efficiently minimizing the sum of a smooth function, a nonsmooth convex function, and the composition of a finite-valued support function with a smooth function. Optimization problems with this structure…

Optimization and Control · Mathematics 2026-04-09 Drew P. Kouri

Model predictive control (MPC) has established itself as the primary methodology for constrained control, enabling general-purpose robot autonomy in diverse real-world scenarios. However, for most problems of interest, MPC relies on the…

Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus on the convergence…

Artificial Intelligence · Computer Science 2023-07-19 Yunwen Lei

Uncertainty in optimization is often represented as stochastic parameters in the optimization model. In Predict-Then-Optimize approaches, predictions of a machine learning model are used as values for such parameters, effectively…

Machine Learning · Computer Science 2025-12-03 Pieter Smet

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

Optimization and Control · Mathematics 2022-10-31 Alberto De Marchi

In traditional topology optimization, the computing time required to iteratively update the material distribution within a design domain strongly depends on the complexity or size of the problem, limiting its application in real engineering…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Gabriel Garayalde , Matteo Torzoni , Matteo Bruggi , Alberto Corigliano

Non-convex optimization problems are challenging to solve; the success and computational expense of a gradient descent algorithm or variant depend heavily on the initialization strategy. Often, either random initialization is used or…

Machine Learning · Computer Science 2020-12-23 Kartik Ahuja , Amit Dhurandhar , Kush R. Varshney

Min-max optimization problems, also known as saddle point problems, have attracted significant attention due to their applications in various fields, such as fair beamforming, generative adversarial networks (GANs), and adversarial…

Machine Learning · Computer Science 2024-09-11 Yuma Ichikawa , Koji Hukushima

Constrained optimization in high-dimensional black-box settings is difficult due to expensive evaluations, the lack of gradient information, and complex feasibility regions. In this work, we propose a Bayesian optimization method that…

Machine Learning · Statistics 2026-03-26 Raju Chowdhury , Tanmay Sen , Prajamitra Bhuyan , Biswabrata Pradhan

Topology optimization is used for the design of high-performance structures but remains fundamentally limited by its iterative nature, requiring repeated finite element analyses that prevent real-time deployment and large-scale design…

Computational Engineering, Finance, and Science · Computer Science 2026-04-07 Aaron Lutheran , Srijan Das , Alireza Tabarraei

Optimization equips engineers and scientists in a variety of fields with the ability to transcribe their problems into a generic formulation and receive optimal solutions with relative ease. Industries ranging from aerospace to robotics…

Artificial Intelligence · Computer Science 2022-12-05 Keivan Shariatmadar , Kaizheng Wang , Calvin R. Hubbard , Hans Hallez , David Moens

We develop an interior-point method for nonsmooth regularized bound-constrained optimization problems. Our method consists of iteratively solving a sequence of unconstrained nonsmooth barrier subproblems. We use a variant of the proximal…

Optimization and Control · Mathematics 2024-02-29 Geoffroy Leconte , Dominique Orban