English
Related papers

Related papers: Efficient and accurate separable models for discre…

200 papers

Determining the proper level of details to develop and solve physical models is usually difficult when one encounters new engineering problems. Such difficulty comes from how to balance the time (simulation cost) and accuracy for the…

Artificial Intelligence · Computer Science 2022-02-03 Randi Wang , Morad Behandish

Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of…

Machine Learning · Statistics 2014-11-03 Hidekazu Oiwa , Ryohei Fujimaki

In this paper, we propose a multilevel stochastic framework for the solution of nonconvex unconstrained optimization problems. The proposed approach uses random regularized first-order models that exploit an available hierarchical…

Optimization and Control · Mathematics 2025-11-27 Filippo Marini , Margherita Porcelli , Elisa Riccietti

In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of…

Optimization and Control · Mathematics 2018-12-17 Yang Yang , Marius Pesavento

This paper presents an algorithm to solve non-convex optimal control problems, where non-convexity can arise from nonlinear dynamics, and non-convex state and control constraints. This paper assumes that the state and control constraints…

Optimization and Control · Mathematics 2017-05-05 Yuanqi Mao , Michael Szmuk , Behcet Acikmese

While several classes of integer linear optimization problems are known to be solvable in polynomial time, far fewer tractability results exist for integer nonlinear optimization. In this work, we narrow this gap by identifying a broad…

Optimization and Control · Mathematics 2026-02-09 Alberto Del Pia

Matrix sensing problems exhibit pervasive non-convexity, plaguing optimization with a proliferation of suboptimal spurious solutions. Avoiding convergence to these critical points poses a major challenge. This work provides new theoretical…

Optimization and Control · Mathematics 2024-03-12 Ziye Ma , Ying Chen , Javad Lavaei , Somayeh Sojoudi

Separable convex optimization problems with linear ascending inequality and equality constraints are addressed in this paper. Under an ordering condition on the slopes of the functions at the origin, an algorithm that determines the optimum…

Information Theory · Computer Science 2011-07-22 Arun Padakandla , Rajesh Sundaresan

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding…

Optimization and Control · Mathematics 2017-06-21 Jérôme Bolte , Shoham Sabach , Marc Teboulle , Yakov Vaisbourd

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

This work proposes a model-reduction approach for the material point method on nonlinear manifolds. Our technique approximates the $\textit{kinematics}$ by approximating the deformation map using an implicit neural representation that…

Machine Learning · Computer Science 2023-02-13 Peter Yichen Chen , Maurizio M. Chiaramonte , Eitan Grinspun , Kevin Carlberg

This paper addresses the challenge of accommodating nonlinear dynamics and constraints in rapid trajectory optimization, envisioned for use in the context of onboard guidance. We present a novel framework that uniquely employs…

Optimization and Control · Mathematics 2024-10-15 Ethan R. Burnett , Francesco Topputo

We develop a stochastic algorithm for independent component analysis that incorporates multi-trial supervision, which is available in many scientific contexts. The method blends a proximal gradient-type algorithm in the space of invertible…

Machine Learning · Computer Science 2025-08-29 Ronak Mehta , Mateus Piovezan Otto , Noah Stanis , Azadeh Yazdan-Shahmorad , Zaid Harchaoui

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

We introduce a class of first-order methods for smooth constrained optimization that are based on an analogy to non-smooth dynamical systems. Two distinctive features of our approach are that (i) projections or optimizations over the entire…

Optimization and Control · Mathematics 2025-04-15 Michael Muehlebach , Michael I. Jordan

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

This paper provides a self-contained ordinary differential equation solver approach for separable convex optimization problems. A novel primal-dual dynamical system with built-in time rescaling factors is introduced, and the exponential…

Optimization and Control · Mathematics 2023-04-26 Hao Luo , Zihang Zhang

Although design optimization has shown its great power of automatizing the whole design process and providing an optimal design, using sophisticated computational models, its process can be formidable due to a computationally expensive…

Numerical Analysis · Mathematics 2019-09-26 Youngsoo Choi , Geoffrey Oxberry , Daniel White , Trenton Kirchdoerfer