English
Related papers

Related papers: Lp-norms, Log-barriers and Cramer transform in Opt…

200 papers

Many applications using large datasets require efficient methods for minimizing a proximable convex function subject to satisfying a set of linear constraints within a specified tolerance. For this task, we present a proximal projection…

Optimization and Control · Mathematics 2024-12-10 Howard Heaton

With the widespread adoption of machine learning systems, the need to curtail their behavior has become increasingly apparent. This is evidenced by recent advancements towards developing models that satisfy robustness, safety, and fairness…

Machine Learning · Computer Science 2024-03-19 Juan Elenter , Luiz F. O. Chamon , Alejandro Ribeiro

Temporal Point Processes (TPP) with partial likelihoods involving a latent structure often entail an intractable marginalization, thus making inference hard. We propose a novel approach to Maximum Likelihood Estimation (MLE) involving…

Machine Learning · Computer Science 2019-12-20 Amrith Setlur , Barnabás Póczós

Convex risk measures play a foundational role in the area of stochastic optimization. However, in contrast to risk neutral models, their applications are still limited due to the lack of efficient solution methods. In particular, the mean…

Optimization and Control · Mathematics 2024-12-30 Zhichao Jia , Guanghui Lan , Zhe Zhang

In this work, the problem of shape optimization, subject to PDE constraints, is reformulated as an $L^p$ best approximation problem under divergence constraints to the shape tensor introduced in Laurain and Sturm: ESAIM Math. Model. Numer.…

Numerical Analysis · Mathematics 2024-04-02 Gerhard Starke

The matrix logarithm, when applied to Hermitian positive definite matrices, is concave with respect to the positive semidefinite order. This operator concavity property leads to numerous concavity and convexity results for other matrix…

Optimization and Control · Mathematics 2019-12-06 Hamza Fawzi , James Saunderson , Pablo A. Parrilo

Comparison of Lasserre's measure--based bounds for polynomial optimization to bounds obtained by simulated annealing. We consider the problem of minimizing a continuous function $f$ over a compact set $\mathbf{K}$. We compare the hierarchy…

Optimization and Control · Mathematics 2017-03-03 Etienne de Klerk , Monique Laurent

We consider linear and obstacle problems driven by a nonlocal integral operator, for which nonlocal interactions are restricted to a ball of finite radius. These type of operators are used to model anomalous diffusion and, for a special…

Numerical Analysis · Mathematics 2018-04-30 Olena Burkovska , Max Gunzburger

We analyze a class of norms defined via an optimal interpolation problem involving the composition of norms and a linear operator. This construction, known as infimal postcomposition in convex analysis, is shown to encompass various of…

Optimization and Control · Mathematics 2017-08-30 Patrick L. Combettes , Andrew M. McDonald , Charles A. Micchelli , Massimiliano Pontil

Affine matrix rank minimization problem is a fundamental problem with a lot of important applications in many fields. It is well known that this problem is combinatorial and NP-hard in general. In this paper, a continuous promoting low rank…

Optimization and Control · Mathematics 2017-05-02 Angang Cui , Jigen Peng , Haiyang Li , Chengyi Zhang , Yongchao Yu

We provide new insight into a {\em generalized conditional subgradient} algorithm and a {\em generalized mirror descent} algorithm for the convex minimization problem \[ \min_x \; \{f(Ax) + h(x)\}.\] As Bach showed in [{\em SIAM J. Optim.},…

Optimization and Control · Mathematics 2019-06-04 Javier Pena

Guaranteed lower Dirichlet eigenvalue bounds (GLB) can be computed for the $m$-th Laplace operator with a recently introduced extra-stabilized nonconforming Crouzeix-Raviart ($m=1$) or Morley ($m=2$) finite element eigensolver. Striking…

Numerical Analysis · Mathematics 2022-03-03 Carsten Carstensen , Sophie Puttkammer

This paper presents a lower bound for optimizing a finite sum of $n$ functions, where each function is $L$-smooth and the sum is $\mu$-strongly convex. We show that no algorithm can reach an error $\epsilon$ in minimizing all functions from…

Machine Learning · Statistics 2015-10-06 Alekh Agarwal , Leon Bottou

We consider the numerical construction of minimal Lagrangian graphs, which is related to recent applications in materials science, molecular engineering, and theoretical physics. It is known that this problem can be formulated as an…

Numerical Analysis · Mathematics 2021-07-01 Brittany Froese Hamfeldt , Jacob Lesniewski

The convergence rate of various first-order optimization algorithms is a pivotal concern within the numerical optimization community, as it directly reflects the efficiency of these algorithms across different optimization problems. Our…

Optimization and Control · Mathematics 2024-07-23 Chenyi Li , Ziyu Wang , Wanyi He , Yuxuan Wu , Shengyang Xu , Zaiwen Wen

The heart of the a priori and a posteriori error control in convex minimization problems is the sharp control of the differences of discrete and exact minimal energy. Conforming finite element discretizations for p-Laplace type minimization…

Numerical Analysis · Mathematics 2026-04-23 Carsten Carstensen , Ngoc Tien Tran

Developing controllers for obstacle avoidance between polytopes is a challenging and necessary problem for navigation in tight spaces. Traditional approaches can only formulate the obstacle avoidance problem as an offline optimization…

Systems and Control · Electrical Eng. & Systems 2025-02-10 Akshay Thirugnanam , Jun Zeng , Koushil Sreenath

We reconsider the stochastic (sub)gradient approach to the unconstrained primal L1-SVM optimization. We observe that if the learning rate is inversely proportional to the number of steps, i.e., the number of times any training pattern is…

Machine Learning · Computer Science 2014-01-28 Constantinos Panagiotakopoulos , Petroula Tsampouka

It is well known that derivatives of solutions to elliptic boundary value problems may become unbounded near the corner of a domain with a conical singularity, even if the data are smooth. When the corner domain is approximated by more…

Analysis of PDEs · Mathematics 2025-10-08 Martin Costabel , Monique Dauge

In this paper we propose a class of randomized primal-dual methods to contend with large-scale saddle point problems defined by a convex-concave function $\mathcal{L}(\mathbf{x},y)\triangleq\sum_{i=1}^m f_i(x_i)+\Phi(\mathbf{x},y)-h(y)$. We…

Optimization and Control · Mathematics 2023-03-17 E. Yazdandoost Hamedani , A. Jalilzadeh , N. S. Aybat