English
Related papers

Related papers: Node-screening tests for L0-penalized least-square…

200 papers

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

Optimization and Control · Mathematics 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

The evaluation of heuristic optimizers on test problems, better known as \emph{benchmarking}, is a cornerstone of research in multi-objective optimization. However, most test problems used in benchmarking numerical multi-objective black-box…

Optimization and Control · Mathematics 2026-01-26 Lennart Schäpermeier , Pascal Kerschke

We consider a setting in which it is desired to find an optimal complex vector $\mathbf{x}\in\mathbb{C}^N$ that satisfies $\mathcal{A}(\mathbf{x}) \approx \mathbf{b}$ in a least-squares sense, where $\mathbf{b} \in \mathbb{C}^M$ is a data…

Numerical Analysis · Mathematics 2020-07-21 Tae Hyung Kim , Justin P. Haldar

Screening and working set techniques are important approaches to reducing the size of an optimization problem. They have been widely used in accelerating first-order methods for solving large-scale sparse learning problems. In this paper,…

Machine Learning · Statistics 2023-04-24 Jian Huang , Yuling Jiao , Lican Kang , Jin Liu , Yanyan Liu , Xiliang Lu , Yuanyuan Yang

Many learning tasks, such as cross-validation, parameter search, or leave-one-out analysis, involve multiple instances of similar problems, each instance sharing a large part of learning data with the others. We introduce a robust framework…

Optimization and Control · Mathematics 2014-11-04 Vu Pham , Laurent El Ghaoui , Arturo Fernandez

One powerful technique to solve NP-hard optimization problems in practice is branch-and-reduce search---which is branch-and-bound that intermixes branching with reductions to decrease the input size. While this technique is known to be very…

Data Structures and Algorithms · Computer Science 2018-10-26 Sebastian Lamm , Christian Schulz , Darren Strash , Robert Williger , Huashuo Zhang

Multi-Objective Mixed-Integer Non-Linear Programming problems (MO-MINLPs) appear in several real-world applications, especially in the mechanical engineering field. To determine a good approximated Pareto front for this type of problems, we…

Optimization and Control · Mathematics 2021-05-17 Ahmed Jaber , Pascal Lafon , Rafic Younes

In this paper, we present a nonlinear least-squares fitting algorithm using B-splines with free knots. Since its performance strongly depends on the initial estimation of the free parameters (i.e. the knots), we also propose a fast and…

Signal Processing · Electrical Eng. & Systems 2020-03-13 Péter Kovács , Andrea M. Fekete

Robust Support Vector Machines (R-SVMs) address feature noise by adopting a worst-case robust formulation that explicitly incorporates uncertainty sets into training. While this robustness improves reliability, it also leads to increased…

Machine Learning · Computer Science 2026-03-27 Tan-Hau Nguyen , Thu-Le Tran , Kien Trung Nguyen

We propose a general random subspace framework for unconstrained nonconvex optimization problems that requires a weak probabilistic assumption on the subspace gradient, which we show to be satisfied by various random matrix ensembles, such…

Optimization and Control · Mathematics 2022-11-21 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

Methodology · Statistics 2012-02-07 Nicolai Meinshausen

Many fixed-parameter tractable algorithms using a bounded search tree have been repeatedly improved, often by describing a larger number of branching rules involving an increasingly complex case analysis. We introduce a novel and general…

Discrete Mathematics · Computer Science 2015-05-19 James Nastos , Yong Gao

We investigate practical algorithms to find or disprove the existence of small subsets of a dataset which, when removed, reverse the sign of a coefficient in an ordinary least squares regression involving that dataset. We empirically study…

Methodology · Statistics 2023-08-01 Daniel Freund , Samuel B. Hopkins

We define and analyse a least-squares finite element method for a first-order reformulation of the obstacle problem. Moreover, we derive variational inequalities that are based on similar but non-symmetric bilinear forms. A priori error…

Numerical Analysis · Mathematics 2018-01-30 Thomas Führer

This paper extends the SQP-approach of the well-known bundle-Newton method for nonsmooth unconstrained minimization to the nonlinearly constrained case. Instead of using a penalty function or a filter or an improvement function to deal with…

Optimization and Control · Mathematics 2015-06-29 Hannes Fendl , Hermann Schichl

Weighted variants of triangle detection are an important object of study because of their prominence in fine-grained complexity. We revisit the Node-Weighted Triangle problem, where the goal is to decide if a vertex-weighted graph contains…

Data Structures and Algorithms · Computer Science 2026-05-12 Shyan Akmal , Nick Fischer

This paper presents an efficient algorithm for the least-squares problem using the point-to-plane cost, which aims to jointly optimize depth sensor poses and plane parameters for 3D reconstruction. We call this least-squares problem…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Lipu Zhou , Daniel Koppel , Hui Ju , Frank Steinbruecker , Michael Kaess

Detectability of failures of linear programming (LP) decoding and the potential for improvement by adding new constraints motivate the use of an adaptive approach in selecting the constraints for the underlying LP problem. In this paper, we…

Information Theory · Computer Science 2007-07-13 Mohammad H. Taghavi , Paul H. Siegel

We consider the problem of minimizing a polynomial $f$ over the binary hypercube. We show that, for a specific set of polynomials, their binary non-negativity can be checked in a polynomial time via minimum cut algorithms, and we construct…

Optimization and Control · Mathematics 2024-05-24 Liding Xu , Leo Liberti

State-of-the-art neural network (NN) verifiers demonstrate that applying the branch-and-bound (BaB) procedure with fast bounding techniques plays a key role in tackling many challenging verification properties. In this work, we introduce…

Machine Learning · Computer Science 2025-12-15 Duo Zhou , Jorge Chavez , Hesun Chen , Grani A. Hanasusanto , Huan Zhang