English
Related papers

Related papers: Polynomial Optimization via Random Projection and …

200 papers

Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the…

Optimization and Control · Mathematics 2023-06-13 Stephan Helfrich , Stefan Ruzika , Clemens Thielen

We present algorithms and heuristics to compute the characteristic polynomial of a matrix given its minimal polynomial. The matrix is represented as a black-box, i.e., by a function to compute its matrix-vector product. The methods apply to…

Symbolic Computation · Computer Science 2009-05-18 Jean-Guillaume Dumas , Clément Pernet , B. David Saunders

Black-box optimization formulations for biological sequence design have drawn recent attention due to their promising potential impact on the pharmaceutical industry. In this work, we propose to unify two seemingly distinct worlds:…

Machine Learning · Computer Science 2022-02-10 Dinghuai Zhang , Jie Fu , Yoshua Bengio , Aaron Courville

Black-box optimization refers to the optimization problem whose objective function and/or constraint sets are either unknown, inaccessible, or non-existent. In many applications, especially with the involvement of humans, the only way to…

Optimizing high-dimensional black-box functions under black-box constraints is a pervasive task in a wide range of scientific and engineering problems. These problems are typically harder than unconstrained problems due to hard-to-find…

Machine Learning · Computer Science 2026-05-08 Kiyoung Om , Kyuil Sim , Taeyoung Yun , Hyeongyu Kang , Jinkyoo Park

Kernelization algorithms in the context of Parameterized Complexity are often based on a combination of reduction rules and combinatorial insights. We will expose in this paper a similar strategy for obtaining polynomial-time approximation…

Data Structures and Algorithms · Computer Science 2014-09-15 Faisal N. Abu-Khzam , Cristina Bazgan , Morgan Chopin , Henning Fernau

Fitting linear regression models can be computationally very expensive in large-scale data analysis tasks if the sample size and the number of variables are very large. Random projections are extensively used as a dimension reduction tool…

Statistics Theory · Mathematics 2017-01-20 Gian-Andrea Thanei , Christina Heinze , Nicolai Meinshausen

We classify, according to their computational complexity, integer optimization problems whose constraints and objective functions are polynomials with integer coefficients and the number of variables is fixed. For the optimization of an…

Optimization and Control · Mathematics 2017-01-03 Jesús A. De Loera , Raymond Hemmecke , Matthias Köppe , Robert Weismantel

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

Many important multiple-objective decision problems can be cast within the framework of ranking under constraints and solved via a weighted bipartite matching linear program. Some of these optimization problems, such as personalized content…

Information Retrieval · Computer Science 2022-02-16 Yegor Tkachenko , Wassim Dhaouadi , Kamel Jedidi

Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

Polynomial optimization problems are infinite-dimensional, nonconvex, NP-hard, and are often handled in practice with the moment-sums of squares hierarchy of semidefinite programming bounds. We consider problems where the objective function…

Optimization and Control · Mathematics 2025-11-25 Igor Klep , Victor Magron , Tobias Metzlaff , Jie Wang

When applying machine learning to problems in NLP, there are many choices to make about how to represent input texts. These choices can have a big effect on performance, but they are often uninteresting to researchers or practitioners who…

Computation and Language · Computer Science 2015-03-03 Dani Yogatama , Noah A. Smith

We derive a stochastic gradient algorithm for semidefinite optimization using randomization techniques. The algorithm uses subsampling to reduce the computational cost of each iteration and the subsampling ratio explicitly controls…

Optimization and Control · Mathematics 2011-08-30 Alexandre d'Aspremont

Blackbox algorithms for linear algebra problems start with projection of the sequence of powers of a matrix to a sequence of vectors (Lanczos), a sequence of scalars (Wiedemann) or a sequence of smaller matrices (block methods). Such…

Symbolic Computation · Computer Science 2015-06-18 Gavin Harrison , Jeremy Johnson , B. David Saunders

We consider polynomials of a few linear forms and show how exploit this type of sparsity for optimization on some particular domains like the Euclidean sphere or a polytope. Moreover, a simple procedure allows to detect this form of…

Optimization and Control · Mathematics 2022-04-05 Jean-Bernard Lasserre

Sum of squares (SOS) optimization is a powerful technique for solving problems where the positivity of a polynomials must be enforced. The common approach to solve an SOS problem is by relaxation to a Semidefinite Program (SDP). The main…

Optimization and Control · Mathematics 2024-10-29 Daniel Keren , Margarita Osadchy , Roi Poranne

We consider the problem of uniform sampling of points on an algebraic variety. Specifically, we develop a randomized algorithm that, given a small set of multivariate polynomials over a sufficiently large finite field, produces a common…

Data Structures and Algorithms · Computer Science 2009-02-10 Mahdi Cheraghchi , Amin Shokrollahi

Given a compact parameter set $Y\subset R^p$, we consider polynomial optimization problems $(P_y$) on $R^n$ whose description depends on the parameter $y\inY$. We assume that one can compute all moments of some probability measure $\phi$ on…

Optimization and Control · Mathematics 2009-05-18 Jean B. Lasserre

Optimization over non-negative polynomials is fundamental for nonlinear systems analysis and control. We investigate the relation between three tractable relaxations for optimizing over sparse non-negative polynomials: sparse sum-of-squares…

Optimization and Control · Mathematics 2020-01-13 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou