English
Related papers

Related papers: Parametric k-best alignment

200 papers

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

This paper studies the parameter tuning problem of positive linear systems for optimizing their stability properties. We specifically show that, under certain regularity assumptions on the parametrization, the problem of finding the…

Optimization and Control · Mathematics 2019-11-26 Masaki Ogura , Masako Kishida , James Lam

Probabilistic models often have parameters that can be translated, scaled, permuted, or otherwise transformed without changing the model. These symmetries can lead to strong correlation and multimodality in the posterior distribution over…

Machine Learning · Statistics 2013-12-20 Robert Nishihara , Thomas Minka , Daniel Tarlow

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

Almost all optimization algorithms have algorithm-dependent parameters, and the setting of such parameter values can largely influence the behaviour of the algorithm under consideration. Thus, proper parameter tuning should be carried out…

Artificial Intelligence · Computer Science 2023-08-31 Geethu Joy , Christian Huyck , Xin-She Yang

In this paper, we study parametric analysis of semidefinite optimization problems w.r.t. the perturbation of the objective function. We study the behavior of the optimal partition and optimal set mapping on a so-called nonlinearity…

Optimization and Control · Mathematics 2019-04-30 Ali Mohammad-Nezhad , Tamas Terlaky

The learning of mixture models can be viewed as a clustering problem. Indeed, given data samples independently generated from a mixture of distributions, we often would like to find the {\it correct target clustering} of the samples…

Machine Learning · Statistics 2022-08-26 Zhaoqiang Liu , Vincent Y. F. Tan

Given a matrix $A$ and $k\geq 0$, we study the problem of finding the $k\times k$ submatrix of $A$ with the maximum determinant in absolute value. This problem is motivated by the question of computing the determinant-based lower bound of…

Data Structures and Algorithms · Computer Science 2021-09-16 Nima Anari , Thuy-Duong Vuong

Algorithms often carry out equally many computations for "easy" and "hard" problem instances. In particular, algorithms for finding nearest neighbors typically have the same running time regardless of the particular problem instance. In…

Data Structures and Algorithms · Computer Science 2020-03-25 Daniel LeJeune , Richard G. Baraniuk , Reinhard Heckel

The parametric geometry of numbers of Schmidt and Summerer deals with rational approximation to points in $\mathbb{R}^n$. We extend this theory to a number field $K$ and its completion $K_w$ at a place $w$ in order to treat approximation…

Number Theory · Mathematics 2023-07-18 Anthony Poëls , Damien Roy

Many mathematical imaging problems are posed as non-convex optimization problems. When numerically tractable global optimization procedures are not available, one is often interested in testing ex post facto whether or not a locally…

Signal Processing · Electrical Eng. & Systems 2020-07-13 Joel W. LeBlanc , Brian J. Thelen , Alfred O. Hero

Hyperparameter optimization can be formulated as a bilevel optimization problem, where the optimal parameters on the training set depend on the hyperparameters. We aim to adapt regularization hyperparameters for neural networks by fitting…

Machine Learning · Computer Science 2019-03-08 Matthew MacKay , Paul Vicol , Jon Lorraine , David Duvenaud , Roger Grosse

We study the maximum likelihood model in emission tomography and propose a new family of algorithms for its solution, called String-Averaging Expectation-Maximization (SAEM). In the String-Averaging algorithmic regime, the index set of all…

Medical Physics · Physics 2019-04-03 E. S. Helou , Y. Censor , T. -B. Chen , I-L. Chern , Á. R. De Pierro , M. Jiang , H. H. -S. Lu

This paper presents a model-agnostic ensemble approach for supervised learning. The proposed approach is based on a parametric version of Random Subspace, in which each base model is learned from a feature subset sampled according to a…

Machine Learning · Computer Science 2023-01-23 Vân Anh Huynh-Thu , Pierre Geurts

Set packing is a fundamental problem that generalises some well-known combinatorial optimization problems and knows a lot of applications. It is equivalent to hypergraph matching and it is strongly related to the maximum independent set…

Combinatorics · Mathematics 2015-07-28 Tim Oosterwijk

Ranking entities such as algorithms, devices, methods, or models based on their performances, while accounting for application-specific preferences, is a challenge. To address this challenge, we establish the foundations of a universal…

Machine Learning · Computer Science 2026-03-25 Sébastien Piérard , Anaïs Halin , Anthony Cioppa , Adrien Deliège , Marc Van Droogenbroeck

The alignment of biological networks has the potential to teach us as much about biology and disease as has sequence alignment. Sequence alignment can be optimally solved in polynomial time. In contrast, network alignment is $NP$-hard,…

Molecular Networks · Quantitative Biology 2016-07-12 Nil Mamano , Wayne Hayes

Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that the hyperparameter…

Machine Learning · Computer Science 2020-06-17 Dami Choi , Christopher J. Shallue , Zachary Nado , Jaehoon Lee , Chris J. Maddison , George E. Dahl

The area of parameterized approximation seeks to combine approximation and parameterized algorithms to obtain, e.g., (1+eps)-approximations in f(k,eps)n^{O(1)} time where k is some parameter of the input. We obtain the following results on…

Data Structures and Algorithms · Computer Science 2019-06-27 Fabrizio Grandoni , Stefan Kratsch , Andreas Wiese

Inference-time computation offers a powerful axis for scaling the performance of language models. However, naively increasing computation in techniques like Best-of-N sampling can lead to performance degradation due to reward hacking.…

Artificial Intelligence · Computer Science 2025-04-09 Audrey Huang , Adam Block , Qinghua Liu , Nan Jiang , Akshay Krishnamurthy , Dylan J. Foster