English
Related papers

Related papers: Alternating Minimization for Regression with Tropi…

200 papers

This paper proposes a unique optimization approach for estimating the minimax rational approximation and its application for evaluating matrix functions. Our method enables the extension to generalized rational approximations and has the…

Numerical Analysis · Mathematics 2025-04-03 Nir Sharon , Vinesha Peiris , Nadia Sukhorukova , Julien Ugon

We propose an $L_{2}$-based penalization algorithm for functional linear regression models, where the coefficient function is shrunk towards a data-driven shape template $\gamma$, which is constrained to belong to a class of piecewise…

Methodology · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

The adaptive Antoulas-Anderson (AAA) algorithm for rational approximation is a widely used method for the efficient construction of highly accurate rational approximations to given data. While AAA can often produce rational approximations…

Numerical Analysis · Mathematics 2026-01-28 Michael S. Ackermann , Linus Balicki , Serkan Gugercin , Steffen W. R. Werner

Recovering nonlinearly degraded signal in the presence of noise is a challenging problem. In this work, this problem is tackled by minimizing the sum of a non convex least-squares fit criterion and a penalty term. We assume that the…

Signal Processing · Electrical Eng. & Systems 2019-02-27 Marc Castella , Jean-Christophe Pesquet , Arthur Marmin

Tropical polyhedra have been recently used to represent disjunctive invariants in static analysis. To handle larger instances, tropical analogues of classical linear programming results need to be developed. This motivation leads us to…

Metric Geometry · Mathematics 2015-03-17 Stephane Gaubert , Ricardo D. Katz , Sergei Sergeev

We revisit the Universal Approximation Theorem(UAT) through the lens of the tropical geometry of neural networks and introduce a constructive, geometry-aware initialization for sigmoidal multi-layer perceptrons (MLPs). Tropical geometry…

Machine Learning · Statistics 2025-10-20 Yi-Shan Chu , Yueh-Cheng Kuo

An unconstrained optimization problem is formulated in terms of tropical mathematics to minimize a functional that is defined on a vector set by a matrix and calculated through multiplicative conjugate transposition. For some particular…

Optimization and Control · Mathematics 2015-01-30 Nikolai Krivulin

This paper presents new variants of the averaged alternating modified reflections (AAMR) method for the best approximation problem. Under a mild constraint qualification, we first show its weak convergence and then establish a convergence…

Optimization and Control · Mathematics 2016-09-06 Shin-ya Matsushita

We consider the problem of solving mixed random linear equations with $k$ components. This is the noiseless setting of mixed linear regression. The goal is to estimate multiple linear models from mixed samples in the case where the labels…

Machine Learning · Computer Science 2016-08-23 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

A new multidimensional optimization problem is considered in the tropical mathematics setting. The problem is to minimize a nonlinear function defined on a finite-dimensional semimodule over an idempotent semifield and given by a conjugate…

Optimization and Control · Mathematics 2013-11-12 Nikolai Krivulin

This paper introduces scalable, sampling-based algorithms that optimize trained neural networks with ReLU activations. We first propose an iterative algorithm that takes advantage of the piecewise linear structure of ReLU neural networks…

Optimization and Control · Mathematics 2022-06-07 Georgia Perakis , Asterios Tsiourvas

We consider decision problems of rating alternatives based on their pairwise comparisons according to two criteria. Given pairwise comparison matrices for each criterion, the problem is to find the overall scores of the alternatives. We…

Optimization and Control · Mathematics 2019-04-02 Nikolai Krivulin

In this paper we give an elementary proof of the Fundamental Theorem of Algebra for polynomials over the rational tropical semi-ring. We prove that, tropically, the rational numbers are algebraically closed. We provide a simple algorithm…

Combinatorics · Mathematics 2007-07-18 Nathan Grigg , Nathan Manwaring

To avoid specification of the error distribution in a regression model, we propose a general nonparametric scale mixture model for the error distribution. For fitting such mixtures, the predictive recursion method is a simple and…

Methodology · Statistics 2015-09-03 Ryan Martin , Zhen Han

Feasibility pumps are highly effective primal heuristics for mixed-integer linear and nonlinear optimization. However, despite their success in practice there are only few works considering their theoretical properties. We show that…

Optimization and Control · Mathematics 2017-08-01 Björn Geißler , Antonio Morsi , Lars Schewe , Martin Schmidt

Oblique decision trees combine the transparency of trees with the power of multivariate decision boundaries, but learning high-quality oblique splits is NP-hard, and practical methods still rely on slow search or theory-free heuristics. We…

Machine Learning · Computer Science 2026-05-01 Hongyi Li , Han Lin , Jun Xu

Standard reward models typically predict scalar scores that fail to capture the multifaceted nature of response quality in non-verifiable domains, such as creative writing or open-ended instruction following. To address this limitation, we…

Computation and Language · Computer Science 2026-02-13 Ran Xu , Tianci Liu , Zihan Dong , Tony Yu , Ilgee Hong , Carl Yang , Linjun Zhang , Tao Zhao , Haoyu Wang

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

Machine Learning · Statistics 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of $f$-divergences. In…

Information Theory · Computer Science 2025-09-11 Giuseppe Serra , Photios A. Stavrou , Marios Kountouris

Matrix Factorization (MF) has found numerous applications in Machine Learning and Data Mining, including collaborative filtering recommendation systems, dimensionality reduction, data visualization, and community detection. Motivated by the…

Machine Learning · Computer Science 2023-09-26 Ioannis Kordonis , Emmanouil Theodosis , George Retsinas , Petros Maragos