English
Related papers

Related papers: Alternating Minimization for Regression with Tropi…

200 papers

We consider a binary classifier defined as the sign of a tropical rational function, that is, as the difference of two convex piecewise linear functions. The parameter space of ReLU neural networks is contained as a semialgebraic set inside…

Combinatorics · Mathematics 2024-03-19 Marie-Charlotte Brandenburg , Georg Loho , Guido Montúfar

We present a new algorithm to generate minimal, stable, and symbolic corrections to an input that will cause a neural network with ReLU activations to change its output. We argue that such a correction is a useful way to provide feedback to…

Machine Learning · Computer Science 2018-09-03 Xin Zhang , Armando Solar-Lezama , Rishabh Singh

We present a new active learning algorithm based on nonparametric estimators of the regression function. Our investigation provides probabilistic bounds for the rates of convergence of the generalization error achievable by proposed method…

Statistics Theory · Mathematics 2011-11-03 Stanislav Minsker

We introduce a simple, easy to implement, and computationally efficient tropical convolutional neural network architecture that is robust against adversarial attacks. We exploit the tropical nature of piece-wise linear neural networks by…

Machine Learning · Computer Science 2024-02-02 Kurt Pasque , Christopher Teska , Ruriko Yoshida , Keiji Miura , Jefferson Huang

We apply methods of tropical optimization to handle problems of rating alternatives on the basis of the log-Chebyshev approximation of pairwise comparison matrices. We derive a direct solution in a closed form, and investigate the obtained…

Optimization and Control · Mathematics 2017-08-15 Nikolai Krivulin

Alternating minimization heuristics seek to solve a (difficult) global optimization task through iteratively solving a sequence of (much easier) local optimization tasks on different parts (or blocks) of the input parameters. While popular…

Computational Complexity · Computer Science 2020-03-10 Peter Bürgisser , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

Optimization problems are considered in the framework of tropical algebra to minimize and maximize a nonlinear objective function defined on vectors over an idempotent semifield, and calculated using multiplicative conjugate transposition.…

Optimization and Control · Mathematics 2017-06-05 Nikolai Krivulin

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

We show that finding the classical bound of broad families of Bell inequalities can be naturally framed as the contraction of an associated tensor network, but in tropical algebra, where the sum is replaced by the minimum and the product is…

Quantum Physics · Physics 2026-02-13 Mengyao Hu , Jordi Tura

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi

We examine a multidimensional optimisation problem in the tropical mathematics setting. The problem involves the minimisation of a nonlinear function defined on a finite-dimensional semimodule over an idempotent semifield subject to linear…

Optimization and Control · Mathematics 2015-03-16 Nikolai Krivulin

In this paper we develop a combinatorial abstraction of tropical linear programming. This generalizes the search for a feasible point of a system of min-plus-inequalities. It is based on the polyhedral properties of triangulations of the…

Optimization and Control · Mathematics 2017-12-05 Georg Loho

Function approximation is a powerful approach for structuring large decision problems that has facilitated great achievements in the areas of reinforcement learning and game playing. Regression counterfactual regret minimization (RCFR) is a…

Artificial Intelligence · Computer Science 2020-05-04 Ryan D'Orazio , Dustin Morrill , James R. Wright , Michael Bowling

We apply methods and techniques of tropical optimization to develop a new theoretical and computational framework for the implementation of the Analytic Hierarchy Process in multi-criteria problems of rating alternatives from pairwise…

Optimization and Control · Mathematics 2018-02-01 N. Krivulin , S. Sergeev

In this work, we examine the process of Tropical Polynomial Division, a geometric method which seeks to emulate the division of regular polynomials, when applied to those of the max-plus semiring. This is done via the approximation of the…

Machine Learning · Computer Science 2019-12-02 Georgios Smyrnis , Petros Maragos

Adapters are widely popular parameter-efficient transfer learning approaches in natural language processing that insert trainable modules in between layers of a pre-trained language model. Apart from several heuristics, however, there has…

Computation and Language · Computer Science 2023-10-31 Rishabh Bhardwaj , Tushar Vaidya , Soujanya Poria

The approximation of tensors is important for the efficient numerical treatment of high dimensional problems, but it remains an extremely challenging task. One of the most popular approach to tensor approximation is the alternating least…

Numerical Analysis · Mathematics 2015-06-02 Mike Espig , Wolfgang Hackbusch , Aram Khachatryan

In this note, we propose a novel technique to reduce the algorithmic complexity of neural network training by using matrices of tropical real numbers instead of matrices of real numbers. Since the tropical arithmetics replaces…

Computational Complexity · Computer Science 2021-01-05 Ozgur Ceyhan

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We contribute to a better understanding of the class of functions that can be represented by a neural network with ReLU activations and a given architecture. Using techniques from mixed-integer optimization, polyhedral theory, and tropical…

Machine Learning · Computer Science 2024-07-18 Christoph Hertrich , Amitabh Basu , Marco Di Summa , Martin Skutella