English
Related papers

Related papers: Numerical stability and tensor nuclear norm

200 papers

We propose a new numerical algorithm for computing the tensor rank decomposition or canonical polyadic decomposition of higher-order tensors subject to a rank and genericity constraint. Reformulating this computational problem as a system…

Numerical Analysis · Mathematics 2024-07-02 Simon Telen , Nick Vannieuwenhoven

We introduce two algorithms for computing tight guarantees on the probabilistic robustness of Bayesian Neural Networks (BNNs). Computing robustness guarantees for BNNs is a significantly more challenging task than verifying the robustness…

Machine Learning · Computer Science 2024-03-01 Ben Batten , Mehran Hosseini , Alessio Lomuscio

Many iterative algorithms in optimization, computational geometry, computer algebra, and other areas of computer science require repeated computation of some algebraic expression whose input changes slightly from one iteration to the next.…

Computational Complexity · Computer Science 2024-01-24 Emile Anand , Jan van den Brand , Mehrdad Ghadiri , Daniel Zhang

We study the problem of certifying the robustness of Bayesian neural networks (BNNs) to adversarial input perturbations. Given a compact set of input points $T \subseteq \mathbb{R}^m$ and a set of output points $S \subseteq \mathbb{R}^n$,…

Machine Learning · Computer Science 2023-06-26 Matthew Wicker , Andrea Patane , Luca Laurenti , Marta Kwiatkowska

This paper is a continuation of a recent work on a new norm, christened the $ (\alpha, \beta)$-norm, on the space of bounded linear operators on a Hilbert space. We obtain some upper bounds for the said norm of $n\times n$ operator…

Functional Analysis · Mathematics 2024-08-14 P. Bhunia , A. Bhanja , D. Sain , K. Paul

Many problems can be formulated as recovering a low-rank tensor. Although an increasingly common task, tensor recovery remains a challenging problem because of the delicacy associated with the decomposition of higher order tensors. To…

Machine Learning · Statistics 2014-05-09 Ming Yuan , Cun-Hui Zhang

This paper develops a new approach to the estimation of the degree of boundedness or stability of multidimensional nonlinear systems with time-dependent nonperiodic coefficients-an essential task in various engineering and natural science…

Dynamical Systems · Mathematics 2022-06-16 Mark A. Pinsky

Stability and boundedness analysis for vector nonlinear systems with variable delays and coefficients remains challenging due to the conservatism of existing methods. Moreover, estimates of the transient behavior of solution norms remain…

Dynamical Systems · Mathematics 2026-01-13 Mark A. Pinsky

In this paper we show that simple semidefinite programs inspired by degree $4$ SOS can exactly solve the tensor nuclear norm, tensor decomposition, and tensor completion problems on tensors with random asymmetric components. More precisely,…

Data Structures and Algorithms · Computer Science 2021-10-29 Bohdan Kivva , Aaron Potechin

The min-cost matching problem suffers from being very sensitive to small changes of the input. Even in a simple setting, e.g., when the costs come from the metric on the line, adding two nodes to the input might change the optimal solution…

Discrete Mathematics · Computer Science 2019-04-30 Jannik Matuschke , Ulrike Schmidt-Kraepelin , José Verschae

Deep learning (DL) has had unprecedented success and is now entering scientific computing with full force. However, current DL methods typically suffer from instability, even when universal approximation properties guarantee the existence…

Machine Learning · Computer Science 2022-04-04 Matthew J. Colbrook , Vegard Antun , Anders C. Hansen

Inverse linear programming (LP) has received increasing attention due to its potential to generate efficient optimization formulations that can closely replicate the behavior of a complex system. However, inversely inferred parameters and…

Optimization and Control · Mathematics 2022-02-22 Zahed Shahmoradi , Taewoo Lee

Clustering under most popular objective functions is NP-hard, even to approximate well, and so unlikely to be efficiently solvable in the worst case. Recently, Bilu and Linial \cite{Bilu09} suggested an approach aimed at bypassing this…

Data Structures and Algorithms · Computer Science 2011-08-12 Pranjal Awasthi , Avrim Blum , Or Sheffet

We show that there exists no algorithm that decides for any bilinear system $(B,v)$ if the growth rate of $(B,v)$ is $1$. This answers a question of Bui who showed that if the coefficients are positive the growth rate is computable (i.e.,…

Discrete Mathematics · Computer Science 2022-01-20 Matthieu Rosenfeld

The class $(r,2)$-CSP, or simply Max 2-CSP, consists of constraint satisfaction problems with at most two $r$-valued variables per clause. For instances with $n$ variables and $m$ binary clauses, we present an $O(n r^{5+19m/100})$-time…

Discrete Mathematics · Computer Science 2008-03-26 Alexander D. Scott , Gregory B. Sorkin

Long-period circumbinary planets appear to be as common as those orbiting single stars and have been found to frequently have orbital radii just beyond the critical distance for dynamical stability. Assessing the stability is typically done…

Earth and Planetary Astrophysics · Physics 2018-02-12 Christopher Lam , David Kipping

Linear systems with a tensor product structure arise naturally when considering the discretization of Laplace type differential equations or, more generally, multidimensional operators with separable coefficients. In this work, we focus on…

Numerical Analysis · Mathematics 2023-11-03 Stefano Massei , Leonardo Robol

Finding the rank of a tensor is a problem that has many applications. Unfortunately it is often very difficult to determine the rank of a given tensor. Inspired by the heuristics of convex relaxation, we consider the nuclear norm instead of…

Optimization and Control · Mathematics 2014-04-23 Harm Derksen

We examine the stability of loss-minimizing training processes that are used for deep neural networks (DNN) and other classifiers. While a classifier is optimized during training through a so-called loss function, the performance of…

Analysis of PDEs · Mathematics 2020-10-05 Leonid Berlyand , Pierre-Emmanuel Jabin , C. Alex Safsten

A well studied problem in algebraic complexity theory is the determination of the complexity of problems relying on evaluations of bilinear maps. One measure of the complexity of a bilinear map (or 3-tensor) is the optimal number of…

Information Theory · Computer Science 2021-03-23 Eimear Byrne , Giuseppe Cotardo