English
Related papers

Related papers: Faster Stochastic Trace Estimation with a Chebyshe…

200 papers

Many applications, including rank aggregation and crowd-labeling, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and columns. We consider the problem of estimating such a matrix based on…

Machine Learning · Statistics 2018-06-06 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

We consider the task of approximating a matrix function $f(A)$, where $A$ is a matrix in which only a relatively small number of (not necessarily consecutive) sub- and superdiagonals contain nonzero entries. Approximating $f$ by a…

Numerical Analysis · Mathematics 2025-12-09 Majed Hamadi , Nezam Mahdavi-Amiri , Marcel Schweitzer

We propose a higher-order dimensionality reduction framework based on the Trace Ratio (TR) optimization problem. We establish conditions for existence and uniqueness of solutions and clarify the theoretical connection between the Trace…

Numerical Analysis · Mathematics 2025-11-25 Alaeddine Zahir , Franck Dufrenois , Khalide Jbilou , Ahmed Ratnani

Polynomial regression is widely used and can help to express nonlinear patterns. However, considering very high polynomial orders may lead to overfitting and poor extrapolation ability for unseen data. The paper presents a method for…

Machine Learning · Computer Science 2023-08-01 Andrei Ivanov , Stefan Maria Ailuro

Parametric Markov chains occur quite naturally in various applications: they can be used for a conservative analysis of probabilistic systems (no matter how the parameter is chosen, the system works to specification); they can be used to…

Logic in Computer Science · Computer Science 2018-11-05 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

In this paper, we study convex optimization methods for computing the trace norm regularized least squares estimate in multivariate linear regression. The so-called factor estimation and selection (FES) method, recently proposed by Yuan et…

Methodology · Statistics 2009-04-07 Zhaosong Lu , Renato D. C. Monteiro , Ming Yuan

Continuous-time trajectory estimation is an attractive alternative to discrete-time batch estimation due to the ability to incorporate high-frequency measurements from asynchronous sensors while keeping the number of optimization parameters…

Robotics · Computer Science 2024-02-02 Jacob Johnson , Joshua Mangelson , Timothy Barfoot , Randal Beard

This paper is devoted to parameter estimation for partially observed polynomial state space models. This class includes discretely observed affine or more generally polynomial Markov processes. The polynomial structure allows for the…

Statistics Theory · Mathematics 2025-07-11 Jan Kallsen , Ivo Richert

Nesterov's well-known scheme for accelerating gradient descent in convex optimization problems is adapted to accelerating stationary iterative solvers for linear systems. Compared with classical Krylov subspace acceleration methods, the…

Optimization and Control · Mathematics 2021-08-10 Tao Hong , Irad Yavneh

Discrete statistical models supported on labelled event trees can be specified using so-called interpolating polynomials which are generalizations of generating functions. These admit a nested representation. A new algorithm exploits the…

Statistics Theory · Mathematics 2017-05-29 Christiane Görgen , Anna Bigatti , Eva Riccomagno , Jim Q. Smith

Predictability of behavior has emerged an an important characteristic in many fields including biology, medicine, and marketing. Behavior can be recorded as a sequence of actions performed by an individual over a given time period. This…

Methodology · Statistics 2017-11-13 Brian Vegetabile , Jenny Molet , Tallie Z. Baram , Hal Stern

We study the problem of estimating the diagonal of an implicitly given matrix $A$. For such a matrix we have access to an oracle that allows us to evaluate the matrix vector product $Av$. For random variable $v$ drawn from an appropriate…

Data Structures and Algorithms · Computer Science 2022-01-27 Robert A. Baston , Yuji Nakatsukasa

We consider rank-one non-symmetric tensor estimation and derive simple formulas for the mutual information. We start by the order 2 problem, namely matrix factorization. We treat it completely in a simpler fashion than previous proofs using…

Information Theory · Computer Science 2018-11-28 Jean Barbier , Nicolas Macris , Léo Miolane

This is a brief tutorial on the least square estimation technique that is straightforward yet effective for parameter estimation. The tutorial is focused on the linear LSEs instead of nonlinear versions, since most nonlinear LSEs can be…

Systems and Control · Electrical Eng. & Systems 2022-11-29 Qingrui Zhang

RNA-Seq technology offers new high-throughput ways for transcript identification and quantification based on short reads, and has recently attracted great interest. The problem is usually modeled by a weighted splicing graph whose nodes…

Quantitative Methods · Quantitative Biology 2013-08-02 Alexandru I. Tomescu , Anna Kuosmanen , Romeo Rizzi , Veli Mäkinen

Various forms of regularization in learning tasks strive for different notions of simplicity. This paper presents a spectral regularization technique, which attaches a unique inductive bias to sequence modeling based on an intuitive concept…

Machine Learning · Computer Science 2022-11-07 Kaiwen Hou , Guillaume Rabusseau

Despite the popularity of Shapley Values in explaining neural text classification models, computing them is prohibitive for large pretrained models due to a large number of model evaluations. In practice, Shapley Values are often estimated…

Computation and Language · Computer Science 2023-06-01 Chenghao Yang , Fan Yin , He He , Kai-Wei Chang , Xiaofei Ma , Bing Xiang

Chebyshev varieties are algebraic varieties parametrized by Chebyshev polynomials or their multivariate generalizations. We determine the dimension, degree, singular locus and defining equations of these varieties. We explain how they play…

Algebraic Geometry · Mathematics 2024-01-23 Zaïneb Bel-Afia , Chiara Meroni , Simon Telen

We survey and unify recent results on the existence of accurate algorithms for evaluating multivariate polynomials, and more generally for accurate numerical linear algebra with structured matrices. By "accurate" we mean that the computed…

Numerical Analysis · Mathematics 2008-05-21 James Demmel , Ioana Dumitriu , Olga Holtz , Plamen Koev

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr