English
Related papers

Related papers: Sharpening Occam's Razor

200 papers

We prove a complexity dichotomy theorem for Holant Problems on 3-regular graphs with an arbitrary complex-valued edge function. Three new techniques are introduced: (1) higher dimensional iterations in interpolation; (2) Eigenvalue Shifted…

Computational Complexity · Computer Science 2011-08-09 Michael Kowalczyk , Jin-Yi Cai

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

We propose a general algorithm of constructing an extended formulation for any given set of linear constraints with integer coefficients. Our algorithm consists of two phases: first construct a decision diagram $(V,E)$ that somehow…

Data Structures and Algorithms · Computer Science 2023-09-07 Yuta Kurokawa , Ryotaro Mitsuboshi , Haruki Hamasaki , Kohei Hatano , Eiji Takimoto , Holakou Rahmanian

We consider the sensitivity of real roots of polynomial systems with respect to perturbations of the coefficients. In particular - for a version of the condition number defined by Cucker, Krick, Malajovich, and Wschebor - we establish new…

Probability · Mathematics 2018-06-11 Alperen A. Ergür , J. Maurice Rojas , Grigoris Paouris

We propose a simple O([n^5/\log n]L) algorithm for linear programming feasibility, that can be considered as a polynomial-time implementation of the relaxation method. Our work draws from Chubanov's "Divide-and-Conquer" algorithm [4], where…

Optimization and Control · Mathematics 2013-12-09 László A. Végh , Giacomo Zambelli

We solve principal component regression (PCR), up to a multiplicative accuracy $1+\gamma$, by reducing the problem to $\tilde{O}(\gamma^{-1})$ black-box calls of ridge regression. Therefore, our algorithm does not require any explicit…

Machine Learning · Statistics 2017-04-26 Zeyuan Allen-Zhu , Yuanzhi Li

We derive oracle inequalities for the problems of isotonic and convex regression using the combination of $Q$-aggregation procedure and sparsity pattern aggregation. This improves upon the previous results including the oracle inequalities…

Statistics Theory · Mathematics 2015-10-01 Pierre C. Bellec , Alexandre B. Tsybakov

We provide simple criteria and algorithms for expressing homogeneous polynomials as sums of powers of independent linear forms, or equivalently, for decomposing symmetric tensors into sums of rank-1 symmetric tensors of linearly independent…

Rings and Algebras · Mathematics 2021-10-08 Hua-Lin Huang , Huajun Lu , Yu Ye , Chi Zhang

We present a comprehensive analysis of an algorithm for evaluating high-dimensional polynomials that are invariant under permutations and rotations. The key bottleneck is the contraction of a high-dimensional symmetric and sparse tensor…

Numerical Analysis · Mathematics 2022-02-10 Illia Kaliuzhnyi , Christoph Ortner

Effective features can improve the performance of a model, which can thus help us understand the characteristics and underlying structure of complex data. Previous feature selection methods usually cannot keep more local structure…

Machine Learning · Computer Science 2019-10-10 Xia Wu , Xueyuan Xu , Jianhong Liu , Hailing Wang , Bin Hu , Feiping Nie

Offset Rademacher complexities have been shown to provide tight upper bounds for the square loss in a broad class of problems including improper statistical learning and online learning. We show that the offset complexity can be generalized…

Machine Learning · Statistics 2021-10-27 Suhas Vijaykumar

We study reduction schemes for functions of "many" variables into system of functions in one variable. Our setting includes infinite-dimensions. Following Cybenko-Kolmogorov, the outline for our results is as follows: We present explicit…

Functional Analysis · Mathematics 2019-03-08 Palle Jorgensen , Feng Tian

Recently, there has been a surge of interest for quantum computation for its ability to exponentially speed up algorithms, including machine learning algorithms. However, Tang suggested that the exponential speed up can also be done on a…

Discrete Mathematics · Computer Science 2020-12-03 Daniel Chen , Yekun Xu , Betis Baheri , Samuel A. Stein , Chuan Bi , Ying Mao , Qiang Quan , Shuai Xu

The regular expression matching problem asks whether a given regular expression of length $m$ matches a given string of length $n$. As is well known, the problem can be solved in $O(nm)$ time using Thompson's algorithm. Moreover, recent…

Computational Complexity · Computer Science 2026-04-03 Taisei Nogami , Yoshiki Nakamura , Tachio Terauchi

New sequences of orthogonal polynomials with ultra-exponential weight functions are discovered. In particular, it gives an explicit solution to the Ditkin-Prudnikov problem (1966). The 3-term recurrence relations, explicit representations,…

Classical Analysis and ODEs · Mathematics 2019-12-05 Semyon Yakubovich

Counting distinct permutations with replacement, especially when involving multiple subwords, is a longstanding challenge in combinatorial analysis, with critical applications in cryptography, bioinformatics, and statistical modeling. This…

Cryptography and Security · Computer Science 2024-11-27 Martin Mathew , Javier Noda

In this paper, we consider an extension of Jacobi's symbol, the so called rational $2^k$-th power residue symbol. In Section 3, we prove a novel generalization of Zolotarev's lemma. In Sections 4, 5 and 6, we show that several hard…

Number Theory · Mathematics 2017-09-20 Markus Hittmeir

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

We develop a new framework to compute the exact correlators of characteristic polynomials, and their inverses, in random matrix theory. Our results hold for general potentials and incorporate the effects of an external source. In matrix…

High Energy Physics - Theory · Physics 2021-11-04 Taro Kimura , Edward A. Mazenc

Various control schemes rely on a solution of a convex optimization problem involving a particular robust quadratic constraint, which can be reformulated as a linear matrix inequality using the well-known $\mathcal{S}$-lemma. However, the…

Optimization and Control · Mathematics 2020-12-10 Goran Banjac , Jianzhe Zhen , Dick den Hertog , John Lygeros