English
Related papers

Related papers: Tractability from overparametrization: The example…

200 papers

We take a different look at the problem of testing the independence of two metric-space-valued random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the…

Statistics Theory · Mathematics 2025-11-19 Holger Dette , Marius Kroll

We study the l^{p_1,...,p_m} singular value problem for non-negative tensors. We prove a general Perron-Frobenius theorem for weakly irreducible and irreducible nonnegative tensors and provide a Collatz-Wielandt characterization of the…

Spectral Theory · Mathematics 2015-03-05 Antoine Gautier , Matthias Hein

The majority of existing probabilistic model checking case studies are based on well understood theoretical models and distributions. However, real-life probabilistic systems usually involve distribution parameters whose values are obtained…

Software Engineering · Computer Science 2013-08-29 Guoxin Su , David S. Rosenblum

We leverage the connections between nonexpansive maps, monotone Lipschitz operators, and proximal mappings to obtain near-optimal (i.e., optimal up to poly-log factors in terms of iteration complexity) and parameter-free methods for solving…

Optimization and Control · Mathematics 2020-04-14 Jelena Diakonikolas

For $2\leq p<\infty$, $\alpha'>2/p$, and $\delta>0$, we construct Cantor-type measures on $\mathbb{R}$ supported on sets of Hausdorff dimension $\alpha<\alpha'$ for which the associated maximal operator is bounded from $L^p_\delta…

Classical Analysis and ODEs · Mathematics 2018-09-11 Izabella Laba

Large optimal transport problems can be approached via domain decomposition, i.e. by iteratively solving small partial problems independently and in parallel. Convergence to the global minimizers under suitable assumptions has been shown in…

Optimization and Control · Mathematics 2021-06-16 Mauro Bonafini , Ismael Medina , Bernhard Schmitzer

The article proposes an n-dimensional mathematical model of the visual representation of a linear programming problem. This model makes it possible to use artificial neural networks to solve multidimensional linear optimization problems,…

Optimization and Control · Mathematics 2022-08-18 Nikolay A. Olkhovsky , Leonid B. Sokolinsky

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

Identification of input data points relevant for the classifier (i.e. serve as the support vector) has recently spurred the interest of researchers for both interpretability as well as dataset debugging. This paper presents an in-depth…

Machine Learning · Computer Science 2020-09-30 Dominique Mercier , Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

The trapping redundancy of a linear code is the number of rows of a smallest parity-check matrix such that no submatrix forms an $(a,b)$-trapping set. This concept was first introduced in the context of low-density parity-check (LDPC) codes…

Information Theory · Computer Science 2016-11-15 Yu Tsunoda , Yuichiro Fujiwara

We consider the problem of performing linear regression over a stream of $d$-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without…

Machine Learning · Computer Science 2020-10-13 Vatsal Sharan , Aaron Sidford , Gregory Valiant

We deal with countable alphabet locally compact random subshifts of finite type (the latter merely meaning that the symbol space is generated by an incidence matrix) under the absence of Big Images Property and under the absence of uniform…

Dynamical Systems · Mathematics 2015-09-02 Volker Mayer , Mariusz Urbanski

In this paper, we address the problem of how many randomly labeled patterns can be correctly classified by a single-layer perceptron when the patterns are correlated with each other. In order to solve this problem, two analytical schemes…

Disordered Systems and Neural Networks · Physics 2016-12-15 Takashi Shinzato , Yoshiyuki Kabashima

Deep Neural Networks miss a principled model of their operation. A novel framework for supervised learning based on Topological Quantum Field Theory that looks particularly well suited for implementation on quantum processors has been…

Today's deep neural networks require substantial computation resources for their training, storage, and inference, which limits their effective use on resource-constrained devices. Many recent research activities explore different options…

Machine Learning · Computer Science 2020-04-21 Rahim Entezari , Olga Saukh

We propose Rademacher complexity bounds for multiclass classifiers trained with a two-step semi-supervised model. In the first step, the algorithm partitions the partially labeled data and then identifies dense clusters containing $\kappa$…

Machine Learning · Statistics 2021-09-15 Yury Maximov , Massih-Reza Amini , Zaid Harchaoui

Several variants of the Constraint Satisfaction Problem have been proposed and investigated in the literature for modelling those scenarios where solutions are associated with some given costs. Within these frameworks computing an optimal…

Artificial Intelligence · Computer Science 2012-09-18 Georg Gottlob , Gianluigi Greco , Francesco Scarcello

We prove the first nontrivial worst-case lower bounds for two closely related problems. First, $\Omega(n^{3/2})$ degree-1 reductions, series-parallel reductions, and $\Delta$Y transformations are required in the worst case to reduce an…

Computational Geometry · Computer Science 2015-10-05 Hsien-Chih Chang , Jeff Erickson

We propose a nonparametric quantile regression method using deep neural networks with a rectified linear unit penalty function to avoid quantile crossing. This penalty function is computationally feasible for enforcing non-crossing…

Machine Learning · Statistics 2022-10-20 Wenlu Tang , Guohao Shen , Yuanyuan Lin , Jian Huang

Marton's optimal error exponent for the lossy source coding problem is defined as a non-convex optimization problem. This fact had prevented us to develop an efficient algorithm to compute it. This problem is caused by the fact that the…

Information Theory · Computer Science 2024-09-13 Yutaka Jitsumatsu