English
Related papers

Related papers: Adapt or Die: Polynomial Lower Bounds for Non-Adap…

200 papers

An antithetical concept, adaptive symmetry, to conservative symmetry in physics is proposed to understand the deep neural networks (DNNs). It characterizes the invariance of variance, where a biotic system explores different pathways of…

Machine Learning · Computer Science 2022-01-21 Shawn W. M. Li

We consider a static data structure problem of computing a linear operator under cell-probe model. Given a linear operator $M \in \mathbb{F}_2^{m \times n}$, the goal is to pre-process a vector $X \in \mathbb{F}_2^n$ into a data structure…

Computational Complexity · Computer Science 2025-09-04 Young Kun Ko

Neural operator (NO) architectures learn nonlinear maps between infinite-dimensional function spaces and are widely used to accelerate simulation and enable data-driven model discovery. While universality results ensure expressivity, they…

Optimization and Control · Mathematics 2026-03-02 Takashi Furuya , Anastasis Kratsios

An important question in data-driven control is how to obtain an informative dataset. In this work, we consider the problem of effective data acquisition of an unknown linear system with bounded disturbance for both open-loop and…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Shilun Feng , Dawei Shi , Yang Shi , Kaikai Zheng

To date, the only way to argue polynomial lower bounds for dynamic algorithms is via fine-grained complexity arguments. These arguments rely on strong assumptions about specific problems such as the Strong Exponential Time Hypothesis (SETH)…

Computational Complexity · Computer Science 2023-07-27 Sayan Bhattacharya , Danupon Nanongkai , Thatchaphol Saranurak

This paper advances the theoretical understanding of active learning label complexity for decision trees as binary classifiers. We make two main contributions. First, we provide the first analysis of the disagreement coefficient for…

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive…

Numerical Analysis · Mathematics 2019-03-27 Yuhan Ding , Fred J. Hickernell , Peter Kritzer , Simon Mak

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

We resolve the long-standing open problem of Boolean dynamic data structure hardness, proving an unconditional lower bound of $\Omega((\log n / \log\log n)^2)$ for the Multiphase Problem of Patrascu [STOC 2010] (instantiated with Inner…

Computational Complexity · Computer Science 2026-03-30 Young Kun Ko

It is known that, for systems of initial-value problems, algorithms using adaptive information perform much better in the worst case setting than the algorithms using nonadaptive information. In the latter case, lower and upper complexity…

Numerical Analysis · Mathematics 2018-11-09 Boleslaw Kacewicz

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For…

Numerical Analysis · Mathematics 2020-08-26 Han Gao , Jian-Xun Wang , Matthew J. Zahr

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial…

Systems and Control · Electrical Eng. & Systems 2022-02-11 Robin Strässer , Julian Berberich , Frank Allgöwer

MapReduce (and its open source implementation Hadoop) has become the de facto platform for processing large data sets. MapReduce offers a streamlined computational framework by interleaving sequential and parallel computation while hiding…

Computational Complexity · Computer Science 2019-04-22 Sungjin Im , Benjamin Moseley

In this paper we present two analytical frameworks for calculating the performance of lock-free data structures. Lock-free data structures are based on retry loops and are called by application-specific routines. In contrast to previous…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Aras Atalar , Paul Renaud-Goud , Philippas Tsigas

Practitioners prune neural networks for efficiency gains and generalization improvements, but few scrutinize the factors determining the prunability of a neural network the maximum fraction of weights that pruning can remove without…

Machine Learning · Computer Science 2022-12-02 Zachary Ankner , Alex Renda , Gintare Karolina Dziugaite , Jonathan Frankle , Tian Jin

We revisit classic string problems considered in the area of parameterized complexity, and study them through the lens of dynamic data structures. That is, instead of asking for a static algorithm that solves the given instance efficiently,…

Data Structures and Algorithms · Computer Science 2022-05-03 Jędrzej Olkowski , Michał Pilipczuk , Mateusz Rychlicki , Karol Węgrzycki , Anna Zych-Pawlewicz

We formulate a framework of polynomial diagrams, which are a generalisation of power diagrams (PDs) and anisotropic power diagrams (APDs) allowing for boundaries between cells to be algebraic curves of a prescribed degree. We show that they…

Optimization and Control · Mathematics 2026-05-21 David P. Bourne , Maciej Buze , Thomas Gallouët , Quentin Mérigot

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar

The fundamental lemma from behavioral systems theory yields a data-driven non-parametric system representation that has shown great potential for the data-efficient control of unknown linear and weakly nonlinear systems, even in the…

Systems and Control · Electrical Eng. & Systems 2024-09-26 Johannes Teutsch , Sebastian Ellmaier , Sebastian Kerz , Dirk Wollherr , Marion Leibold