English
Related papers

Related papers: Linear Systems can be Hard to Learn

200 papers

We define the complexity of a continuous-time linear system to be the minimum number of bits required to describe its forward increments to a desired level of fidelity, and compute this quantity using the rate distortion function of a…

Systems and Control · Electrical Eng. & Systems 2023-06-06 Eric Wendel , John Baillieul , Joseph Hollmann

Generalizations of linear numeration systems in which the set of natural numbers is recognizable by finite automata are obtained by describing an arbitrary infinite regular language following the lexicographic ordering. For these systems of…

Other Computer Science · Computer Science 2007-05-23 Pierre B. A. Lecomte , Michel Rigo

Identification of nonlinear systems is a challenging problem. Physical knowledge of the system can be used in the identification process to significantly improve the predictive performance by restricting the space of possible mappings from…

Computation · Statistics 2022-10-27 Anna Wigren , Johan Wågberg , Fredrik Lindsten , Adrian Wills , Thomas B. Schön

This work explores the trade-off between the number of samples required to accurately build models of dynamical systems and the degradation of performance in various control objectives due to a coarse approximation. In particular, we show…

Optimization and Control · Mathematics 2017-12-01 Stephen Tu , Ross Boczar , Andrew Packard , Benjamin Recht

This paper considers a single-trajectory system identification problem for linear systems under general nonlinear and/or time-varying policies with i.i.d. random excitation noises. The problem is motivated by safe learning-based control for…

Optimization and Control · Mathematics 2023-06-21 Yingying Li , Tianpeng Zhang , Subhro Das , Jeff Shamma , Na Li

Real world evolves in continuous time but computations are done from finite samples. Therefore, we study algorithms using finite observations in continuous-time linear dynamical systems. We first study the system identification problem, and…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Hongyi Zhou , Jingwei Li , Jingzhao Zhang

Machine-learning technologies for learning dynamical systems from data play an important role in engineering design. This research focuses on learning continuous linear models from data. Stability, a key feature of dynamic systems, is…

Machine Learning · Computer Science 2023-01-25 Pawan Goyal , Igor Pontes Duff , Peter Benner

We consider the controllability of large-scale linear networked dynamical systems when complete knowledge of network structure is unavailable and knowledge is limited to coarse summaries. We provide conditions under which average…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Nafiseh Ghoroghchian , Rajasekhar Anguluri , Gautam Dasarathy , Stark C. Draper

We address the problem of learning linear system models from observing multiple trajectories from different system dynamics. This framework encompasses a collaborative scenario where several systems seeking to estimate their dynamics are…

Optimization and Control · Mathematics 2023-09-12 Leonardo F. Toso , Han Wang , James Anderson

Learning governing dynamics from data is a common goal across the sciences, yet it is only well-posed when the underlying mechanisms are identifiable. In practice, many data-driven methods implicitly assume identifiability; when this…

Machine Learning · Computer Science 2026-05-13 Aybüke Ulusarslan , Niki Kilbertus , Nora Schneider

This tutorial survey provides an overview of recent non-asymptotic advances in statistical learning theory as relevant to control and system identification. While there has been substantial progress across all areas of control, the theory…

Systems and Control · Electrical Eng. & Systems 2023-04-28 Anastasios Tsiamis , Ingvar Ziemann , Nikolai Matni , George J. Pappas

Dynamical systems modeling is a core pillar of scientific inquiry across natural and life sciences. Increasingly, dynamical system models are learned from data, rendering identifiability a paramount concept. For systems that are not…

Machine Learning · Computer Science 2026-05-11 Cecilia Casolo , Sören Becker , Niki Kilbertus

Complex structures are typical in machine learning. Tailoring learning algorithms for every structure requires an effort that may be saved by defining a generic learning procedure adaptive to any complex structure. In this paper, we propose…

Machine Learning · Computer Science 2019-05-28 Pablo Strasser , Stephane Armand , Stephane Marchand-Maillet , Alexandros Kalousis

Human recursive numeral systems (i.e., counting systems such as English base-10 numerals), like many other grammatical systems, are highly regular. Following prior work that relates cross-linguistic tendencies to biases in learning, we ask…

Computation and Language · Computer Science 2026-04-30 Andrea Silvi , Ponrawee Prasertsom , Jennifer Culbertson , Devdatt Dubhashi , Moa Johansson , Kenny Smith

As learning difficulty is crucial for machine learning (e.g., difficulty-based weighting learning strategies), previous literature has proposed a number of learning difficulty measures. However, no comprehensive investigation for learning…

Machine Learning · Computer Science 2022-09-20 Weiyao Zhu , Ou Wu , Fengguang Su , Yingjun Deng

A fundamental concept in control theory is that of controllability, where any system state can be reached through an appropriate choice of control inputs. Indeed, a large body of classical and modern approaches are designed for controllable…

Optimization and Control · Mathematics 2022-06-13 Yonathan Efroni , Sham Kakade , Akshay Krishnamurthy , Cyril Zhang

The main objective of this article is to develop a matrix pencil approach for the study of the controllability and reachability of a class of linear singular discrete time systems. The description equation of a practical system may be…

Optimization and Control · Mathematics 2014-06-06 Charalambos P. Kontzalis , Grigoris Kalogeropoulos

In statistical setting of the pattern recognition problem the number of examples required to approximate an unknown labelling function is linear in the VC dimension of the target learning class. In this work we consider the question whether…

Machine Learning · Computer Science 2016-06-27 Daniil Ryabko

We propose an active learning algorithm for linear system identification with optimal centered noise excitation. Notably, our algorithm, based on ordinary least squares and semidefinite programming, attains the minimal sample complexity…

Optimization and Control · Mathematics 2026-04-08 Kaito Ito , Alexandre Proutiere

System identification is a fundamental problem in reinforcement learning, control theory and signal processing, and the non-asymptotic analysis of the corresponding sample complexity is challenging and elusive, even for linear time-varying…

Machine Learning · Computer Science 2020-11-30 Sen Lin , Hang Wang , Junshan Zhang