English
Related papers

Related papers: Linear Systems can be Hard to Learn

200 papers

We provide a computational complexity lens to understand the power of machine learning models, particularly their ability to model complex systems. Machine learning models are often trained on data drawn from sampleable or more complex…

Machine Learning · Computer Science 2026-04-09 Lance Fortnow

Interpretable classifiers have recently witnessed an increase in attention from the data mining community because they are inherently easier to understand and explain than their more complex counterparts. Examples of interpretable…

Machine Learning · Computer Science 2019-11-01 Hugo M. Proença , Matthijs van Leeuwen

This paper considers the problem of closed-loop identification of linear scalar systems with Gaussian process noise, where the system input is determined by a deterministic state feedback policy. The regularized least-square estimate (LSE)…

Systems and Control · Electrical Eng. & Systems 2020-03-30 Ali Reza Pedram , Takashi Tanaka

We extend the learning from demonstration paradigm by providing a method for learning unknown constraints shared across tasks, using demonstrations of the tasks, their cost functions, and knowledge of the system dynamics and control…

Robotics · Computer Science 2019-02-22 Glen Chou , Dmitry Berenson , Necmiye Ozay

Statistical linearization has recently seen a particular surge of interest as a numerically cheap method for robust control of stochastic differential equations. Although it has already been successfully applied to control complex…

Optimization and Control · Mathematics 2023-07-06 Riccardo Bonalli , Clara Leparoux , Bruno Hérissé , Frédéric Jean

Control synthesis under constraints is at the forefront of research on autonomous systems, in part due to its broad application from low-level control to high-level planning, where computing control inputs is typically cast as a constrained…

Optimization and Control · Mathematics 2026-03-23 Panagiotis Rousseas , Haejoon Lee , Dimos V. Dimarogonas , Dimitra Panagou

This article addresses the following problems: 1) First, a nonlinearity analysis is made looking for the presence of nonlinearities in an early phase of the identification process. The level and the nature of the nonlinearities should be…

Systems and Control · Computer Science 2018-04-26 Johan Schoukens , Mark Vaes , Rik Pintelon

This paper proposes basic definitions of similarity and similarity indexes between heterogeneous linear systems and presents a similarity-based learning control strategy. By exploring geometric properties of admissible behaviors of linear…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Chenchao Wang , Deyuan Meng

Positive linear systems on arbitrary time scales are studied. The theory developed in the paper unifies and extends concepts and results known for continuous-time and discrete-time systems. A necessary and sufficient condition for a linear…

Optimization and Control · Mathematics 2012-04-17 Zbigniew Bartosiewicz

We investigate the complexity of logistic regression models which is defined by counting the number of indistinguishable distributions that the model can represent (Balasubramanian, 1997). We find that the complexity of logistic models with…

Machine Learning · Statistics 2019-03-04 Nicola Bulso , Matteo Marsili , Yasser Roudi

This paper addresses the end-to-end sample complexity bound for learning in closed loop the state estimator-based robust H2 controller for an unknown (possibly unstable) Linear Time Invariant (LTI) system, when given a fixed state-feedback…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Yifei Zhang , Sourav Kumar Ukil , Andrei Sperila , Serban Sabau

Domain knowledge can often be encoded in the structure of a network, such as convolutional layers for vision, which has been shown to increase generalization and decrease sample complexity, or the number of samples required for successful…

Artificial Intelligence · Computer Science 2017-07-14 Marc Pickett , Ayush Sekhari , James Davidson

A joint characterisation of the controllability and observability of a particular kind of discrete system has been developed. The key idea of the procedure can be reduced to a correct choice of the sampling sequence. This freedom, owing to…

Dynamical Systems · Mathematics 2010-06-14 Amparo Fúster-Sabater , J. M. Guillén

We present novel information-theoretic limits on detecting sparse changes in Ising models, a problem that arises in many applications where network changes can occur due to some external stimuli. We show that the sample complexity for…

Information Theory · Computer Science 2020-11-10 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

A fundamental challenge in learning to control an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. In this work, we formulate a mathematical definition of what it means to safely learn…

Optimization and Control · Mathematics 2020-11-25 Amir Ali Ahmadi , Abraar Chaudhry , Vikas Sindhwani , Stephen Tu

Scientists often use observational time series data to study complex natural processes, but regression analyses often assume simplistic dynamics. Recent advances in deep learning have yielded startling improvements to the performance of…

Machine Learning · Computer Science 2023-04-21 Cory Shain , William Schuler

In this paper we introduce a novel family of decision lists consisting of highly interpretable models which can be learned efficiently in a greedy manner. The defining property is that all rules are oriented in the same direction.…

Machine Learning · Statistics 2016-01-12 Marc Goessling , Shan Kang

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are…

Machine Learning · Computer Science 2018-11-21 Jacob M. Springer , Charles S. Strauss , Austin M. Thresher , Edward Kim , Garrett T. Kenyon

This article presents an identification methodology to capture general relationships, with application to piecewise nonlinear approximations of model predictive control for constrained (non)linear systems. The mathematical formulation…

Optimization and Control · Mathematics 2017-01-06 Van-Vuong Trinh , Mazen Alamir , Patrick Bonnay

Statistical latent class models are widely used in social and psychological researches, yet it is often difficult to establish the identifiability of the model parameters. In this paper we consider the identifiability issue of a family of…

Methodology · Statistics 2016-03-15 Gongjun Xu