English
Related papers

Related papers: Joint Learning of Linear Dynamical Systems under S…

200 papers

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

Laplacian regularized stratified models (LRSM) are models that utilize the explicit or implicit network structure of the sub-problems as defined by the categorical features called strata (e.g., age, region, time, forecast horizon, etc.),…

Machine Learning · Statistics 2023-05-05 Ziheng Cheng , Junzi Zhang , Akshay Agrawal , Stephen Boyd

As one of the central tasks in machine learning, regression finds lots of applications in different fields. An existing common practice for solving regression problems is the mean square error (MSE) minimization approach or its regularized…

Machine Learning · Statistics 2022-11-24 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao , Yusen He , Yaohua Wang

Multimodal learning has been lacking principled ways of combining information from different modalities and learning a low-dimensional manifold of meaningful representations. We study multimodal learning and sensor fusion from a latent…

Machine Learning · Computer Science 2019-04-24 Lijiang Guo

We study the problem of learning a mixture model of non-parametric product distributions. The problem of learning a mixture model is that of finding the component distributions along with the mixing weights using observed samples generated…

Signal Processing · Electrical Eng. & Systems 2019-04-03 Nikos Kargas , Nicholas D. Sidiropoulos

A semi-parametric, non-linear regression model in the presence of latent variables is applied towards learning network graph structure. These latent variables can correspond to unmodeled phenomena or unmeasured agents in a complex system of…

Machine Learning · Statistics 2018-07-03 Jonathan Mei , José M. F. Moura

In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $\epsilon$) of the…

Machine Learning · Computer Science 2025-05-02 Gautam Chandrasekaran , Adam Klivans , Vasilis Kontonis , Raghu Meka , Konstantinos Stavropoulos

We give a necessary and sufficient condition, of geometric type, for the uniform decay of energy of solutions of the linear system of magnetoelasticity in a bounded domain with smooth boundary. A Dirichlet-type boundary condition is…

Analysis of PDEs · Mathematics 2007-05-23 Thomas Duyckaerts

We study the learning ability of linear recurrent neural networks with Gradient Descent. We prove the first theoretical guarantee on linear RNNs to learn any stable linear dynamic system using any a large type of loss functions. For an…

Machine Learning · Computer Science 2023-10-24 Lifu Wang , Tianyu Wang , Shengwei Yi , Bo Shen , Bo Hu , Xing Cao

A system of coupled oscillators on an arbitrary graph is locally driven by the tendency to mutual synchronization between nearby oscillators, but can and often exhibit nonlinear behavior on the whole graph. Understanding such nonlinear…

Dynamical Systems · Mathematics 2023-11-28 Agam Goyal , Zhaoxing Wu , Richard P. Yim , Binhao Chen , Zihong Xu , Hanbaek Lyu

Learning the topology of higher-order networks from data is a fundamental challenge in many signal processing and machine learning applications. Simplicial complexes provide a principled framework for modeling multi-way interactions, yet…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Varun Sarathchandran , Geert Leus

We consider the problem of learning a realization of a partially observed bilinear dynamical system (BLDS) from noisy input-output data. Given a single trajectory of input-output samples, we provide a finite time analysis for learning the…

Machine Learning · Computer Science 2025-10-23 Yahya Sattar , Yassir Jedra , Maryam Fazel , Sarah Dean

This paper studies linear stochastic approximation (SA) algorithms and their application to multi-agent systems in engineering and sociology. As main contribution, we provide necessary and sufficient conditions for convergence of linear SA…

Optimization and Control · Mathematics 2018-09-07 Ge Chen , Xiaoming Duan , Wenjun Mei , Francesco Bullo

This paper explores the observability and estimation capability of dynamical systems using predominantly relative measurements of the system's state-space variables, with minimal to no reliance on absolute measurements of these variables.…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Ioannis Raptis

Learning graphs from sets of nodal observations represents a prominent problem formally known as graph topology inference. However, current approaches are limited by typically focusing on inferring single networks, and they assume that…

Social and Information Networks · Computer Science 2021-11-17 Samuel Rey , Andrei Buciulea , Madeline Navarro , Santiago Segarra , Antonio G. Marques

This paper studies uncertainty set estimation for unknown linear systems. Uncertainty sets are crucial for the quality of robust control since they directly influence the conservativeness of the control design. Departing from the confidence…

Optimization and Control · Mathematics 2024-06-11 Yingying Li , Jing Yu , Lauren Conger , Taylan Kargin , Adam Wierman

Structure learning algorithms that learn the graph of a Bayesian network from observational data often do so by assuming the data correctly reflect the true distribution of the variables. However, this assumption does not hold in the…

Artificial Intelligence · Computer Science 2020-11-20 Yang Liu , Anthony C. Constantinou , ZhiGao Guo

We propose a neural network-based approach that computes a stable and generalizing metric (LSiM) to compare data from a variety of numerical simulation sources. We focus on scalar time-dependent 2D data that commonly arises from motion and…

Machine Learning · Computer Science 2021-01-29 Georg Kohl , Kiwon Um , Nils Thuerey

Achieving convergence of multiple learning agents in general $N$-player games is imperative for the development of safe and reliable machine learning (ML) algorithms and their application to autonomous systems. Yet it is known that, outside…

Computer Science and Game Theory · Computer Science 2023-01-24 Aamal Abbas Hussain , Francesco Belardinelli , Georgios Piliouras

We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic regression, phase retrieval) with general data-covariance.…

Optimization and Control · Mathematics 2023-08-21 Elizabeth Collins-Woodfin , Courtney Paquette , Elliot Paquette , Inbar Seroussi