English
Related papers

Related papers: Discovering Nonlinear Relations with Minimum Predi…

200 papers

Time series prediction is an important problem in machine learning. Previous methods for time series prediction did not involve additional information. With a lot of dynamic knowledge graphs available, we can use this additional information…

Machine Learning · Computer Science 2020-07-14 Sankalp Garg , Navodita Sharma , Woojeong Jin , Xiang Ren

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Causal relationships play a fundamental role in understanding the world around us. The ability to identify and understand cause-effect relationships is critical to making informed decisions, predicting outcomes, and developing effective…

Statistical Mechanics · Physics 2025-09-10 Sergio Chibbaro , Cyril Furtlehner , Théo Marchetta , Andrei-Tiberiu Pantea , Davide Rossetti

Discovering causal relations from observational time series without making the stationary assumption is a significant challenge. In practice, this challenge is common in many areas, such as retail sales, transportation systems, and medical…

Machine Learning · Computer Science 2024-07-11 Shanyun Gao , Raghavendra Addanki , Tong Yu , Ryan A. Rossi , Murat Kocaoglu

In a direct data-driven approach, this paper studies the {\em property identification(ID)} problem to analyze whether an unknown linear system has a property of interest, e.g., stabilizability and structural properties. In sharp contrast to…

Systems and Control · Electrical Eng. & Systems 2022-08-30 Shubo Kang , Keyou You

We consider the ill-posed inverse problem of identifying a nonlinearity in a time-dependent PDE model. The nonlinearity is approximated by a neural network, and needs to be determined alongside other unknown physical parameters and the…

Numerical Analysis · Mathematics 2022-11-23 Barbara Kaltenbacher , Tram Thi Ngoc Nguyen

We discuss connections between sequential system identification and control for linear time-invariant systems, often termed indirect data-driven control, as well as a contemporary direct data-driven control approach seeking an optimal…

Optimization and Control · Mathematics 2021-09-15 Florian Dörfler , Jeremy Coulson , Ivan Markovsky

Achieving high-performance in multi-object tracking algorithms heavily relies on modeling spatio-temporal relationships during the data association stage. Mainstream approaches encompass rule-based and deep learning-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhonglin Liu , Shujie Chen , Jianfeng Dong , Xun Wang , Di Zhou

We propose a physics-based regularization technique for function learning, inspired by statistical mechanics. By drawing an analogy between optimizing the parameters of an interpolator and minimizing the energy of a system, we introduce…

Machine Learning · Computer Science 2025-08-20 Abhisek Ganguly , Alessandro Gabbana , Vybhav Rao , Sauro Succi , Santosh Ansumali

Time series measured from real-world systems are generally noisy, complex and display statistical properties that evolve continuously over time. Here, we present a method that combines wavelet analysis and non-stationary surrogates to…

Data Analysis, Statistics and Probability · Physics 2018-04-12 Mario Chavez , Bernard Cazelles

In this paper we develop a method for learning nonlinear systems with multiple outputs and inputs. We begin by modelling the errors of a nominal predictor of the system using a latent variable framework. Then using the maximum likelihood…

Machine Learning · Statistics 2018-05-28 Per Mattsson , Dave Zachariah , Petre Stoica

In this paper we propose a novel Temporal Attentive Relation Network (TARN) for the problems of few-shot and zero-shot action recognition. At the heart of our network is a meta-learning approach that learns to compare representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Mina Bishay , Georgios Zoumpourlis , Ioannis Patras

Inferring cause-effect relationships from observational data has gained significant attention in recent years, but most methods are limited to scalar random variables. In many important domains, including neuroscience, psychology, social…

Machine Learning · Statistics 2025-06-06 Konstantin Göbler , Tobias Windisch , Mathias Drton

We consider the problem of inferring causal relationships between two or more passively observed variables. While the problem of such causal discovery has been extensively studied especially in the bivariate setting, the majority of current…

Machine Learning · Statistics 2019-04-22 Ricardo Pio Monti , Kun Zhang , Aapo Hyvarinen

Deep neural networks suffer from catastrophic forgetting, where performance on previous tasks degrades after training on a new task. This issue arises due to the model's tendency to overwrite previously acquired knowledge with new…

Machine Learning · Computer Science 2025-12-02 Lama Alssum , Hasan Abed Al Kader Hammoud , Motasem Alfarra , Juan C Leon Alcazar , Bernard Ghanem

Learning causal relationships from empirical observations is a central task in scientific research. A common method is to employ structural causal models that postulate noisy functional relations among a set of interacting variables. To…

Machine Learning · Statistics 2023-09-11 Grigor Keropyan , David Strieder , Mathias Drton

Deep learning has been shown to achieve impressive results in several tasks where a large amount of training data is available. However, deep learning solely focuses on the accuracy of the predictions, neglecting the reasoning process…

Artificial Intelligence · Computer Science 2020-02-07 Giuseppe Marra , Michelangelo Diligenti , Francesco Giannini , Marco Gori , Marco Maggini

On time-series data, most causal discovery methods fit a new model whenever they encounter samples from a new underlying causal graph. However, these samples often share relevant information which is lost when following this approach.…

Machine Learning · Computer Science 2022-02-24 Sindy Löwe , David Madras , Richard Zemel , Max Welling

Selecting the best regularization parameter in inverse problems is a classical and yet challenging problem. Recently, data-driven approaches have become popular to tackle this challenge. These approaches are appealing since they do require…

Statistics Theory · Mathematics 2025-10-22 Jonathan Chirinos Rodriguez , Ernesto De Vito , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

This paper deals with the problem of finite-time learning for unknown discrete-time nonlinear systems' dynamics, without the requirement of the persistence of excitation. Two finite-time concurrent learning methods are presented to…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Farzaneh Tatari , Christos Panayiotou , Marios Polycarpou