English
Related papers

Related papers: Learning Nonlinear Mixtures: Identifiability and A…

200 papers

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between…

Machine Learning · Statistics 2021-11-24 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

In causal inference, interference occurs when the treatment of one unit may affect the outcomes of other units. The goal of this work is to serve as a guide to the use of linear outcome modeling for estimating causal effects in settings…

Methodology · Statistics 2026-04-01 Eric Tong , Salvador V. Balkus

Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent…

Optimization and Control · Mathematics 2022-10-28 Patrick L. Combettes , Jean-Christophe Pesquet , Audrey Repetti

In recent years we see a rapidly growing line of research which shows learnability of various models via common neural network algorithms. Yet, besides a very few outliers, these results show learnability of models that can be learned using…

Machine Learning · Computer Science 2020-07-06 Amit Daniely , Eran Malach

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

This work focuses on the question of how identifiability of a mathematical model, that is, whether parameters can be recovered from data, is related to identifiability of its submodels. We look specifically at linear compartmental models…

Algebraic Geometry · Mathematics 2019-05-27 Elizabeth Gross , Heather A. Harrington , Nicolette Meshkat , Anne Shiu

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

A Profile Mixture Model is a model of protein evolution, describing sequence data in which sites are assumed to follow many related substitution processes on a single evolutionary tree. The processes depend in part on different amino acid…

Populations and Evolution · Quantitative Biology 2020-07-07 Samaneh Yourdkhani , Elizabeth S. Allman , John A. Rhodes

In many data-driven applications, collecting data from different sources is increasingly desirable for enhancing performance. In this paper, we are interested in the problem of probabilistic forecasting with multi-source time series. We…

Machine Learning · Computer Science 2023-02-23 Tian Guo

In this paper we develop a method for learning nonlinear systems with multiple outputs and inputs. We begin by modelling the errors of a nominal predictor of the system using a latent variable framework. Then using the maximum likelihood…

Machine Learning · Statistics 2018-05-28 Per Mattsson , Dave Zachariah , Petre Stoica

Machine Learning algorithms have had a profound impact on the field of computer science over the past few decades. These algorithms performance is greatly influenced by the representations that are derived from the data in the learning…

Dynamical models identified from data are frequently employed in control system design. However, decoupling system identification from controller synthesis can result in situations where no suitable controller exists after a model has been…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Sampath Kumar Mulagaleti , Alberto Bemporad

Across scientific domains, a fundamental challenge is to characterize and compute the mappings from underlying physical processes to observed signals and measurements. While nonlinear neural networks have achieved considerable success, they…

Machine Learning · Computer Science 2025-08-11 Alexander DeLise , Kyle Loh , Krish Patel , Meredith Teague , Andrea Arnold , Matthias Chung

Balancing the model complexity and the representation capability towards the process to be captured remains one of the main challenges in nonlinear system identification. One possibility to reduce model complexity is to impose structure on…

Systems and Control · Electrical Eng. & Systems 2020-04-13 Maarten Schoukens , Roland Toth

This paper explores unsupervised learning of parsing models along two directions. First, which models are identifiable from infinite data? We use a general technique for numerically checking identifiability based on the rank of a Jacobian…

Machine Learning · Statistics 2012-06-15 Daniel Hsu , Sham M. Kakade , Percy Liang

Can we effectively learn a nonlinear representation in time comparable to linear learning? We describe a new algorithm that explicitly and adaptively expands higher-order interaction features over base linear representations. The algorithm…

Machine Learning · Computer Science 2014-10-03 Alekh Agarwal , Alina Beygelzimer , Daniel Hsu , John Langford , Matus Telgarsky

In this paper, an original result in terms of a sufficient condition to test identifiability of nonlinear delayed-differential models with constant delays and multi-inputs is given. The identifiability is studied for the linearized system…

Dynamical Systems · Mathematics 2010-09-10 Carine Jauberthie , Louise Travé-Massuyès

The parameters of a linear compartment model are usually estimated from experimental input-output data. A problem arises when infinitely many parameter values can yield the same result; such a model is called unidentifiable. In this case,…

Combinatorics · Mathematics 2016-03-08 Jasmijn A. Baaijens , Jan Draisma

Differential equations and numerical methods are extensively used to model various real-world phenomena in science and engineering. With modern developments, we aim to find the underlying differential equation from a single observation of…

Numerical Analysis · Mathematics 2025-06-10 Roy Y. He , Hao Liu , Wenjing Liao , Sung Ha Kang