English
Related papers

Related papers: Learning Nonlinear Factor Models with Unknown Mono…

200 papers

This work proposes a low complexity nonlinearity model and develops adaptive algorithms over it. The model is based on the decomposable---or rank-one, in tensor language---Volterra kernels. It may also be described as a product of FIR…

Systems and Control · Computer Science 2016-10-25 Felipe C. Pinheiro , Cassio G. Lopes

We consider the approximate recovery of multivariate periodic functions from a discrete set of function values taken on a rank-$s$ integration lattice. The main result is the fact that any (non-)linear reconstruction algorithm taking…

Numerical Analysis · Mathematics 2016-08-02 Glenn Byrenheid , Lutz Kämmerer , Tino Ullrich , Toni Volkmer

We present a method to reconstruct autocorrelated signals together with their autocorrelation structure from nonlinear, noisy measurements for arbitrary monotonous nonlinear instrument response. In the presented formulation the algorithm…

Methodology · Statistics 2018-02-14 Jakob Knollmüller , Theo Steininger , Torsten A. Enßlin

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

Low-rank tensor decompositions (TDs) provide an effective framework for multiway data analysis. Traditional TD methods rely on predefined structural assumptions, such as CP or Tucker decompositions. From a probabilistic perspective, these…

Machine Learning · Computer Science 2025-06-30 Zhengyun Cheng , Changhao Wang , Guanwen Zhang , Yi Xu , Wei Zhou , Xiangyang Ji

Latent or unobserved phenomena pose a significant difficulty in data analysis as they induce complicated and confounding dependencies among a collection of observed variables. Factor analysis is a prominent multivariate statistical modeling…

Methodology · Statistics 2020-06-22 Armeen Taeb , Venkat Chandrasekaran

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

This paper studies the data-driven reconstruction of firing rate dynamics of brain activity described by linear-threshold network models. Identifying the system parameters directly leads to a large number of variables and a highly…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Xuan Wang , Jorge Cortes

There is a growing need for models that are interpretable and have reduced energy and computational cost (e.g., in health care analytics and federated learning). Examples of algorithms to train such models include logistic regression and…

Machine Learning · Computer Science 2023-02-21 Tyler Sypherd , Nathan Stromberg , Richard Nock , Visar Berisha , Lalitha Sankar

We develop a model in which interactions between nodes of a dynamic network are counted by non homogeneous Poisson processes. In a block modelling perspective, nodes belong to hidden clusters (whose number is unknown) and the intensity…

Machine Learning · Statistics 2017-07-11 Marco Corneli , Pierre Latouche , Fabrice Rossi

Neural networks used for multi-interaction trajectory reconstruction lack the ability to estimate the uncertainty in their outputs, which would be useful to better analyse and understand the systems they model. In this paper we extend the…

Machine Learning · Computer Science 2020-06-26 Vasileios Karavias , Ben Day , Pietro Liò

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse…

Statistics Theory · Mathematics 2019-07-04 David Gamarnik , Julia Gaudio

A lossy compression algorithm for binary redundant memoryless sources is presented. The proposed scheme is based on sparse graph codes. By introducing a nonlinear function, redundant memoryless sequences can be compressed. We propose a…

Information Theory · Computer Science 2011-08-19 Kazushi Mimura

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler

This paper studies the design of neural network (NN)-based controllers for unknown nonlinear systems, using contraction analysis. A Neural Ordinary Differential Equation (NODE) system is constructed by approximating the unknown draft…

Systems and Control · Electrical Eng. & Systems 2025-05-23 Hao Yin , Claudio De Persis , Bayu Jayawardhana , Santiago Sanchez Escalonilla Plaza

Few neural architectures lend themselves to provable learning with gradient based methods. One popular model is the single-index model, in which labels are produced by composing an unknown linear projection with a possibly unknown scalar…

Machine Learning · Computer Science 2023-10-04 Aaron Zweig , Joan Bruna

This paper describes a method for learning low-dimensional approximations of nonlinear dynamical systems, based on neural-network approximations of the underlying Koopman operator. Extended Dynamic Mode Decomposition (EDMD) provides a…

Dynamical Systems · Mathematics 2019-01-17 Samuel E. Otto , Clarence W. Rowley

Robots must satisfy safety-critical state and input constraints despite disturbances and model mismatch. We introduce a robust model predictive control (RMPC) formulation that is fast, scalable, and compatible with real-time implementation.…

Optimization and Control · Mathematics 2025-09-24 Antoine P. Leeman , Johannes Köhler , Melanie N. Zeilinger

Kernel-based nonlinear dictionary learning methods operate in a feature space obtained by an implicit feature map, and they are not independent of computationally expensive operations like Singular Value Decomposition (SVD). This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 G. Madhuri , Atul Negi