English
Related papers

Related papers: Kernel Modelling of Fading Memory Systems

200 papers

In this paper, we present a kernel subspace clustering method that can handle non-linear models. In contrast to recent kernel subspace clustering methods which use predefined kernels, we propose to learn a low-rank kernel matrix, with which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Pan Ji , Ian Reid , Ravi Garg , Hongdong Li , Mathieu Salzmann

Quantum computing has been revolutionizing the development of algorithms. However, only noisy intermediate-scale quantum devices are available currently, which imposes several restrictions on the circuit implementation of quantum…

Quantum Physics · Physics 2023-09-29 Jonathan H. A. de Carvalho , Fernando M. de Paula Neto

Incorporating nonlinearity into quantum machine learning is essential for learning a complicated input-output mapping. We here propose quantum algorithms for nonlinear regression, where nonlinearity is introduced with feature maps when…

Quantum Physics · Physics 2018-08-30 Dan-Bo Zhang , Shi-Liang Zhu , Z. D. Wang

We propose a new method for blind system identification. Resorting to a Gaussian regression framework, we model the impulse response of the unknown linear system as a realization of a Gaussian process. The structure of the covariance matrix…

Systems and Control · Computer Science 2016-05-20 Giulio Bottegal , Riccardo S. Risuleo , Håkan Hjalmarsson

In this contribution, we propose a kernel-based method for the identification of linear systems from noisy and incomplete input-output datasets. We model the impulse response of the system as a Gaussian process whose covariance matrix is…

Systems and Control · Computer Science 2017-01-18 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Understanding how the brain encodes stimuli has been a fundamental problem in computational neuroscience. Insights into this problem have led to the design and development of artificial neural networks that learn representations by…

Neurons and Cognition · Quantitative Biology 2025-12-04 Shubham Choudhary , Paul Masset , Demba Ba

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

Factor modeling is a powerful statistical technique that permits to capture the common dynamics in a large panel of data with a few latent variables, or factors, thus alleviating the curse of dimensionality. Despite its popularity and…

Econometrics · Economics 2021-03-03 Varlam Kutateladze

The study of networks has witnessed an explosive growth over the past decades with several ground-breaking methods introduced. A particularly interesting -- and prevalent in several fields of study -- problem is that of inferring a function…

We present an improvement of a recent funnel controller design for uncertain nonlinear multi-input, multi-output systems modeled by higher order functional differential equations in the presence of input constraints. The objective is to…

Optimization and Control · Mathematics 2026-04-29 Thomas Berger

We introduce an incremental processing scheme for convolutional neural network (CNN) inference, targeted at embedded applications with limited memory budgets. Instead of processing layers one by one, individual input pixels are propagated…

Neural and Evolutionary Computing · Computer Science 2019-05-22 Jonathan Binas , Yoshua Bengio

Through one decade's development, the kernel-based regularization method (KRM) has become a complement to the classical maximum likelihood/prediction error method and an emerging new system identification paradigm. One recent example is its…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Xiaozhu Fang , Tianshi Chen

Neural Turing Machines (NTM) contain memory component that simulates "working memory" in the brain to store and retrieve information to ease simple algorithms learning. So far, only linearly organized memory is proposed, and during…

Artificial Intelligence · Computer Science 2015-10-27 Wei Zhang , Yang Yu , Bowen Zhou

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

We propose a principled method for kernel learning, which relies on a Fourier-analytic characterization of translation-invariant or rotation-invariant kernels. Our method produces a sequence of feature maps, iteratively refining the SVM…

Machine Learning · Computer Science 2018-02-28 Brian Bullins , Cyril Zhang , Yi Zhang

Tracking of reference signals is addressed in the context of a class of nonlinear controlled systems modelled by $r$-th order functional differential equations, encompassing inter alia systems with unknown "control direction" and dead-zone…

Optimization and Control · Mathematics 2021-01-18 Thomas Berger , Achim Ilchmann , Eugene P Ryan

Sequential deep learning models such as RNN, causal CNN and attention mechanism do not readily consume continuous-time information. Discretizing the temporal data, as we show, causes inconsistency even for simple continuous-time processes.…

Machine Learning · Computer Science 2021-03-30 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

This paper describes a process for combining patterns and features, to guide a search process and make predictions. It is based on the functionality that a human brain might have, which is a highly distributed network of simple neuronal…

Artificial Intelligence · Computer Science 2021-01-05 Kieran Greer

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

This paper addresses the problem of learning the impulse responses characterizing forward models by means of a regularized kernel-based Prediction Error Method (PEM). The common approach to accomplish that is to approximate the system with…

Optimization and Control · Mathematics 2024-09-20 Giulio Fattore , Marco Peruzzo , Giacomo Sartori , Mattia Zorzi