English
Related papers

Related papers: A Closed-Form Solution for Kernel Adaptive Filteri…

200 papers

Recent vision transformers, large-kernel CNNs and MLPs have attained remarkable successes in broad vision tasks thanks to their effective information fusion in the global scope. However, their efficient deployments, especially on mobile…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Zhipeng Huang , Zhizheng Zhang , Cuiling Lan , Zheng-Jun Zha , Yan Lu , Baining Guo

We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as…

Optimization and Control · Mathematics 2020-11-20 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

Complex-valued neural networks (CVNNs) have been shown to be powerful nonlinear approximators when the input data can be properly modeled in the complex domain. One of the major challenges in scaling up CVNNs in practice is the design of…

Neural and Evolutionary Computing · Computer Science 2019-02-07 Simone Scardapane , Steven Van Vaerenbergh , Danilo Comminiello , Aurelio Uncini

In this paper, we use a matrix adaptive filter as the synthesis stage of a Uniform Filter Bank (UFB) to reconstruct the input signal. We first develop the mathematical theory behind it by applying the model of optimal filtering at the…

Signal Processing · Electrical Eng. & Systems 2022-09-23 Sandeep Patel , Ravindra Dhuli , Brejesh Lall

We present a kernel-based methodology for constructing Lyapunov functions for nonlinear dynamical systems using approximate Koopman eigenfunctions. Our approach decomposes principal Koopman eigenfunctions into linear and nonlinear…

Numerical Analysis · Mathematics 2026-02-26 P. Giesl , S. Hafstein , B. Hamzi , J. Lee , H. Owhadi , G. Santin , U. Vaidya

The Kalman filter (KF) is used in a variety of applications for computing the posterior distribution of latent states in a state space model. The model requires a linear relationship between states and observations. Extensions to the Kalman…

Machine Learning · Statistics 2016-08-31 Michael C. Burkhart , David M. Brandman , Carlos E. Vargas-Irwin , Matthew T. Harrison

In this paper, we introduce an adaptive kernel method for solving the optimal filtering problem. The computational framework that we adopt is the Bayesian filter, in which we recursively generate an optimal estimate for the state of a…

Numerical Analysis · Mathematics 2022-03-11 Zezhong Zhang , Richard Archibald , Feng Bao

The Kalman filter (KF) is one of the most widely used tools for data assimilation and sequential estimation. In this work, we show that the state estimates from the KF in a standard linear dynamical system setting are equivalent to those…

Methodology · Statistics 2021-08-04 Maria Jahja , David C. Farrow , Roni Rosenfeld , Ryan J. Tibshirani

Fractional differential equations (FDEs) describe subdiffusion behavior of dynamical systems. Its non-local structure requires taking into account the whole evolution history during the time integration, which then possibly causes…

Numerical Analysis · Mathematics 2022-02-17 Ustim Khristenko , Barbara Wohlmuth

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

This paper develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of…

Methodology · Statistics 2021-07-20 Rui Tuo , Shiyuan He , Arash Pourhabib , Yu Ding , Jianhua Z. Huang

This paper presents a fully multidimensional kernel-based reconstruction scheme for finite volume methods applied to systems of hyperbolic conservation laws, with a particular emphasis on the compressible Euler equations. Non-oscillatory…

Numerical Analysis · Mathematics 2024-01-31 Ian C. T. May , Dongwook Lee

State-of-the-art methods for computer vision rely heavily on the translation equivariance and spatial sharing properties of convolutional layers without explicitly taking into consideration the input content. Modern techniques employ deep…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Filippos Kokkinos , Ioannis Marras , Matteo Maggioni , Gregory Slabaugh , Stefanos Zafeiriou

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

Convolutional networks are not aware of an object's geometric variations, which leads to inefficient utilization of model and data capacity. To overcome this issue, recent works on deformation modeling seek to spatially reconfigure the data…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Hang Gao , Xizhou Zhu , Steve Lin , Jifeng Dai

Accurately reconstructing continuous flow fields from sparse or indirect measurements remains an open challenge, as existing techniques often suffer from oversmoothing artifacts, reliance on heterogeneous architectures, and the…

Graphics · Computer Science 2025-04-03 Xingyu Ni , Jingrui Xing , Xingqiao Li , Bin Wang , Baoquan Chen

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

We consider the problem of approximating a truncated Gaussian kernel using Fourier (trigonometric) functions. The computation-intensive bilateral filter can be expressed using fast convolutions by applying such an approximation to its range…

Image and Video Processing · Electrical Eng. & Systems 2018-11-07 Sanjay Ghosh , Pravin Nair , Kunal N. Chaudhury

This paper introduces a computational framework to identify nonlinear input-output operators that fit a set of system trajectories while satisfying incremental integral quadratic constraints. The data fitting algorithm is thus regularized…

Optimization and Control · Mathematics 2021-10-25 Henk J. van Waarde , Rodolphe Sepulchre