English
Related papers

Related papers: Accelerating Regularized Attention Kernel Regressi…

200 papers

Diffusion Transformers (DiT) have become a leading architecture in image generation. However, the quadratic complexity of attention mechanisms, which are responsible for modeling token-wise relationships, results in significant latency when…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Songhua Liu , Zhenxiong Tan , Xinchao Wang

The use of mobile robots in unstructured environments like the agricultural field is becoming increasingly common. The ability for such field robots to proactively identify and avoid failures is thus crucial for ensuring efficiency and…

Robotics · Computer Science 2023-10-02 Andre Schreiber , Tianchen Ji , D. Livingston McPherson , Katherine Driggs-Campbell

Constructing the adjacency graph is fundamental to graph-based clustering. Graph learning in kernel space has shown impressive performance on a number of benchmark data sets. However, its performance is largely determined by the chosen…

Machine Learning · Computer Science 2019-03-15 Zhao Kang , Liangjian Wen , Wenyu Chen , Zenglin Xu

For data-driven iterative learning control (ILC) methods, both the model estimation and controller design problems are converted to parameter estimation problems for some chosen model structures. It is well-known that if the model order is…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Xian Yu , Xiaozhu Fang , Biqiang Mu , Tianshi Chen

Kernel logistic regression (KLR) is a widely used supervised learning method for binary and multi-class classification, which provides estimates of the conditional probabilities of class membership for the data points. Unlike other kernel…

Machine Learning · Computer Science 2025-12-23 Antonio Consolo , Andrea Manno , Edoardo Amaldi

Unstructured point clouds with varying sizes are increasingly acquired in a variety of environments through laser triangulation or Light Detection and Ranging (LiDAR). Predicting a scalar response based on unstructured point clouds is a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Michael Biehler , Hao Yan , Jianjun Shi

Deep learning has demonstrated remarkable achievements in medical image segmentation. However, prevailing deep learning models struggle with poor generalization due to (i) intra-class variations, where the same class appears differently in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Vandan Gorade , Sparsh Mittal , Debesh Jha , Rekha Singhal , Ulas Bagci

Visual autoregressive (AR) generation offers a promising path toward unifying vision and language models, yet its performance remains suboptimal against diffusion models. Prior work often attributes this gap to tokenizer limitations and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Qiyuan He , Yicong Li , Haotian Ye , Jinghao Wang , Xinyao Liao , Pheng-Ann Heng , Stefano Ermon , James Zou , Angela Yao

Attributed graphs, typically characterized by irregular topologies and a mix of numerical and categorical attributes, are ubiquitous in diverse domains such as social networks, bioinformatics, and cheminformatics. While graph kernels…

Machine Learning · Computer Science 2025-11-17 Hong Huang , Chengyu Yao , Haiming Chen , Hang Gao

Deep-learning based Super-Resolution (SR) methods have exhibited promising performance under non-blind setting where blur kernel is known. However, blur kernels of Low-Resolution (LR) images in different practical applications are usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Guangpin Tao , Xiaozhong Ji , Wenzhuo Wang , Shuo Chen , Chuming Lin , Yun Cao , Tong Lu , Donghao Luo , Ying Tai

This paper studies the decentralized optimization and learning problem where multiple interconnected agents aim to learn an optimal decision function defined over a reproducing kernel Hilbert space by jointly minimizing a global objective…

Machine Learning · Computer Science 2021-07-01 Ping Xu , Yue Wang , Xiang Chen , Zhi Tian

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

Enhanced modeling of microlensing variations in light curves of strongly lensed quasars improves measurements of cosmological time delays, the Hubble Constant, and quasar structure. Traditional methods for modeling extra-galactic…

Instrumentation and Methods for Astrophysics · Physics 2025-01-03 Somayeh Khakpash , Federica Bianco , Georgios Vernardos , Gregory Dobler , Charles Keeton

Kernel approximation via nonlinear random feature maps is widely used in speeding up kernel machines. There are two main challenges for the conventional kernel approximation methods. First, before performing kernel approximation, a good…

Machine Learning · Statistics 2015-03-16 Felix X. Yu , Sanjiv Kumar , Henry Rowley , Shih-Fu Chang

Motivated by the growing interest in representation learning approaches that uncover the latent structure of high-dimensional data, this work proposes new algorithms for reconstruction-based manifold learning within Reproducing-Kernel…

Machine Learning · Computer Science 2026-05-07 Enrique Feito-Casares , Francisco M. Melgarejo-Meseguer , José-Luis Rojo-Álvarez

Kernel ridge regression, KRR, is a generalization of linear ridge regression that is non-linear in the data, but linear in the model parameters. Here, we introduce an equivalent formulation of the objective function of KRR, which opens up…

Machine Learning · Statistics 2025-03-10 Oskar Allerbo

Given the broad application of infrared technology across diverse fields, there is an increasing emphasis on investigating super-resolution techniques for infrared images within the realm of deep learning. Despite the impressive results of…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Feiwei Qin , Kang Yan , Changmiao Wang , Ruiquan Ge , Yong Peng , Kai Zhang

We address the problem of upsampling a low-resolution (LR) depth map using a registered high-resolution (HR) color image of the same scene. Previous methods based on convolutional neural networks (CNNs) combine nonlinear activations of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Beomjun Kim , Jean Ponce , Bumsub Ham

Anomaly detection is referred to as a process in which the aim is to detect data points that follow a different pattern from the majority of data points. Anomaly detection methods suffer from several well-known challenges that hinder their…

Machine Learning · Computer Science 2021-08-31 Kasra Babaei , Zhi Yuan Chen , Tomas Maul

A normalized batch gradient descent optimizer is proposed to improve the first-order regular perturbation coefficients of the Manakov equation, often referred to as kernels. The optimization is based on the linear parameterization offered…

Signal Processing · Electrical Eng. & Systems 2023-01-16 Astrid Barreiro , Gabriele Liga , Alex Alvarado