English
Related papers

Related papers: Kronecker-factored Approximate Curvature (KFAC) Fr…

200 papers

Remote Sensing Scene Classification is a challenging and valuable research topic, in which Convolutional Neural Network (CNN) has played a crucial role. CNN can extract hierarchical convolutional features from remote sensing imagery, and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yinzhu Cheng

Kernel methods are powerful learning methodologies that allow to perform non-linear data analysis. Despite their popularity, they suffer from poor scalability in big data scenarios. Various approximation methods, including random feature…

Machine Learning · Statistics 2022-06-14 Bharath Sriperumbudur , Nicholas Sterge

Kronecker PCA involves the use of a space vs. time Kronecker product decomposition to estimate spatio-temporal covariances. In this work the addition of a sparse correction factor is considered, which corresponds to a model of the…

Methodology · Statistics 2016-11-17 Kristjan Greenewald , Alfred Hero

Quantum error correction (QEC) is essential for enabling quantum advantages, with decoding as a central algorithmic primitive. Owing to its importance and intrinsic difficulty, substantial effort has been made to QEC decoder design, among…

Quantum Physics · Physics 2026-05-13 Ge Yan , Shanchuan Li , Yuxuan Du

In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum…

Numerical Analysis · Mathematics 2022-11-03 Matteo Croci , Judit Muñoz-Matute

The rapid evolution of deepfake generation technologies poses critical challenges for detection systems, as non-continual learning methods demand frequent and expensive retraining. We reframe deepfake detection (DFD) as a Continual Learning…

Machine Learning · Computer Science 2025-09-11 Federico Fontana , Anxhelo Diko , Romeo Lanzino , Marco Raoul Marini , Bachir Kaddar , Gian Luca Foresti , Luigi Cinque

The ability to train Deep Neural Networks (DNNs) with constraints is instrumental in improving the fairness of modern machine-learning models. Many algorithms have been analysed in recent years, and yet there is no standard, widely accepted…

Machine Learning · Computer Science 2026-02-19 Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

In this paper we propose and study a technique to reduce the number of parameters and computation time in fully-connected layers of neural networks using Kronecker product, at a mild cost of the prediction quality. The technique proceeds by…

Neural and Evolutionary Computing · Computer Science 2015-07-23 Shuchang Zhou , Jia-Nan Wu

The Kronecker product is an invaluable tool for data-sparse representations of large networks and matrices with countless applications in machine learning, graph theory and numerical linear algebra. In some instances, the sparsity pattern…

Numerical Analysis · Mathematics 2025-10-30 Yannis Voet , Leonardo De Novellis

Traditional deep learning models implicity encode knowledge limiting their transparency and ability to adapt to data changes. Yet, this adaptability is vital for addressing user data privacy concerns. We address this limitation by storing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sebastian Doerrich , Tobias Archut , Francesco Di Salvo , Christian Ledig

Variational Bayesian neural networks combine the flexibility of deep learning with Bayesian uncertainty estimation. However, inference procedures for flexible variational posteriors are computationally expensive. A recently proposed method,…

Machine Learning · Computer Science 2018-12-03 Juhan Bae , Guodong Zhang , Roger Grosse

Classification is one of the core problems in Computer-Aided Diagnosis (CAD), targeting for early cancer detection using 3D medical imaging interpretation. High detection sensitivity with desirably low false positive (FP) rate is critical…

Computer Vision and Pattern Recognition · Computer Science 2014-05-20 Meizhu Liu , Le Lu , Xiaojing Ye , Shipeng Yu

As we reach the limit of Moore's Law, researchers are exploring different paradigms to achieve unprecedented performance. Approximate Computing (AC), which relies on the ability of applications to tolerate some error in the results to…

Numerical Analysis · Mathematics 2023-04-14 Garima Singh , Baidyanath Kundu , Harshitha Menon , Alexander Penev , David J. Lange , Vassil Vassilev

Continuous learning seeks to perform the learning on the data that arrives from time to time. While prior works have demonstrated several possible solutions, these approaches require excessive training time as well as memory usage. This is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chih-Hsing Ho , Shang-Ho , Tsai

Adversarial training has been widely acknowledged as the most effective method to improve the adversarial robustness against adversarial examples for Deep Neural Networks (DNNs). So far, most existing works focus on enhancing the overall…

Machine Learning · Computer Science 2023-03-28 Zeming Wei , Yifei Wang , Yiwen Guo , Yisen Wang

Constrained low-rank matrix approximations have been known for decades as powerful linear dimensionality reduction techniques to be able to extract the information contained in large data sets in a relevant way. However, such low-rank…

Machine Learning · Computer Science 2021-12-20 Pierre De Handschutter , Nicolas Gillis , Xavier Siebert

Recent advances in variational inference enable the modelling of highly structured joint distributions, but are limited in their capacity to scale to the high-dimensional setting of stochastic neural networks. This limitation motivates a…

Quantum computing (QC) seems to show potential for application in machine learning (ML). In particular quantum kernel methods (QKM) exhibit promising properties for use in supervised ML tasks. However, a major disadvantage of kernel methods…

Quantum Physics · Physics 2025-01-14 Kilian Tscharke , Sebastian Issel , Pascal Debus

We consider the problem of matrix approximation and denoising induced by the Kronecker product decomposition. Specifically, we propose to approximate a given matrix by the sum of a few Kronecker products of matrices, which we refer to as…

Statistics Theory · Mathematics 2020-08-28 Chencheng Cai , Rong Chen , Han Xiao

Functional data, representing curves or trajectories, are ubiquitous in fields like biomedicine and motion analysis. A fundamental challenge is phase variability -- temporal misalignments that obscure underlying patterns and degrade model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Siyuan Jiang , Yihan Hu , Wenjie Li , Pengcheng Zeng