English
Related papers

Related papers: Kronecker-factored Approximate Curvature (KFAC) Fr…

200 papers

Computing accurate yet efficient approximations to the solutions of the electronic Schr\"odinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of…

Chemical Physics · Physics 2023-09-25 Zeno Schätzle , Bernát Szabó , Matĕj Mezera , Jan Hermann , Frank Noé

Kernel principal component analysis (KPCA) is a well-recognized nonlinear dimensionality reduction method that has been widely used in nonlinear fault detection tasks. As a kernel trick-based method, KPCA inherits two major problems. First,…

Machine Learning · Computer Science 2024-10-28 Zelin Ren , Xuebing Yang , Yuchen Jiang , Wensheng Zhang

The goal of a learning algorithm is to receive a training data set as input and provide a hypothesis that can generalize to all possible data points from a domain set. The hypothesis is chosen from hypothesis classes with potentially…

Machine Learning · Statistics 2023-03-29 Soosan Beheshti , Mahdi Shamsi

Second-order methods have the capability of accelerating optimization by using much richer curvature information than first-order methods. However, most are impractical for deep learning, where the number of training parameters is huge. In…

Machine Learning · Computer Science 2022-02-22 Yi Ren , Achraf Bahamou , Donald Goldfarb

The $k$-principal component analysis ($k$-PCA) problem is a fundamental algorithmic primitive that is widely-used in data analysis and dimensionality reduction applications. In statistical settings, the goal of $k$-PCA is to identify a top…

Numerical Analysis · Mathematics 2024-06-12 Arun Jambulapati , Syamantak Kumar , Jerry Li , Shourya Pandey , Ankit Pensia , Kevin Tian

The fast Fourier transform (FFT) is one of the most successful numerical algorithms of the 20th century and has found numerous applications in many branches of computational science and engineering. The FFT algorithm can be derived from a…

Numerical Analysis · Mathematics 2021-02-10 Daan Camps , Roel Van Beeumen , Chao Yang

Quadratic assignment problems (QAPs) arise in a wide variety of domains, ranging from operations research to graph theory to computer vision to neuroscience. In the age of big data, graph valued data is becoming more prominent, and with it,…

Cross-correlator plays a significant role in many visual perception tasks, such as object detection and tracking. Beyond the linear cross-correlator, this paper proposes a kernel cross-correlator (KCC) that breaks traditional limitations.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Chen Wang , Le Zhang , Lihua Xie , Junsong Yuan

We provide a general framework for getting expected linear time constant factor approximations (and in many cases FPTASs) to several well-known problems in Computational Geometry, such as $k$-center clustering and farthest nearest neighbor.…

Computational Geometry · Computer Science 2026-03-04 Sariel Har-Peled , Banjamin Raichel

3D action recognition was shown to benefit from a covariance representation of the input data (joint 3D positions). A kernel machine feed with such feature is an effective paradigm for 3D action recognition, yielding state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

Pre-trained models are widely used in fine-tuning downstream tasks with linear classifiers optimized by the cross-entropy loss, which might face robustness and stability problems. These problems can be improved by learning representations…

Computation and Language · Computer Science 2021-10-07 Linyang Li , Demin Song , Ruotian Ma , Xipeng Qiu , Xuanjing Huang

Knowledge graph embedding research has mainly focused on learning continuous representations of entities and relations tailored towards the link prediction problem. Recent results indicate an ever increasing predictive ability of current…

Machine Learning · Computer Science 2022-05-16 Caglar Demir , Julian Lienen , Axel-Cyrille Ngonga Ngomo

Many applications, such as system identification, classification of time series, direct and inverse problems in partial differential equations, and uncertainty quantification lead to the question of approximation of a non-linear operator…

Numerical Analysis · Mathematics 2022-12-05 Hrushikesh Mhaskar

Deep learning using neural networks is an effective technique for generating models of complex data. However, training such models can be expensive when networks have large model capacity resulting from a large number of layers and nodes.…

Machine Learning · Computer Science 2023-01-19 Jarom D. Hogue , Robert M. Kirby , Akil Narayan

We propose an end-to-end integrated strategy to produce highly accurate quantum chemistry (QC) synthetic datasets (energies and forces) aimed at deriving Foundation Machine Learning models for molecular simulation. Starting from Density…

Graph learning, or network inference, is a prominent problem in graph signal processing (GSP). GSP generalizes the Fourier transform to non-Euclidean domains, and graph learning is pivotal to applying GSP when these domains are unknown.…

Machine Learning · Computer Science 2025-05-16 Changhao Shi , Gal Mishne

We introduce a quadratically-constrained approximation (QCAC) of the AC optimal power flow (AC-OPF) problem. Unlike existing approximations like the DC-OPF, our model does not rely on typical assumptions such as high reactance-to-resistance…

Optimization and Control · Mathematics 2026-01-21 Gonzalo E. Constante-Flores , Can Li

Kernel-based reinforcement learning (KBRL) stands out among reinforcement learning algorithms for its strong theoretical guarantees. By casting the learning problem as a local kernel approximation, KBRL provides a way of computing a…

Machine Learning · Computer Science 2014-07-22 André M. S. Barreto , Doina Precup , Joelle Pineau

Classification is at the core of data-driven prediction and decision-making, representing a fundamental task in supervised machine learning. Recently, several quantum machine learning algorithms that use quantum kernels as a measure of…

Quantum Physics · Physics 2024-08-12 Jungyun Lee , Daniel K. Park

Approximate Bayesian Computation (ABC for short) is a family of computational techniques which offer an almost automated solution in situations where evaluation of the posterior likelihood is computationally prohibitive, or whenever…

Statistics Theory · Mathematics 2013-06-04 Gérard Biau , Frédéric Cérou , Arnaud Guyader