English
Related papers

Related papers: Kronecker-factored Approximate Curvature (KFAC) Fr…

200 papers

Approximate Bayesian computation (ABC) is a family of computational techniques in Bayesian statistics. These techniques allow to fi t a model to data without relying on the computation of the model likelihood. They instead require to…

Statistics Theory · Mathematics 2018-12-27 Maxime Lenormand , Franck Jabot , Guillaume Deffuant

Factor Analysis (FA) is a technique of fundamental importance that is widely used in classical and modern multivariate statistics, psychometrics and econometrics. In this paper, we revisit the classical rank-constrained FA problem, which…

Methodology · Statistics 2017-04-25 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

Quantum computing (QC) emulators, which simulate quantum algorithms on classical hardware, are indispensable platforms for testing quantum algorithms before scalable quantum computers become widely available. A critical challenge in QC…

Quantum Physics · Physics 2025-04-03 Seonghyun Choi , Kyeongwon Lee , Jongin Choi , Woojoo Lee

We study a multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in $d$ dimensions. KTF is a natural extension of univariate trend filtering (Steidl et al.,…

Machine Learning · Statistics 2024-04-09 Veeranjaneyulu Sadhanala , Yu-Xiang Wang , Addison J. Hu , Ryan J. Tibshirani

The seminal work of Dwork {\em et al.} [ITCS 2012] introduced a metric-based notion of individual fairness. Given a task-specific similarity metric, their notion required that every pair of similar individuals should be treated similarly.…

Machine Learning · Computer Science 2018-07-03 Guy N. Rothblum , Gal Yona

Recent days have witnessed significant interests in applying quantum-enhanced techniques for solving a variety of machine learning tasks. Variational methods that use quantum resources of imperfect quantum devices with the help of classical…

Quantum Physics · Physics 2021-11-15 Hiroshi Yano , Yudai Suzuki , Kohei M. Itoh , Rudy Raymond , Naoki Yamamoto

Fitting geometric models onto outlier contaminated data is provably intractable. Many computer vision systems rely on random sampling heuristics to solve robust fitting, which do not provide optimality guarantees and error bounds. It is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Anh-Dzung Doan , Michele Sasdelli , David Suter , Tat-Jun Chin

Most previous deepfake detection methods bent their efforts to discriminate artifacts by end-to-end training. However, the learned networks often fail to mine the general face forgery information efficiently due to ignoring the data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Wentang Song , Yuzhen Lin , Bin Li

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

We consider the problem of maximizing a monotone submodular function under a knapsack constraint. We show that, for any fixed $\epsilon > 0$, there exists a polynomial-time algorithm with an approximation ratio $1-c/e-\epsilon$, where $c…

Data Structures and Algorithms · Computer Science 2016-07-18 Yuichi Yoshida

Clustering problems are fundamental to unsupervised learning. There is an increased emphasis on fairness in machine learning and AI; one representative notion of fairness is that no single demographic group should be over-represented among…

Data Structures and Algorithms · Computer Science 2024-05-14 David G. Harris , Thomas Pensyl , Aravind Srinivasan , Khoa Trinh

We consider a general class of binary packing problems with a convex quadratic knapsack constraint. We prove that these problems are APX-hard to approximate and present constant-factor approximation algorithms based upon three different…

Optimization and Control · Mathematics 2019-12-19 Max Klimm , Marc E. Pfetsch , Rico Raber , Martin Skutella

Kernel Adaptive Filtering (KAF) are mathematically principled methods which search for a function in a Reproducing Kernel Hilbert Space. While they work well for tasks such as time series prediction and system identification they are…

Machine Learning · Computer Science 2023-12-20 Benjamin Colburn , Jose C. Principe , Luis G. Sanchez Giraldo

Local quantum annealing (LQA), an iterative algorithm, is designed to solve combinatorial optimization problems. It draws inspiration from QA, which utilizes adiabatic time evolution to determine the global minimum of a given objective…

Quantum Physics · Physics 2025-01-07 Shunta Arai , Satoshi Takabe

Many applications that use empirically estimated functions face a curse of dimensionality, because the integrals over most function classes must be approximated by sampling. This paper introduces a novel regression-algorithm that learns…

Machine Learning · Computer Science 2015-03-31 Wendelin Böhmer , Klaus Obermayer

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

Quantum computing promises to revolutionize various fields, yet the execution of quantum programs necessitates an effective compilation process. This involves strategically mapping quantum circuits onto the physical qubits of a quantum…

Quantum Physics · Physics 2024-12-19 Tian Li , Xiao-Yue Xu , Chen Ding , Tian-Ci Tian , Wei-You Liao , Shuo Zhang , He-Liang Huang

Approximate Bayesian Computation (ABC) methods are commonly used to approximate posterior distributions in models with unknown or computationally intractable likelihoods. Classical ABC methods are based on nearest neighbor type algorithms…

Methodology · Statistics 2025-06-24 Meili Baragatti , Casenave Céline , Bertrand Cloez , David Métivier , Isabelle Sanchez

Kronecker product kernel provides the standard approach in the kernel methods literature for learning from graph data, where edges are labeled and both start and end vertices have their own feature representations. The methods allow…

Machine Learning · Statistics 2022-02-07 Antti Airola , Tapio Pahikkala

Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Feng Zhou , Jun Zhu