中文
相关论文

相关论文: Estimating the Hessian by Back-propagating Curvatu…

200 篇论文

The Gleason grading system using histological images is the most powerful diagnostic and prognostic predictor of prostate cancer. The current standard inspection is evaluating Gleason H&E-stained histopathology images by pathologists.…

图像与视频处理 · 电气工程与系统科学 2020-12-10 Haotian Xie , Yong Zhang , Jun Wang , Jingjing Zhang , Yifan Ma , Zhaogang Yang

Differential quantities, including normals, curvatures, principal directions, and associated matrices, play a fundamental role in geometric processing and physics-based modeling. Computing these differential quantities consistently on…

数值分析 · 数学 2016-03-23 Xiangmin Jiao , Hongyuan Zha

We derive an exact and efficient Bayesian regression algorithm for piecewise constant functions of unknown segment number, boundary location, and levels. It works for any noise and segment level prior, e.g. Cauchy which can handle outliers.…

统计理论 · 数学 2007-06-13 Marcus Hutter

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

图像与视频处理 · 电气工程与系统科学 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

In regression, conformal prediction is a general methodology to construct prediction intervals in a distribution-free manner. Although conformal prediction guarantees strong statistical property for predictive inference, its inherent…

统计理论 · 数学 2016-12-01 Wenyu Chen , Zhaokai Wang , Wooseok Ha , Rina Foygel Barber

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

最优化与控制 · 数学 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

We present Causal Posterior Estimation (CPE), a novel method for Bayesian inference in simulator models, i.e., models where the evaluation of the likelihood function is intractable or too computationally expensive, but where one can…

机器学习 · 计算机科学 2025-05-28 Simon Dirmeier , Antonietta Mira

Depth prediction is one of the fundamental problems in computer vision. In this paper, we propose a simple yet effective convolutional spatial propagation network (CSPN) to learn the affinity matrix for various depth estimation tasks.…

计算机视觉与模式识别 · 计算机科学 2019-10-07 Xinjing Cheng , Peng Wang , Ruigang Yang

Backpropagation is a classic automatic differentiation algorithm computing the gradient of functions specified by a certain class of simple, first-order programs, called computational graphs. It is a fundamental tool in several fields, most…

计算机科学中的逻辑 · 计算机科学 2019-11-07 Alois Brunel , Damiano Mazza , Michele Pagani

We present an efficient matrix-free point spread function (PSF) method for approximating operators that have locally supported non-negative integral kernels. The method computes impulse responses at scattered points, and interpolates these…

数值分析 · 数学 2024-02-26 Nick Alger , Tucker Hartland , Noemi Petra , Omar Ghattas

We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature information leveraged by quasi-Newton methods. We unify these…

机器学习 · 计算机科学 2014-12-02 Jascha Sohl-Dickstein , Ben Poole , Surya Ganguli

Differentiable programming is revolutionizing computational science by enabling automatic differentiation (AD) of numerical simulations. While first-order gradients are well-established, second-order derivatives (Hessians) for implicit…

计算工程、金融与科学 · 计算机科学 2025-05-20 Tianju Xue

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

统计理论 · 数学 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

For uncertainty propagation of highly complex and/or nonlinear problems, one must resort to sample-based non-intrusive approaches [1]. In such cases, minimizing the number of function evaluations required to evaluate the response surface is…

数值分析 · 数学 2017-12-04 Anindya Bhaduri , Lori Graham-Brady

Our goal is to improve variance reducing stochastic methods through better control variates. We first propose a modification of SVRG which uses the Hessian to track gradients over time, rather than to recondition, increasing the correlation…

最优化与控制 · 数学 2018-04-03 Robert M. Gower , Nicolas Le Roux , Francis Bach

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

机器学习 · 统计学 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

In this article, we propose and develop a novel Bayesian algorithm for optimization of functions whose first and second partial derivatives are known. The basic premise is the Gaussian process representation of the function which induces a…

最优化与控制 · 数学 2020-10-27 Sucharita Roy , Sourabh Bhattacharya

The $p$-curvature of a system of linear differential equations in positive characteristic $p$ is a matrix that measures how far the system is from having a basis of polynomial solutions. We show that the similarity class of the…

符号计算 · 计算机科学 2016-05-23 Alin Bostan , Xavier Caruso , Eric Schost

When generalizing schemes for real-valued data approximation or decomposition to data living in Riemannian manifolds, tangent space-based schemes are very attractive for the simple reason that these spaces are linear. An open challenge is…

数值分析 · 数学 2023-06-02 Willem Diepeveen , Joyce Chew , Deanna Needell

Stochastic second-order methods achieve fast local convergence in strongly convex optimization by using noisy Hessian estimates to precondition the gradient. However, these methods typically reach superlinear convergence only when the…

最优化与控制 · 数学 2024-11-12 Ruichen Jiang , Michał Dereziński , Aryan Mokhtari