English
Related papers

Related papers: Seismic Tomography with Random Batch Gradient Reco…

200 papers

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient…

Computational Physics · Physics 2021-04-28 Weiqiang Zhu , Kailai Xu , Eric Darve , Gregory C. Beroza

We introduce two quantum algorithms for solving structured prediction problems. We first show that a stochastic gradient descent that uses the quantum minimum finding algorithm and takes its probabilistic failure into account solves the…

Machine Learning · Computer Science 2021-07-05 Behrooz Sepehry , Ehsan Iranmanesh , Michael P. Friedlander , Pooya Ronagh

Advances in data acquisition and numerical wave simulation have improved tomographic imaging techniques and results, but non-experts may find it difficult to understand which model is best for their needs. This paper is intended for these…

Geophysics · Physics 2025-01-27 Andreas Fichtner , Jeroen Ritsema , Solvi Thrastarson

Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…

Machine Learning · Statistics 2025-08-25 Hao Chen , Lili Zheng , Raed Al Kontar , Garvesh Raskutti

We study the generalization performance of $\text{full-batch}$ optimization algorithms for stochastic convex optimization: these are first-order methods that only access the exact gradient of the empirical risk (rather than gradients with…

Optimization and Control · Mathematics 2021-07-02 Idan Amir , Yair Carmon , Tomer Koren , Roi Livni

Using recent advances in generative artificial intelligence (AI) brought by diffusion models, this paper introduces a new synergistic method for spectral computed tomography (CT) reconstruction. Diffusion models define a neural network to…

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

Stochastic gradient descent~(SGD) and its variants have been the dominating optimization methods in machine learning. Compared to SGD with small-batch training, SGD with large-batch training can better utilize the computational power of…

Machine Learning · Statistics 2024-04-16 Shen-Yi Zhao , Chang-Wei Shi , Yin-Peng Xie , Wu-Jun Li

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

We use a rank one Gaussian perturbation to derive a smooth stochastic approximation of the maximum eigenvalue function. We then combine this smoothing result with an optimal smooth stochastic optimization algorithm to produce an efficient…

Optimization and Control · Mathematics 2014-03-05 Alexandre d'Aspremont , Noureddine El Karoui

A well-known diagnostic imaging modality, termed ultrasound tomography, was quickly developed for the detection of very small tumors whose sizes are smaller than the wavelength of the incident pressure wave without ionizing radiation,…

Medical Physics · Physics 2015-08-05 Tran Quang-Huy , Tran Duc-Tan , Huynh Huu Tue , Nguyen Linh-Trung

We analyze a batched variant of Stochastic Gradient Descent (SGD) with weighted sampling distribution for smooth and non-smooth objective functions. We show that by distributing the batches computationally, a significant speedup in the…

Numerical Analysis · Mathematics 2017-03-02 Deanna Needell , Rachel Ward

We derive a stochastic gradient algorithm for semidefinite optimization using randomization techniques. The algorithm uses subsampling to reduce the computational cost of each iteration and the subsampling ratio explicitly controls…

Optimization and Control · Mathematics 2011-08-30 Alexandre d'Aspremont

Gaussian processes (GPs) based methods for solving partial differential equations (PDEs) demonstrate great promise by bridging the gap between the theoretical rigor of traditional numerical algorithms and the flexible design of machine…

Numerical Analysis · Mathematics 2024-02-02 Xianjin Yang , Houman Owhadi

This paper describes a novel method for partitioning image into meaningful segments. The proposed method employs watershed transform, a well-known image segmentation technique. Along with that, it uses various auxiliary schemes such as…

Computer Vision and Pattern Recognition · Computer Science 2013-03-21 Ankit R. Chadha , Neha S. Satam

Recently, 3D Gaussian Splatting (3DGS) has enabled photorealistic view synthesis at high inference speeds. However, its splatting-based rendering model makes several approximations to the rendering equation, reducing physical accuracy. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Chinmay Talegaonkar , Yash Belhe , Ravi Ramamoorthi , Nicholas Antipa

Constrained optimization plays a crucial role in the fields of quantum physics and quantum information science and becomes especially challenging for high-dimensional complex structure problems. One specific issue is that of quantum process…

Quantum Physics · Physics 2024-04-30 Daniel Volya , Andrey Nikitin , Prabhat Mishra

Full waveform inversion (FWI) is a powerful yet computationally expensive technique that can yield subsurface models at high resolution. Randomly selected shots ("mini-batches") can be used to approximate the misfit and the gradient of FWI,…

Geophysics · Physics 2020-05-25 Bharath Shekar

We consider blind ptychography, an imaging technique which aims to reconstruct an object of interest from a set of its diffraction patterns, each obtained by a local illumination. As the distribution of the light within the illuminated…

Numerical Analysis · Mathematics 2023-06-16 Oleh Melnyk

Seismic data are commonly modeled by a high-frequency single scattering approximation. This amounts to a linearization in the medium coefficient about a smooth background. The discontinuities are contained in the medium perturbation. The…

Analysis of PDEs · Mathematics 2009-09-25 Christiaan C. Stolk , Maarten V. de Hoop
‹ Prev 1 4 5 6 7 8 10 Next ›