English
Related papers

Related papers: Accurate and Fast Geometry Optimization with Time …

200 papers

An important linear algebra routine, GEneral Matrix Multiplication (GEMM), is a fundamental operator in deep learning. Compilers need to translate these routines into low-level code optimized for specific hardware. Compiler-level…

Machine Learning · Computer Science 2019-09-25 Huaqing Zhang , Xiaolin Cheng , Hui Zang , Dae Hoon Park

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang

Algorithms that promise to leverage resources of quantum computers efficiently to accelerate the finite element method have emerged. However, the finite element method is usually incorporated into a high-level numerical scheme which allows…

Quantum Physics · Physics 2025-04-03 Elise Fressart , Michel Nowak , Nicole Spillane

We present an application of the blackbox matrix-matrix multiplication (BBMM) algorithm to scale up the Gaussian Process (GP) training of molecular energies in the molecular-orbital based machine learning (MOB-ML) framework. An alternative…

Chemical Physics · Physics 2023-03-28 Jiace Sun , Lixue Cheng , Thomas F. Miller

For computational fluid dynamics (CFD), the generalized Riemann problem (GRP) solver and the gas-kinetic kinetic scheme (GKS) provide a time-accurate flux function starting from a discontinuous piecewise linear flow distributions around…

Numerical Analysis · Mathematics 2016-10-12 Liang Pan , Kun Xu , Qibing Li , Jiequan Li

Training efficiency in large-scale models is typically assessed through memory consumption, training time, and model performance. Current methods often exhibit trade-offs among these metrics, as optimizing one generally degrades at least…

Machine Learning · Computer Science 2026-02-03 Tianhao Miao , Zhongyuan Bao , Lejun Zhang

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

Optimization and Control · Mathematics 2023-03-15 Lénaïc Chizat

Electronic structure calculations are ubiquitous in most branches of chemistry, but all have errors in both energies and equilibrium geometries. Quantifying errors in possibly dozens of bond angles and bond lengths is a Herculean task. A…

Chemical Physics · Physics 2020-07-31 Stefan Vuckovic , Kieron Burke

Models invoking the chemical master equation are used in many areas of science, and, hence, their simulation is of interest to many researchers. The complexity of the problems at hand often requires considerable computational power, so a…

Biological Physics · Physics 2016-03-02 Fabian Spill , Philip K. Maini , Helen Byrne

In structural optimization, both parameters and shape are relevant for the model performance. Yet, conventional optimization techniques usually consider either parameters or the shape separately. This work addresses this problem by…

Optimization and Control · Mathematics 2025-03-18 Michael Wiesheu , Theodor Komann , Melina Merkel , Sebastian Schöps , Stefan Ulbrich , Idoia Cortes Garcia

Gradient-based (a.k.a. `first order') optimization algorithms are routinely used to solve large scale non-convex problems. Yet, it is generally hard to predict their effectiveness. In order to gain insight into this question, we revisit the…

Probability · Mathematics 2024-12-10 Andrea Montanari , Eliran Subag

In this work we propose a differential geometric motivation for Nesterov's accelerated gradient method (AGM) for strongly-convex problems. By considering the optimization procedure as occurring on a Riemannian manifold with a natural…

Machine Learning · Computer Science 2019-11-21 Aaron Defazio

Parallel algorithms on CPU and GPU are implemented for the Unified Gas-Kinetic Scheme and their performances are investigated and compared by a two dimensional channel flow case. The parallel CPU algorithm has a one dimensional block…

Computational Physics · Physics 2018-11-02 Jizhou Liu , Fang Q. Hu , Xiaodong Li

This paper presents an optimization technique for the multi-pass face milling process. Genetic algorithm (GA) is used to obtain the optimum cutting parameters by minimizing the unit production cost for a given amount of material removal.…

Computational Engineering, Finance, and Science · Computer Science 2009-02-05 Sourabh Saha

Universal fault-tolerant quantum computers will require error-free execution of long sequences of quantum gate operations, which is expected to involve millions of physical qubits. Before the full power of such machines will be available,…

In this work, we propose and analyze optimization strategies for the VQE algorithm that combine various methods, including molecular point group symmetries (symmetry adaptation), compact excitation circuits (qubit-excitation-based),…

Quantum Physics · Physics 2025-04-30 Konstantin M. Makushin , Aleksey K. Fedorov

The Gromov-Wasserstein distance is a notable extension of optimal transport. In contrast to the classic Wasserstein distance, it solves a quadratic assignment problem that minimizes the pair-wise distance distortion under the transportation…

Machine Learning · Computer Science 2024-04-16 Wei Zhang , Zihao Wang , Jie Fan , Hao Wu , Yong Zhang

New algorithms are devised for finding the maxima of multidimensional point samples, one of the very first problems studied in computational geometry. The algorithms are very simple and easily coded and modified for practical needs. The…

Data Structures and Algorithms · Computer Science 2009-10-09 Wei-Mei Chen , Hsien-Kuei Hwang , Tsung-Hsi Tsai

We present a new algorithm to quickly generate high-performance GPU implementations of complex imaging and vision pipelines, directly from high-level Halide algorithm code. It is fully automatic, requiring no schedule templates or…

Programming Languages · Computer Science 2023-08-29 Luke Anderson , Andrew Adams , Karima Ma , Tzu-Mao Li , Tian Jin , Jonathan Ragan-Kelley