English
Related papers

Related papers: Evolutionary Discovery of Sequence Acceleration Me…

200 papers

This paper presents a novel method for accelerating path planning tasks in unknown scenes with obstacles by utilizing Wasserstein Generative Adversarial Networks (WGANs) with Gradient Penalty (GP) to approximate the distribution of the free…

Robotics · Computer Science 2023-06-19 Jorge Ocampo Jimenez , Wael Suleiman

We present GERN, a novel scalable framework for training GNNs in node classification tasks, based on effective resistance, a standard tool in spectral graph theory. Our method progressively refines the GNN weights on a sequence of random…

Machine Learning · Computer Science 2025-02-25 Francesco Bonchi , Claudio Gentile , Francesco Paolo Nerini , André Panisson , Fabio Vitale

Several applications of spectral methods to problems related to the relativistic astrophysics of compact objects are presented. Based on a proper definition of the analytical properties of regular tensorial functions we have developed a…

General Relativity and Quantum Cosmology · Physics 2007-05-23 S. Bonazzola , J. Frieben , E. Gourgoulhon , J. A. Marck

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

A novel algorithm is proposed to solve the sample-based optimal transport problem. An adversarial formulation of the push-forward condition uses a test function built as a convolution between an adaptive kernel and an evolving probability…

Machine Learning · Statistics 2020-06-11 Daeyoung Kim , Esteban G. Tabak

The computation of tunes and matched beam distributions are essential steps in the analysis of circular accelerators. If certain symmetries - like midplane symmetrie - are present, then it is possible to treat the betatron motion in the…

Mathematical Physics · Physics 2013-07-17 Christian Baumgarten

In this paper, we present a novel method for dynamically expanding Convolutional Neural Networks (CNNs) during training, aimed at meeting the increasing demand for efficient and sustainable deep learning models. Our approach, drawing from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Blaise Appolinary , Alex Deaconu , Sophia Yang , Qingze , Li

Knotted molecules occur naturally and are designed by scientists to gain special biological and material properties. Understanding and utilizing knotting require efficient methods to recognize and generate knotted structures, which are…

Computational Physics · Physics 2025-01-23 Zhiyu Zhang , Yongjian Zhu , Liang Dai

In this paper, we study deep neural networks (DNNs) for solving high-dimensional evolution equations with oscillatory solutions. Different from deep least-squares methods that deal with time and space variables simultaneously, we propose a…

Numerical Analysis · Mathematics 2022-06-01 Yiqi Gu , Micheal K. Ng

As more and more numerical and analytical solutions to the linear neutron transport equation become available, verification of numerical results is increasingly important. This presentation concerns the development of another benchmark for…

Computational Physics · Physics 2024-06-21 Barry Ganapol

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Evolutionary symbolic regression approaches are powerful tools that can approximate an explicit mapping between input features and observation for various problems. However, ensuring that explored expressions maintain consistency with…

Optimization and Control · Mathematics 2024-11-19 Maximilian Reissmann , Yuan Fang , Andrew Ooi , Richard Sandberg

We propose Acc-Sinkhorn, a simple accelerated variant of Sinkhorn for entropy-regularized optimal transport (EOT). The method is derived from a bilevel optimization view: Sinkhorn row scaling solves the inner variable $u$ exactly and…

Optimization and Control · Mathematics 2026-05-29 Zeyi Xu , Long Chen

Machine learning problems such as neural network training, tensor decomposition, and matrix factorization, require local minimization of a nonconvex function. This local minimization is challenged by the presence of saddle points, of which…

Optimization and Control · Mathematics 2018-07-23 Santiago Paternain , Aryan Mokhtari , Alejandro Ribeiro

Solving symmetric positive semidefinite linear systems is an essential task in many scientific computing problems. While Jacobi-type methods, including the classical Jacobi method and the weighted Jacobi method, exhibit simplicity in their…

Optimization and Control · Mathematics 2025-10-16 Ling Liang , Qiyuan Pang , Kim-Chuan Toh , Haizhao Yang

We propose a new algorithm for minimizing regularized empirical loss: Stochastic Dual Newton Ascent (SDNA). Our method is dual in nature: in each iteration we update a random subset of the dual variables. However, unlike existing methods…

Machine Learning · Computer Science 2015-02-10 Zheng Qu , Peter Richtárik , Martin Takáč , Olivier Fercoq

We propose the complex-plane generalization of a powerful algebraic sequence acceleration algorithm, the Method of Weighted Averages (MWA), to guarantee exponential-cum-algebraic convergence of Fourier and Fourier-Hankel (F-H) integral…

Computational Physics · Physics 2016-02-17 Kamalesh Sainath , Fernando Teixeira , Burkay Donderici

A computational framework that leverages data from self-consistent field theory simulations with deep learning to accelerate the exploration of parameter space for block copolymers is presented. This is a substantial two-dimensional…

Materials Science · Physics 2023-07-04 Yao Xuan , Kris T. Delaney , Hector D. Ceniceros , Glenn H. Fredrickson

We present a novel approach to accelerate iterative methods to solve nonlinear Schr\"odinger eigenvalue problems using neural networks. Nonlinear eigenvector problems are fundamental in quantum mechanics and other fields, yet conventional…

Numerical Analysis · Mathematics 2025-07-23 Daniel Peterseim , Jan-F. Pietschmann , Jonas Püschel , Kilian Ruess

We study a class of monotone inclusions called "self-concordant inclusion" which covers three fundamental convex optimization formulations as special cases. We develop a new generalized Newton-type framework to solve this inclusion. Our…

Optimization and Control · Mathematics 2017-07-25 Quoc Tran-Dinh , Tianxiao Sun , Shu Lu