English
Related papers

Related papers: Linearized Implicit Methods Based on a Single-Laye…

200 papers

Training deep neural networks for scientific computing remains computationally expensive due to the slow formation of diverse feature representations in early training stages. Recent studies identify a staircase phenomenon in training…

Numerical Analysis · Mathematics 2025-07-17 Tao Tang , Jiang Yang , Yuxiang Zhao , Quanhui Zhu

Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which -- when finetuned for…

Machine Learning · Computer Science 2025-08-15 Yuhan Xie , William Cappelletti , Mahsa Shoaran , Pascal Frossard

In this paper we analyze a stochastic interpretation of the one-dimensional parabolic-parabolic Keller-Segel system without cut-off. It involves an original type of McKean-Vlasov interaction kernel. At the particle level, each particle…

Probability · Mathematics 2018-09-07 Denis Talay , Milica Tomasevic

Although implicit-explicit (IMEX) methods for approximating solutions to semilinear parabolic equations are relatively standard, most recent works examine the case of a fully discretized model. We show that by discretizing time only, one…

Analysis of PDEs · Mathematics 2007-05-23 Michael Robinson

When optimizing over-parameterized models, such as deep neural networks, a large set of parameters can achieve zero training error. In such cases, the choice of the optimization algorithm and its respective hyper-parameters introduces…

Machine Learning · Computer Science 2019-12-06 Gauthier Gidel , Francis Bach , Simon Lacoste-Julien

We develop and analyze numerical methods for a stochastic Keller-Segel system perturbed by Stratonovich noise, which models chemotactic behavior under randomly fluctuating environmental conditions. The proposed fully discrete scheme couples…

Numerical Analysis · Mathematics 2025-07-25 Liet Vo

Chemists in search of structure-property relationships face great challenges due to limited high quality, concordant datasets. Machine learning (ML) has significantly advanced predictive capabilities in chemical sciences, but these modern…

Machine Learning · Computer Science 2025-09-18 Yulia Pimonova , Michael G. Taylor , Alice Allen , Ping Yang , Nicholas Lubbers

The Keller-Segel equations are widely used for describing chemotaxis in biology. Recently, a new fully discrete scheme for this model was proposed in [46], mass conservation, positivity and energy decay were proved for the proposed scheme,…

Numerical Analysis · Mathematics 2022-12-16 Wenbin Chen , Qianqian Liu , Jie Shen

In this paper, we investigate a chemotaxis-fluid interaction model governed by the incompressible Navier-Stokes equations coupled with the classical Keller-Segel chemotaxis system. To numerically solve this coupled system, we develop a…

Numerical Analysis · Mathematics 2025-12-01 Chenyang Li , Ping Lin , Haibiao Zheng

Computational fluid dynamics lies at the heart of many issues in science and engineering, but solving the associated partial differential equations remains computationally demanding. With the rise of quantum computing, new approaches have…

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

The Keller-Segel (KS) chemotaxis system is used to describe the overall behavior of a collection of cells under the influence of chemotaxis. However, solving the KS chemotaxis system and generating its aggregation patterns remain…

Numerical Analysis · Mathematics 2025-10-17 Yani Feng , Michael K. Ng , Zhiwen Zhang

We propose a novel algorithm for the task of supervised discriminative distance learning by nonlinearly embedding vectors into a low dimensional Euclidean space. We work in the challenging setting where supervision is with constraints on…

Computer Vision and Pattern Recognition · Computer Science 2015-09-30 Gaurav Sharma , Bernt Schiele

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

Stochastic sampling methods are arguably the most direct and least intrusive means of incorporating parametric uncertainty into numerical simulations of partial differential equations with random inputs. However, to achieve an overall error…

Numerical Analysis · Mathematics 2014-04-09 Hans-Werner van Wyk

We establish new convergence results, in strong topologies, for solutions of the parabolic-parabolic Keller--Segel system in the plane, to the corresponding solutions of the parabolic-elliptic model, as a physical parameter goes to zero.…

Analysis of PDEs · Mathematics 2009-07-17 Piotr Biler , Lorenzo Brandolese

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna Narayanan , Mingyuan Zhou , Xiaoning Qian

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

Photonic neural networks offer a promising alternative to traditional electronic systems for machine learning accelerators due to their low latency and energy efficiency. However, the challenge of implementing the backpropagation algorithm…

Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers,…

Numerical Analysis · Mathematics 2020-12-23 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado