English
Related papers

Related papers: A Variational Framework for Residual-Based Adaptiv…

200 papers

This paper proposes a deep learning architecture based on Residual Network that dynamically adjusts the number of executed layers for the regions of the image. This architecture is end-to-end trainable, deterministic and problem-agnostic.…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Michael Figurnov , Maxwell D. Collins , Yukun Zhu , Li Zhang , Jonathan Huang , Dmitry Vetrov , Ruslan Salakhutdinov

We consider finite element discretizations of Maxwell's equations coupled with a non-local hydrodynamic Drude model that accurately accounts for electron motions in metallic nanostructures. Specifically, we focus on a posteriori error…

Numerical Analysis · Mathematics 2021-08-04 T. Chaumont-Frelet , S. Lanteri , P. Vega

Reinforcement learning with verifiable rewards (RLVR) has become a highly effective method for improving the reasoning abilities of Large Language Models (LLMs). Recent research shows that Negative Sample Reinforcement (NSR) -- which…

Machine Learning · Computer Science 2026-05-11 Yash Ingle , Jaival Chauhan , Ankit Yadav , Sudhakar Mishra

Training machine learning interatomic potentials often requires optimizing a loss function composed of three variables: potential energies, forces, and stress. The contribution of each variable to the total loss is typically weighted using…

Computational Physics · Physics 2024-03-29 Daniel Ocampo , Daniela Posso , Reza Namakian , Wei Gao

We present an adaptive algorithm for effectively solving rough differential equations (RDEs) using the log-ODE method. The algorithm is based on an error representation formula that accurately describes the contribution of local errors to…

Numerical Analysis · Mathematics 2023-07-25 Christian Bayer , Simon Breneis , Terry Lyons

In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution…

Machine Learning · Computer Science 2019-08-26 Tao Li , Quanyan Zhu

Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE methods. We first show that a residual block of layers in…

Computation and Language · Computer Science 2022-04-13 Bei Li , Quan Du , Tao Zhou , Yi Jing , Shuhan Zhou , Xin Zeng , Tong Xiao , JingBo Zhu , Xuebo Liu , Min Zhang

We present a convolutional framework which significantly reduces the complexity and thus, the computational effort for distributed reinforcement learning control of dynamical systems governed by partial differential equations (PDEs).…

Machine Learning · Computer Science 2023-12-27 Sebastian Peitz , Jan Stenner , Vikas Chidananda , Oliver Wallscheid , Steven L. Brunton , Kunihiko Taira

In this paper, we explore adaptive inference based on variational Bayes. Although several studies have been conducted to analyze the contraction properties of variational posteriors, there is still a lack of a general and computationally…

Statistics Theory · Mathematics 2024-03-12 Ilsang Ohn , Lizhen Lin

We present a variational multi-label segmentation algorithm based on a robust Huber loss for both the data and the regularizer, minimized within a convex optimization framework. We introduce a novel constraint on the common areas, to bias…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Byung-Woo Hong , Ja-Keoung Koo , Stefano Soatto

The multiscale complexity of modern problems in computational science and engineering can prohibit the use of traditional numerical methods in multi-dimensional simulations. Therefore, novel algorithms are required in these situations to…

Numerical Analysis · Mathematics 2021-06-15 Cale Harnish , Luke Dalessandro , Karel Matous , Daniel Livescu

We develop all of the components needed to construct an adaptive finite element code that can be used to approximate fractional partial differential equations, on non-trivial domains in $d\geq 1$ dimensions. Our main approach consists of…

Numerical Analysis · Mathematics 2018-02-14 Mark Ainsworth , Christian Glusa

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

This paper proposes an adaptive neural-compilation framework to address the problem of efficient program learning. Traditional code optimisation strategies used in compilers are based on applying pre-specified set of transformations that…

Artificial Intelligence · Computer Science 2016-05-27 Rudy Bunel , Alban Desmaison , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

We introduce an $r-$adaptive algorithm to solve Partial Differential Equations using a Deep Neural Network. The proposed method restricts to tensor product meshes and optimizes the boundary node locations in one dimension, from which we…

Numerical Analysis · Mathematics 2022-10-21 Ángel J. Omella , David Pardo

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

A general adaptive refinement strategy for solving linear elliptic partial differential equation with random data is proposed and analysed herein. The adaptive strategy extends the a posteriori error estimation framework introduced by…

Numerical Analysis · Mathematics 2022-08-23 Alex Bespalov , David Silvester , Feng Xu

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on…

Machine Learning · Statistics 2026-02-16 Oscar Clivio , Avi Feller , Chris Holmes

Physical dynamical systems can be viewed as natural information processors: their systems preserve, transform, and disperse input information. This perspective motivates learning not only from data generated by such systems, but also how to…

Machine Learning · Computer Science 2026-03-05 Felix Köster , Atsushi Uchida