English
Related papers

Related papers: Local to Global Normalization Dynamic by Nonlinear…

200 papers

We propose a novel regularization method, called \textit{volumization}, for neural networks. Inspired by physics, we define a physical volume for the weight parameters in neural networks, and we show that this method is an effective way of…

Machine Learning · Computer Science 2020-04-02 Liu Ziyin , Zihao Wang , Makoto Yamada , Masahito Ueda

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by…

Numerical Analysis · Mathematics 2022-12-14 Yahya Saleh , Armin Iske , Andrey Yachmenev , Jochen Küpper

The aim of this paper is to establish a nonlinear variational approach to the reconstruction of moving density images from indirect dynamic measurements. Our approach is to model the dynamics as a hyperelastic deformation of an initial…

Numerical Analysis · Mathematics 2015-12-01 Martin Burger , Jan Modersitzki , Sebastian Suhr

This paper studies countable systems of linearly and hierarchically interacting diffusions taking values in the positive quadrant. These systems arise in population dynamics for two types of individuals migrating between and interacting…

Probability · Mathematics 2007-09-09 Don A. Dawson , Andreas Greven , Frank den Hollander , Rongfeng Sun , Jan M. Swart

To enhance low-light images to normally-exposed ones is highly ill-posed, namely that the mapping relationship between them is one-to-many. Previous works based on the pixel-wise reconstruction losses and deterministic processes fail to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Yufei Wang , Renjie Wan , Wenhan Yang , Haoliang Li , Lap-Pui Chau , Alex C. Kot

This study focuses on the novel application of a normalizing flow as a method of domain adaptation. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a method of…

Data Analysis, Statistics and Probability · Physics 2024-05-16 Rowan Kelleher , Anselm Vossen

We explain how to use diffusion models to learn inverse renormalization group flows of statistical and quantum field theories. Diffusion models are a class of machine learning models which have been used to generate samples from complex…

High Energy Physics - Theory · Physics 2023-09-07 Jordan Cotler , Semon Rezchikov

Reconstructing noise-driven nonlinear networks from time series of output variables is a challenging problem, which turns to be very difficult when nonlinearity of dynamics, strong noise impacts and low measurement frequencies jointly…

Statistical Mechanics · Physics 2017-10-20 Rundong Shi , Gang Hu , Shihong Wang

Normalization layers have been shown to improve convergence in deep neural networks, and even add useful inductive biases. In many vision applications the local spatial context of the features is important, but most common normalization…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Anthony Ortiz , Caleb Robinson , Dan Morris , Olac Fuentes , Christopher Kiekintveld , Md Mahmudulla Hassan , Nebojsa Jojic

In order to understand the dynamical mechanism of the friction phenomena, we heavily rely on the numerical analysis using various methods: molecular dynamics, Langevin equation, lattice Boltzmann method, Monte Carlo, e.t.c.. We propose a…

High Energy Physics - Theory · Physics 2013-05-28 Shoichi Ichinose

A nonlinear elasticity model for comparing images is formulated and analyzed, in which optimal transformations between images are sought as minimizers of an integral functional. The existence of minimizers in a suitable class of…

Analysis of PDEs · Mathematics 2023-03-21 John M. Ball , Christopher L. Horner

Stochastic resetting models diverse phenomena across numerous scientific disciplines. Current understanding stems from the renewal framework, which relates systems subject to global resetting to their non-resetting counterparts. Yet, in…

Statistical Mechanics · Physics 2021-03-10 Asaf Miron , Shlomi Reuveni

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

A network of locally interacting agents can be thought of as performing a distributed computation. But not all computations can be faithfully distributed. This paper investigates which global, linear transformations can be computed using…

Optimization and Control · Mathematics 2013-11-26 Zak Costello , Magnus Egerstedt

The global existence of renormalised solutions and convergence to equilibrium for reaction-diffusion systems with non-linear diffusion are investigated. The system is assumed to have quasi-positive non-linearities and to satisfy an entropy…

Analysis of PDEs · Mathematics 2021-09-27 Klemens Fellner , Julian Fischer , Michael Kniely , Bao Quoc Tang

Learning neural networks using only few available information is an important ongoing research topic with tremendous potential for applications. In this paper, we introduce a powerful regularizer for the variational modeling of inverse…

Machine Learning · Computer Science 2023-05-17 Fabian Altekrüger , Alexander Denker , Paul Hagemann , Johannes Hertrich , Peter Maass , Gabriele Steidl

This paper introduces a novel direct approach to system identification of dynamic networks with missing data based on maximum likelihood estimation. Dynamic networks generally present a singular probability density function, which poses a…

Systems and Control · Electrical Eng. & Systems 2024-07-31 João Victor Galvão da Mata , Anders Hansson , Martin S. Andersen

In this work, we propose a framework to learn a local regularization model for solving general image restoration problems. This regularizer is defined with a fully convolutional neural network that sees the image through a receptive field…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis