English
Related papers

Related papers: Regularized dynamical parametric approximation of …

200 papers

We consider nonlinear inverse problems arising in the context of parameter identification for parabolic partial differential equations (PDEs). For stable reconstructions, regularization methods such as the iteratively regularized…

Numerical Analysis · Mathematics 2025-07-16 Michael Kartmann , Benedikt Klein , Mario Ohlberger , Thomas Schuster , Stefan Volkwein

Recent work has introduced a simple numerical method for solving partial differential equations (PDEs) with deep neural networks (DNNs). This paper reviews and extends the method while applying it to analyze one of the most fundamental…

Machine Learning · Computer Science 2019-05-14 Craig Michoski , Milos Milosavljevic , Todd Oliver , David Hatch

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

In this paper, we provide a mathematical framework for improving generalization in a class of learning problems which is related to point estimations for modeling of high-dimensional nonlinear functions. In particular, we consider a…

Optimization and Control · Mathematics 2024-12-13 Getachew K. Befekadu

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explicit connection between compressibility and generalization…

Machine Learning · Statistics 2024-02-13 Yijun Wan , Melih Barsbey , Abdellatif Zaidi , Umut Simsekli

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work presents a…

Neural and Evolutionary Computing · Computer Science 2019-08-12 Patrick Spettel , Hans-Georg Beyer

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Finite elasticity problems commonly include material and geometric nonlinearities and are solved using various numerical methods. However, for highly nonlinear problems, achieving convergence is relatively difficult and requires small load…

Numerical Analysis · Mathematics 2018-05-01 Yue Mei , Daniel E. Hurtado , Sanjay Pant , Ankush Aggarwal

Accurately, efficiently, and stably computing complex fluid flows and their evolution near solid boundaries over long horizons remains challenging. Conventional numerical solvers require fine grids and small time steps to resolve near-wall…

Machine Learning · Computer Science 2026-03-18 Chenglin Li , Hang Xu , Jianting Chen , Yanfei Zhang

Subject motion in whole-body dynamic PET introduces inter-frame mismatch and seriously impacts parametric imaging. Traditional non-rigid registration methods are generally computationally intense and time-consuming. Deep learning approaches…

Image and Video Processing · Electrical Eng. & Systems 2022-06-29 Xueqi Guo , Bo Zhou , David Pigg , Bruce Spottiswoode , Michael E. Casey , Chi Liu , Nicha C. Dvornek

In this article, we addressed the numerical solution of a non-linear evolutionary variational inequality, which is encountered in the investigation of quasi-static contact problems. Our study encompasses both the semi-discrete and…

Numerical Analysis · Mathematics 2024-01-05 Kamana Porwal , Tanvi Wadhawan

Optimization problems constrained by partial differential equations (PDEs) naturally arise in scientific computing, as those constraints often model physical systems or the simulation thereof. In an implicitly constrained approach, the…

Optimization and Control · Mathematics 2024-09-17 Akwum Onwunta , Clément W. Royer

This paper focuses on proposing a deep learning initialized iterative method (Int-Deep) for low-dimensional nonlinear partial differential equations (PDEs). The corresponding framework consists of two phases. In the first phase, an…

Numerical Analysis · Mathematics 2020-08-26 Jianguo Huang , Haoqin Wang , Haizhao Yang

In this paper, we present a dynamic non-diagonal regularization for interior point methods. The non-diagonal aspect of this regularization is implicit, since all the off-diagonal elements of the regularization matrices are cancelled out by…

Optimization and Control · Mathematics 2019-02-19 Spyridon Pougkakiotis , Jacek Gondzio

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

Machine Learning · Computer Science 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

While deep learning is successful in a number of applications, it is not yet well understood theoretically. A satisfactory theoretical characterization of deep learning however, is beginning to emerge. It covers the following questions: 1)…

Machine Learning · Computer Science 2019-08-27 Tomaso Poggio , Andrzej Banburski , Qianli Liao