English
Related papers

Related papers: Automatic discovery of optimal meta-solvers via mu…

200 papers

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

Machine Learning · Statistics 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin

Meta-learning has been widely used for implementing few-shot learning and fast model adaptation. One kind of meta-learning methods attempt to learn how to control the gradient descent process in order to make the gradient-based learning…

Machine Learning · Computer Science 2019-11-20 Jialin Liu , Fei Chao , Longzhi Yang , Chih-Min Lin , Qiang Shen

We present a new approach for nonlocal image denoising, based around the application of an unnormalized extended Gaussian ANOVA kernel within a bilevel optimization algorithm. A critical bottleneck when solving such problems for…

Numerical Analysis · Mathematics 2025-05-14 Andrés Miniguano-Trujillo , John W. Pearson , Benjamin D. Goddard

Real-world scenarios frequently involve multi-objective data-driven optimization problems, characterized by unknown problem coefficients and multiple conflicting objectives. Traditional two-stage methods independently apply a machine…

Machine Learning · Computer Science 2024-06-04 Peng Li , Lixia Wu , Chaoqun Feng , Haoyuan Hu , Lei Fu , Jieping Ye

We show that the error achievable using physics-informed neural networks for solving systems of differential equations can be substantially reduced when these networks are trained using meta-learned optimization methods rather than to using…

Machine Learning · Computer Science 2023-03-15 Alex Bihlo

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Electromagnetic multipole expansion theory underpins nanoscale light-matter interactions, particularly within subwavelength meta-atoms, paving the way for diverse and captivating optical phenomena. While conventionally brute force…

This paper presents a unified framework for codifying and automating optimization strategies to efficiently deploy deep neural networks (DNNs) on resource-constrained hardware, such as FPGAs, while maintaining high performance, accuracy,…

Hardware Architecture · Computer Science 2026-02-11 Zhiqiang Que , Jose G. F. Coutinho , Ce Guo , Hongxiang Fan , Wayne Luk

In this paper, we study fast iterative solvers for the solution of fourth order parabolic equations discretized by mixed finite element methods. We propose to use consistent mass matrix in the discretization and use lumped mass matrix to…

Numerical Analysis · Mathematics 2016-02-26 Bin Zheng , Luoping Chen , Xiaozhe Hu , Long Chen , Ricardo H. Nochetto , Jinchao Xu

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Multiphysics problems such as multicomponent diffusion, phase transformations in multiphase systems and alloy solidification involve numerical solution of a coupled system of nonlinear partial differential equations (PDEs). Numerical…

Materials Science · Physics 2022-11-24 Vir Karan , A. Maruthi Indresh , Saswata Bhattacharyya

High-order implicit shock tracking (fitting) is a class of high-order numerical methods that use numerical optimization to simultaneously compute a high-order approximation to a conservation law solution and align elements of the…

Numerical Analysis · Mathematics 2024-06-28 Jakob Vandergrift , Matthew J. Zahr

This paper presents a learnable solver tailored to iteratively solve sparse linear systems from discretized partial differential equations (PDEs). Unlike traditional approaches relying on specialized expertise, our solver streamlines the…

Numerical Analysis · Mathematics 2024-05-10 Yan Xie , Minrui Lv , Chensong Zhang

We introduce the Neural Preconditioning Operator (NPO), a novel approach designed to accelerate Krylov solvers in solving large, sparse linear systems derived from partial differential equations (PDEs). Unlike classical preconditioners that…

Computational Engineering, Finance, and Science · Computer Science 2025-02-10 Zhihao Li , Di Xiao , Zhilu Lai , Wei Wang

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

This paper studies numerical solutions for parameterized partial differential equations (P-PDEs) with deep learning (DL). P-PDEs arise in many important application areas and the computational cost using traditional numerical schemes can be…

Numerical Analysis · Mathematics 2020-11-03 Yuyan Chen , Bin Dong , Jinchao Xu

Multiscale modeling is an effective approach for investigating multiphysics systems with largely disparate size features, where models with different resolutions or heterogeneous descriptions are coupled together for predicting the system's…

Computational Engineering, Finance, and Science · Computer Science 2022-12-07 Minglang Yin , Enrui Zhang , Yue Yu , George Em Karniadakis

In this paper, we introduce a discrete variant of the meta-learning framework. Meta-learning aims at exploiting prior experience and data to improve performance on future tasks. By now, there exist numerous formulations for meta-learning in…

Machine Learning · Computer Science 2021-01-12 Arman Adibi , Aryan Mokhtari , Hamed Hassani

In machine learning, there is a fundamental trade-off between ease of optimization and expressive power. Neural Networks, in particular, have enormous expressive power and yet are notoriously challenging to train. The nature of that…

Machine Learning · Computer Science 2015-11-24 Diogo Almeida , Nate Sauder

In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The…

Optimization and Control · Mathematics 2024-05-08 Spyridon Pougkakiotis , Jacek Gondzio , Dionysis Kalogerias