English
Related papers

Related papers: Minimal residual multistep methods for large stiff…

200 papers

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

We show that it is possible to obtain a linear computational cost FEM-based solver for non-stationary Stokes and Navier-Stokes equations. Our method employs a technique developed by Guermond and Minev, which consists of singular…

Numerical Analysis · Mathematics 2020-12-17 Marcin Los , Ignacio Muga , Judit Munoz-Matute , Maciej Paszynski

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

Optimization and Control · Mathematics 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

The random feature method (RFM) has demonstrated great potential in bridging traditional numerical methods and machine learning techniques for solving partial differential equations (PDEs). It retains the advantages of mesh-free approaches…

Numerical Analysis · Mathematics 2025-05-02 Mikhail Kuvakin , Zijian Mei , Jingrun Chen

We consider large-scale Markov decision processes (MDPs) with parameter uncertainty, under the robust MDP paradigm. Previous studies showed that robust MDPs, based on a minimax approach to handle uncertainty, can be solved using dynamic…

Machine Learning · Computer Science 2013-06-27 Aviv Tamar , Huan Xu , Shie Mannor

We prove the existence of explicit linear multistep methods of any order with positive coefficients. Our approach is based on formulating a linear programming problem and establishing infeasibility of the dual problem. This yields a number…

Numerical Analysis · Mathematics 2016-04-07 Adrián Németh , David Ketcheson

This paper addresses the problem of planning under uncertainty in large Markov Decision Processes (MDPs). Factored MDPs represent a complex state space using state variables and the transition model using a dynamic Bayesian network. This…

Artificial Intelligence · Computer Science 2011-06-10 C. Guestrin , D. Koller , R. Parr , S. Venkataraman

Bilinear matrix inequality (BMI) problems in system and control designs are investigated in this paper. A solution method of reduction of variables (MRVs) is proposed. This method consists of a principle of variable classification, a…

Systems and Control · Electrical Eng. & Systems 2026-01-16 Wei-Yu Chiu

A review of the most popular Linear Multistep (LM) Methods for solving Ordinary Differential Equations numerically is presented. These methods are first derived from first principles, and are discussed in terms of their order, consistency,…

Numerical Analysis · Mathematics 2008-10-29 Nikesh S. Dattani

Stabilized explicit methods are particularly efficient for large systems of stiff stochastic differential equations (SDEs) due to their extended stability domain. However, they loose their efficiency when a severe stiffness is induced by…

Numerical Analysis · Mathematics 2021-08-13 Assyr Abdulle , Giacomo Rosilho de Souza

We provide a new theoretical framework for the variable-step deferred correction (DC) methods based on the well-known BDF2 formula. By using the discrete orthogonal convolution kernels, some high-order BDF2-DC methods are proven to be…

Numerical Analysis · Mathematics 2024-02-12 Jiahe Yue , Hong-lin Liao , Nan Liu

Multimodal Large Models (MLLMs) have achieved remarkable progress in vision-language understanding and generation tasks. However, existing MLLMs typically rely on static modality fusion strategies, which treat all modalities equally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hiroshi Tanaka , Anika Rao , Hana Satou , Michael Johnson , Sofia García

Linear multistep methods (LMMs) applied to approximate the solution of initial value problems---typically arising from method-of-lines semidiscretizations of partial differential equations---are often required to have certain monotonicity…

Numerical Analysis · Mathematics 2017-05-30 Lajos Lóczi

Variable steps implicit-explicit multistep methods for PDEs have been presented in [17], where the zero-stability is studied for ODEs; however, the stability analysis still remains an open question for PDEs. Based on the idea of linear…

Numerical Analysis · Mathematics 2021-08-09 Minghua Chen , Fan Yu , Qingdong Zhang

In this paper, by designing a normalized nonmonotone search strategy with the Barzilai--Borwein-type step-size, a novel local minimax method (LMM), which is a globally convergent iterative method, is proposed and analyzed to find multiple…

Numerical Analysis · Mathematics 2024-04-16 Wei Liu , Ziqing Xie , Wenfan Yi

Block majorization-minimization (BMM) is a simple iterative algorithm for nonconvex optimization that sequentially minimizes a majorizing surrogate of the objective function in each block coordinate while the other block coordinates are…

Optimization and Control · Mathematics 2026-03-10 Yuchen Li , Laura Balzano , Deanna Needell , Hanbaek Lyu

Many large-scale optimization problems arising in science and engineering are naturally defined at multiple levels of discretization or model fidelity. Multilevel methods exploit this hierarchy to accelerate convergence by combining coarse-…

Optimization and Control · Mathematics 2025-12-02 Robert Baraldi , Michael Hintermüller , Qi Wang

In many applications, the governing PDE to be solved numerically contains a stiff component. When this component is linear, an implicit time stepping method that is unencumbered by stability restrictions is often preferred. On the other…

Numerical Analysis · Mathematics 2021-04-27 Kevin Chow , Steven J. Ruuth

In this effort we propose a data-driven learning framework for reduced order modeling of fluid dynamics. Designing accurate and efficient reduced order models for nonlinear fluid dynamic problems is challenging for many practical…

Computational Physics · Physics 2018-12-05 Xuping Xie , Guannan Zhang , Clayton G. Webster