English
Related papers

Related papers: Revisiting Orbital Minimization Method for Neural …

200 papers

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

Reduced Order Modelling (ROM) has been widely used to create lower order, computationally inexpensive representations of higher-order dynamical systems. Using these representations, ROMs can efficiently model flow fields while using…

Fluid Dynamics · Physics 2021-10-13 Pranshu Pant , Ruchit Doshi , Pranav Bahl , Amir Barati Farimani

In numerous contexts, high-resolution solutions to partial differential equations are required to capture faithfully essential dynamics which occur at small spatiotemporal scales, but these solutions can be very difficult and slow to obtain…

Machine Learning · Computer Science 2024-04-09 Valentin Duruisseaux , Amit Chakraborty

This paper considers decentralized dynamic optimization problems where nodes of a network try to minimize a sequence of time-varying objective functions in a real-time scheme. At each time slot, nodes have access to different summands of an…

Optimization and Control · Mathematics 2016-03-29 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

In this paper, deep neural network (DNN) is integrated with spatial modulation-orthogonal frequency division multiplexing (SM-OFDM) technique for end-to-end data detection over Rayleigh fading channel. This proposed system directly…

Signal Processing · Electrical Eng. & Systems 2021-09-16 Ahmed M. Badi , Taissir Y. Elganimi , Osama A. S. Alkishriwo , Nadia Adem

This paper addresses the challenges of training large neural network models under federated learning settings: high on-device memory usage and communication cost. The proposed Online Model Compression (OMC) provides a framework that stores…

Machine Learning · Computer Science 2022-05-10 Tien-Ju Yang , Yonghui Xiao , Giovanni Motta , Françoise Beaufays , Rajiv Mathews , Mingqing Chen

Variational quantum eigensolver ans\"atze hold considerable promise for ground-state energy calculations on near-term quantum hardware, yet most promising ansatz designs currently strongly depend on how well the molecular orbital basis…

This paper proposes a novel machine-learning approach for predicting AC-OPF solutions that features a fast and scalable training. It is motivated by the two critical considerations: (1) the fact that topology optimization and the…

Machine Learning · Computer Science 2021-01-19 Minas Chatzos , Terrence W. K. Mak , Pascal Van Hentenryck

Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Jianxiu Li , Maxime Ferreira Da Costa , Urbashi Mitra

A numerical framework based on network partition and operator splitting is developed to solve nonlinear differential equations of large-scale dynamic processes encountered in physics, chemistry and biology. Under the assumption that those…

Computational Physics · Physics 2018-01-22 Shucheng Pan , Jianhang Wang , Xiangyu Hu , Nikolaus A. Adams

In this contribution, we generalize the concept of \textit{optimally accurate operators} proposed and used in a series of studies on the simulation of seismic wave propagation, particularly based on Geller \& Takeuchi (1995). Although these…

Geophysics · Physics 2025-05-06 Nobuaki Fuji , Thibault Duretz

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate…

Numerical Analysis · Mathematics 2022-03-02 Davide Papapicco , Nicola Demo , Michele Girfoglio , Giovanni Stabile , Gianluigi Rozza

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing,…

Machine Learning · Computer Science 2024-08-14 Nicholas H. Nelsen , Andrew M. Stuart

We study a family of $H^m$-conforming piecewise polynomials based on artificial neural network, named as the finite neuron method (FNM), for numerical solution of $2m$-th order partial differential equations in $\mathbb{R}^d$ for any $m,d…

Numerical Analysis · Mathematics 2020-12-30 Jinchao Xu

Low-rank decomposition has emerged as an important problem in Large Language Model (LLM) fine-tuning and inference. Through Singular Value Decomposition (SVD), the weight matrix can be factorized into low-rank spaces optimally. Previously,…

Machine Learning · Computer Science 2026-04-02 Yuhang Li , Donghyun Lee , Ruokai Yin , Priyadarshini Panda

This paper proposes a data-driven approach for optimal power flow (OPF) based on the stacked extreme learning machine (SELM) framework. SELM has a fast training speed and does not require the time-consuming parameter tuning process compared…

Systems and Control · Electrical Eng. & Systems 2020-06-02 Xingyu Lei , Zhifang Yang , Juan Yu , Junbo Zhao , Qian Gao , Hongxin Yu

In this paper, we introduce the neural empirical interpolation method (NEIM), a neural network-based alternative to the discrete empirical interpolation method for reducing the time complexity of computing the nonlinear term in a reduced…

Numerical Analysis · Mathematics 2025-05-13 Max Hirsch , Federico Pichi , Jan S. Hesthaven

Mode-based model-reduction is used to reduce the degrees of freedom of high dimensional systems, often by describing the system state by a linear combination of spatial modes. Transport dominated phenomena, ubiquitous in technical and…

Numerical Analysis · Mathematics 2020-02-28 Julius Reiss

With the aim of establishing a framework to efficiently perform the practical application of quantum chemistry simulation on near-term quantum devices, we envision a hybrid quantum--classical framework for leveraging problem decomposition…

Real-time dynamics of quantum observables provide direct access to excitation spectra and correlation functions in quantum many-body systems, but currently available quantum devices are limited to short evolution times due to decoherence.…

Quantum Physics · Physics 2026-03-17 Jinyang Li , Satoshi Iso , Shunji Matsuura , Lingxiao Wang , Xiaoyang Wang