English
Related papers

Related papers: FIRE: Frobenius-Isometry Reinitialization for Bala…

200 papers

We present a statistical learning framework for robust identification of partial differential equations from noisy spatiotemporal data. Extending previous sparse regression approaches for inferring PDE models from simulated data, we address…

Numerical Analysis · Mathematics 2019-07-19 Suryanarayana Maddu , Bevan L. Cheeseman , Ivo F. Sbalzarini , Christian L. Müller

Plasticity-stability dilemma is a main problem for incremental learning, where plasticity is referring to the ability to learn new knowledge, and stability retains the knowledge of previous tasks. Many methods tackle this problem by storing…

Machine Learning · Computer Science 2022-03-16 Guoliang Lin , Hanlu Chu , Hanjiang Lai

Image reconstruction using deep learning algorithms offers improved reconstruction quality and lower reconstruction time than classical compressed sensing and model-based algorithms. Unfortunately, clean and fully sampled ground-truth data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Hemant Kumar Aggarwal , Aniket Pramanik , Maneesh John , Mathews Jacob

Fairness-awareness has emerged as an essential building block for the responsible use of artificial intelligence in real applications. In many cases, inequity in performance is due to the change in distribution over different regions. While…

Machine Learning · Computer Science 2024-02-07 Zhihao Wang , Yiqun Xie , Zhili Li , Xiaowei Jia , Zhe Jiang , Aolin Jia , Shuo Xu

In continual learning, networks confront a trade-off between stability and plasticity when trained on a sequence of tasks. To bolster plasticity without sacrificing stability, we propose a novel training algorithm called LRFR. This approach…

Machine Learning · Computer Science 2023-12-15 Zhenrong Liu , Yang Li , Yi Gong , Yik-Chung Wu

Neural networks (NN) are implemented as sub-grid flame models in a large-eddy simulation of a single-injector liquid-propellant rocket engine with the aim to replace a look-up table approach. The NN training process presents an…

Fluid Dynamics · Physics 2022-01-11 Zeinab Shadram , Tuan M. Nguyen , Athanasios Sideris , William A. Sirignano

Learning from unlabeled and noisy data is one of the grand challenges of machine learning. As such, it has seen a flurry of research with new ideas proposed continuously. In this work, we revisit a classical idea: Stein's Unbiased Risk…

Machine Learning · Statistics 2020-07-24 Christopher A. Metzler , Ali Mousavi , Reinhard Heckel , Richard G. Baraniuk

AI alignment is growing in importance, yet many current approaches learn safety behavior by directly modifying policy parameters, entangling normative constraints with the underlying policy. This often yields opaque, difficult-to-edit…

Machine Learning · Computer Science 2026-03-26 Elias Malomgré , Pieter Simoens

Dynamic model pruning is a recent direction that allows for the inference of a different sub-network for each input sample during deployment. However, current dynamic methods rely on learning a continuous channel gating through…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Sara Elkerdawy , Mostafa Elhoushi , Hong Zhang , Nilanjan Ray

The complex nature of inertial confinement fusion (ICF) experiments results in a very large number of experimental parameters that are only known with limited reliability. These parameters, combined with the myriad physical models that…

Plasma Physics · Physics 2015-06-15 Jim A Gaffney , Dan Clark , Vijay Sonnad , Stephen B Libby

Deploying federated learning (FL) over wireless networks with resource-constrained devices requires balancing between accuracy, energy efficiency, and precision. Prior art on FL often requires devices to train deep neural networks (DNNs)…

Machine Learning · Computer Science 2023-02-06 Minsu Kim , Walid Saad , Mohammad Mozaffari , Merouane Debbah

We present a novel dynamic configuration technique for deep neural networks that permits step-wise energy-accuracy trade-offs during runtime. Our configuration technique adjusts the number of channels in the network dynamically depending on…

Neural and Evolutionary Computing · Computer Science 2016-10-25 Hokchhay Tann , Soheil Hashemi , R. Iris Bahar , Sherief Reda

The optimal reconstruction of cosmic metric perturbations and other signals requires knowledge of their power spectra and other parameters. If these are not known a priori, they have to be measured simultaneously from the same data used for…

Instrumentation and Methods for Astrophysics · Physics 2011-06-02 Torsten Ensslin , Mona Frommert

Directed energy deposition (DED) produces complex thermo-mechanical responses that can lead to distortion and reduced dimensional accuracy of a manufactured part. Thermo-mechanical finite element simulations are widely used to estimate…

Plasticity Loss is an increasingly important phenomenon that refers to the empirical observation that as a neural network is continually trained on a sequence of changing tasks, its ability to adapt to a new task diminishes over time. We…

Machine Learning · Computer Science 2025-09-30 Vivek F. Farias , Adam D. Jozefiak

Inference and learning are commonly cast in terms of optimisation, yet the fundamental constraints governing uncertainty reduction remain unclear. This work presents a first-principles framework inherent to Bayesian updating, termed…

Information Theory · Computer Science 2026-01-22 Takuya Isomura

This paper explores the multifaceted consequences of federated unlearning (FU) with data heterogeneity. We introduce key metrics for FU assessment, concentrating on verification, global stability, and local fairness, and investigate the…

Artificial Intelligence · Computer Science 2024-06-04 Jiaqi Shao , Tao Lin , Xuanyu Cao , Bing Luo

Recent advances in deep reinforcement learning (RL) have achieved strong results on high-dimensional control tasks, but applying RL to reachability problems raises a fundamental mismatch: reachability seeks to maximize the set of states…

Machine Learning · Computer Science 2026-02-18 Oswin So , Eric Yang Yu , Songyuan Zhang , Matthew Cleaveland , Mitchell Black , Chuchu Fan

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs), yet they often fail to achieve accurate convergence in the H1 norm, especially in the presence of boundary…

Numerical Analysis · Mathematics 2026-01-22 Qixuan Zhou , Chuqi Chen , Tao Luo , Yang Xiang

Imperfections in X-ray imaging systems can limit their performance, especially in High Energy Density (HED) or Inertial Fusion Energy (IFE)-relevant experiments that are typically single shot, by introducing structured, non-stationary…