English
Related papers

Related papers: NESTANets: Stable, accurate and efficient neural n…

200 papers

Recently, there have been increasing demands to construct compact deep architectures to remove unnecessary redundancy and to improve the inference speed. While many recent works focus on reducing the redundancy by eliminating unneeded…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Eunwoo Kim , Chanho Ahn , Songhwai Oh

In recent years, significant attention has been devoted towards integrating deep learning technologies in the healthcare domain. However, to safely and practically deploy deep learning models for home health monitoring, two significant…

Signal Processing · Electrical Eng. & Systems 2020-01-31 Rahul Duggal , Scott Freitas , Cao Xiao , Duen Horng Chau , Jimeng Sun

Finding model parameters from data is an essential task in science and engineering, from weather and climate forecasts to plasma control. Previous works have employed neural networks to greatly accelerate finding solutions to inverse…

Machine Learning · Computer Science 2024-08-16 Philipp Holl , Nils Thuerey

In supervised continual learning, a deep neural network (DNN) is updated with an ever-growing data stream. Unlike the offline setting where data is shuffled, we cannot make any distributional assumptions about the data stream. Ideally, only…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Ronald Kemker , Christopher Kanan

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

We introduce Neural Optimal Design of Experiments, a learning-based framework for optimal experimental design in inverse problems that avoids classical bilevel optimization and indirect sparsity regularization. NODE jointly trains a neural…

Machine Learning · Computer Science 2026-01-08 John E. Darges , Babak Maboudi Afkham , Matthias Chung

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

Machine Learning · Computer Science 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy

Security assessment is among the most fundamental functions of power system operator. The sheer complexity of power systems exceeding a few buses, however, makes it an extremely computationally demanding task. The emergence of deep learning…

Machine Learning · Computer Science 2019-04-22 José-María Hidalgo-Arteaga , Fiodar Hancharou , Florian Thams , Spyros Chatzivasileiadis

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

Deep learning based reconstruction methods deliver outstanding results for solving inverse problems and are therefore becoming increasingly important. A recently invented class of learning-based reconstruction methods is the so-called NETT…

Numerical Analysis · Mathematics 2021-11-16 Stephan Antholzer , Markus Haltmeier

Automating configuration is the key path to achieving zero-touch network management in ever-complicating mobile networks. Deep learning techniques show great potential to automatically learn and tackle high-dimensional networking problems.…

Networking and Internet Architecture · Computer Science 2023-02-08 Yuru Zhang , Yongjie Xue , Qiang Liu , Nakjung Choi , Tao Han

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

Neural networks are increasingly used as fast surrogate models across various domains, but unconstrained predictions can violate physical, operational, or safety requirements. We propose SnareNet, a feasibility-controlled architecture to…

Machine Learning · Computer Science 2026-05-12 Ya-Chi Chu , Alkiviades Boukas , Madeleine Udell

U-Nets have been established as a standard architecture for image-to-image learning problems such as segmentation and inverse problems in imaging. For large-scale data, as it for example appears in 3D medical imaging, the U-Net however has…

Machine Learning · Computer Science 2020-07-01 Christian Etmann , Rihuan Ke , Carola-Bibiane Schönlieb

The residual neural network (ResNet) is a popular deep network architecture which has the ability to obtain high-accuracy results on several image processing problems. In order to analyze the behavior and structure of ResNet, recent work…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Linan Zhang , Hayden Schaeffer

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

Incorporating prior knowledge or specifications of input-output relationships into machine learning models has attracted significant attention, as it enhances generalization from limited data and yields conforming outputs. However, most…

Machine Learning · Computer Science 2025-10-21 Youngjae Min , Navid Azizan

Stable diffusion models have ushered in a new era of advancements in image generation, currently reigning as the state-of-the-art approach, exhibiting unparalleled performance. The process of diffusion, accompanied by denoising through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Andras Horvath

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett