English
Related papers

Related papers: Lipschitz Multiscale Deep Equilibrium Models: A Th…

200 papers

Implicit deep learning has recently gained popularity with applications ranging from meta-learning to Deep Equilibrium Networks (DEQs). In its general formulation, it relies on expressing some components of deep learning pipelines…

Machine Learning · Computer Science 2023-05-25 Zaccharie Ramzi , Pierre Ablin , Gabriel Peyré , Thomas Moreau

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

Machine Learning · Computer Science 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

Empirical fixation densities, spatial distributions estimated from human eye-tracking data, are foundational to saliency benchmarking. They directly shape benchmark conclusions, leaderboard rankings, failure case analyses, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Susmit Agrawal , Jannis Hollman , Matthias Kümmerer

Implicit equilibrium models, i.e., deep neural networks (DNNs) defined by implicit equations, have been becoming more and more attractive recently. In this paper, we investigate an emerging question: can an implicit equilibrium model's…

Machine Learning · Computer Science 2021-06-08 Xingyu Xie , Qiuhao Wang , Zenan Ling , Xia Li , Yisen Wang , Guangcan Liu , Zhouchen Lin

Neural networks commonly execute on hardware accelerators such as NPUs and GPUs for their size and computation overhead. These accelerators are costly and it is hard to scale their resources to handle real-time workload fluctuations. We…

Machine Learning · Computer Science 2025-10-06 Jaemin Kim , Hongjun Um , Sungkyun Kim , Yongjun Park , Jiwon Seo

Estimating the global Lipschitz constant of neural networks is crucial for understanding and improving their robustness and generalization capabilities. However, precise calculations are NP-hard, and current semidefinite programming (SDP)…

Machine Learning · Computer Science 2026-01-12 Haoqi He , Yan Xiao , Wenzhi Xu , Ruoying Liu , Xiaokai Lin , Kai Wen

We study the behavior of deterministic methods for solving inverse problems in imaging. These methods are commonly designed to achieve two goals: (1) attaining high perceptual quality, and (2) generating reconstructions that are consistent…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Guy Ohayon , Tomer Michaeli , Michael Elad

Image quality remains a key problem for both traditional and deep learning (DL)-based approaches to retinal image analysis, but identifying poor quality images can be time consuming and subjective. Thus, automated methods for retinal image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Justin Engelmann , Amos Storkey , Miguel O. Bernabeu

The Lipschitz constant is a key measure for certifying the robustness of neural networks to input perturbations. However, computing the exact constant is NP-hard, and standard approaches to estimate the Lipschitz constant involve solving a…

Machine Learning · Computer Science 2026-04-14 Yuezhu Xu , S. Sivaranjani

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

Bilevel optimization offers a methodology to learn hyperparameters in imaging inverse problems, yet its integration with automatic differentiation techniques remains challenging. On the one hand, inverse problems are typically solved by…

Optimization and Control · Mathematics 2025-06-17 Leo Davy , Luis M. Briceno-Arias , N. Pustelnik

Deformable medical image registration is traditionally formulated as an optimization problem. While classical methods solve this problem iteratively, recent learning-based approaches use recurrent neural networks (RNNs) to mimic this…

Image and Video Processing · Electrical Eng. & Systems 2025-07-09 Yi Zhang , Yidong Zhao , Qian Tao

Optical microscopy is one of the most widely used techniques in research studies for life sciences and biomedicine. These applications require reliable experimental pipelines to extract valuable knowledge from the measured samples and must…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Elena Corbetta , Thomas Bocklitz

The Lipschitz constant plays a crucial role in certifying the robustness of neural networks to input perturbations. Since calculating the exact Lipschitz constant is NP-hard, efforts have been made to obtain tight upper bounds on the…

Machine Learning · Computer Science 2024-10-30 Yuezhu Xu , S. Sivaranjani

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

Deepfake detection has become a fundamental component of modern media forensics. Despite significant progress in detection accuracy, most existing methods remain computationally intensive and parameter-heavy, limiting their deployment on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xiangyu Li , Yujing Sun , Yuhang Zheng , Yuexin Ma , Kwok-Yan Lam

Estimating redshift is a central task in astrophysics, but its measurement is costly and time-consuming. In addition, current image-based methods are often validated on homogeneous datasets. The development and comparison of networks able…

Instrumentation and Methods for Astrophysics · Physics 2026-03-17 Alessandro Meroni , Nicolò Oreste Pinciroli Vago , Piero Fraternali

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

We introduce a novel matching algorithm, called DeepMatching, to compute dense correspondences between images. DeepMatching relies on a hierarchical, multi-layer, correlational architecture designed for matching images and was inspired by…

Computer Vision and Pattern Recognition · Computer Science 2015-10-12 Jerome Revaud , Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid