English
Related papers

Related papers: i-DEQ: A stable inertial deep equilibrium model fo…

200 papers

Detection Transformer (DETR) has redefined object detection by casting it as a set prediction task within an end-to-end framework. Despite its elegance, DETR and its variants still rely on fixed learnable queries and suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhengjian Kang , Jun Zhuang , Kangtong Mo , Qi Chen , Rui Liu , Ye Zhang

Product Quantization (PQ) has long been a mainstream for generating an exponentially large codebook at very low memory/time cost. Despite its success, PQ is still tricky for the decomposition of high-dimensional vector space, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Lianli Gao , Xiaosu Zhu , Jingkuan Song , Zhou Zhao , Heng Tao Shen

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

Plug-and-play algorithms constitute a popular framework for solving inverse imaging problems that rely on the implicit definition of an image prior via a denoiser. These algorithms can leverage powerful pre-trained denoisers to solve a wide…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Matthieu Terris , Thomas Moreau , Nelly Pustelnik , Julian Tachella

The image restoration problem is one of the popular topics in image processing studied by many authors on account of its applications in various areas. The aim of this paper is to present a new algorithm by using viscosity approximation…

Functional Analysis · Mathematics 2021-08-12 Ebru ALTIPARMAK , Ibrahim KARAHAN

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in reconstruction quality. Unfortunately, these new methods often lack reliability and explainability, and there is a…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Alexis Goujon , Sebastian Neumayer , Pakshal Bohra , Stanislas Ducotterd , Michael Unser

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

A crucial problem in learning disentangled image representations is controlling the degree of disentanglement during image editing, while preserving the identity of objects. In this work, we propose a simple yet effective model with the…

Machine Learning · Computer Science 2019-12-30 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

In this study, we introduce a unified neural network architecture, the Deep Equilibrium Density Functional Theory Hamiltonian (DEQH) model, which incorporates Deep Equilibrium Models (DEQs) for predicting Density Functional Theory (DFT)…

Machine Learning · Computer Science 2024-10-10 Zun Wang , Chang Liu , Nianlong Zou , He Zhang , Xinran Wei , Lin Huang , Lijun Wu , Bin Shao

Implicit models such as Deep Equilibrium Models (DEQs) have emerged as promising alternative approaches for building deep neural networks. Their certified robustness has gained increasing research attention due to security concerns.…

Machine Learning · Computer Science 2024-11-05 Weizhi Gao , Zhichao Hou , Han Xu , Xiaorui Liu

Neural networks have emerged as powerful surrogates for solving partial differential equations (PDEs), offering significant computational speedups over traditional methods. However, these models suffer from a critical limitation: error…

Machine Learning · Computer Science 2025-12-29 Xinquan Huang , Paris Perdikaris

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Knowledge-Intensive Visual Question Answering (KI-VQA) refers to answering a question about an image whose answer does not lie in the image. This paper presents a new pipeline for KI-VQA tasks, consisting of a retriever and a reader. First,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Alireza Salemi , Juan Altmayer Pizzorno , Hamed Zamani

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras

Deep Equilibrium (DEQ) Models, an emerging class of implicit models that maps inputs to fixed points of neural networks, are of growing interest in the deep learning community. However, training and applying DEQ models is currently done in…

Machine Learning · Computer Science 2023-10-31 Zhengyang Geng , J. Zico Kolter

Uncertainty quantification (UQ) helps to make trustworthy predictions based on collected observations and uncertain domain knowledge. With increased usage of deep learning in various applications, the need for efficient UQ methods that can…

Machine Learning · Computer Science 2021-11-09 Olga Graf , Pablo Flores , Pavlos Protopapas , Karim Pichara

We consider the problem of recovering a signal from nonlinear transformations, under convex constraints modeling a priori information. Standard feasibility and optimization methods are ill-suited to tackle this problem due to the…

Optimization and Control · Mathematics 2020-06-16 Patrick L. Combettes , Zev. C. Woodstock

Solving inverse problems \(Ax = y\) is central to a variety of practically important fields such as medical imaging, remote sensing, and non-destructive testing. The most successful and theoretically best-understood method is convex…

Numerical Analysis · Mathematics 2025-09-23 Daniel Obmann , Gyeongha Hwang , Markus Haltmeier

Inspired by the traditional partial differential equation (PDE) approach for image denoising, we propose a novel neural network architecture, referred as NODE-ImgNet, that combines neural ordinary differential equations (NODEs) with…

Image and Video Processing · Electrical Eng. & Systems 2023-11-07 Xinheng Xie , Yue Wu , Hao Ni , Cuiyu He