中文
相关论文

相关论文: Self-Supervised Deep Equilibrium Models for Invers…

200 篇论文

Deep Equilibrium Models (DEQs) are an interesting class of implicit model where the model output is implicitly defined as the fixed point of a learned function. These models have been shown to outperform explicit (fixed-depth) models in…

机器学习 · 计算机科学 2025-12-04 Sam McCallum , Kamran Arora , James Foster

Equivariant imaging (EI) enables training signal reconstruction models without requiring ground truth data by leveraging signal symmetries. Deep equilibrium models (DEQs) are a powerful class of neural networks where the output is a fixed…

图像与视频处理 · 电气工程与系统科学 2025-11-25 Alexander Mehta , Ruangrawee Kitichotkul , Vivek K Goyal , Julián Tachella

Deep learning has emerged as a powerful tool for solving inverse problems in imaging, including computed tomography (CT). However, most approaches require paired training data with ground truth images, which can be difficult to obtain,…

图像与视频处理 · 电气工程与系统科学 2025-06-25 Tatiana A. Bubba , Matteo Santacesaria , Andrea Sebastiani

We present a new approach to modeling sequential data: the deep equilibrium model (DEQ). Motivated by an observation that the hidden layers of many existing deep sequence models converge towards some fixed point, we propose the DEQ approach…

机器学习 · 计算机科学 2019-10-30 Shaojie Bai , J. Zico Kolter , Vladlen Koltun

Deep Equilibrium Model (DEQ), which serves as a typical implicit neural network, emphasizes their memory efficiency and competitive performance compared to explicit neural networks. However, there has been relatively limited theoretical…

机器学习 · 计算机科学 2024-12-05 Haixiang Sun , Ye Shi

Deep Equilibrium Models (DEQs) are an established framework for image restoration that learn a problem-adapted regularization by solving a fixed-point (i.e. equilibrium) problem. While flexible and expressive, DEQs are often hindered by…

最优化与控制 · 数学 2026-05-20 Antonin Clerc , Marien Renaud , Baudouin Denis De Seneville , Nicolas Papadakis

Hyperspectral unmixing (HU) is crucial for analyzing hyperspectral imagery, yet achieving accurate unmixing remains challenging. While traditional methods struggle to effectively model complex spectral-spatial features, deep learning…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Chentong Wang , Jincheng Gao , Fei Zhu , Jie Chen

A deep equilibrium model (DEQ) is implicitly defined through an equilibrium point of an infinite-depth weight-tied model with an input-injection. Instead of infinite computations, it solves an equilibrium point directly with root-finding…

机器学习 · 计算机科学 2023-03-30 Zenan Ling , Xingyu Xie , Qiuhao Wang , Zongpeng Zhang , Zhouchen Lin

We propose a new class of implicit networks, the multiscale deep equilibrium model (MDEQ), suited to large-scale and highly hierarchical pattern recognition domains. An MDEQ directly solves for and backpropagates through the equilibrium…

机器学习 · 计算机科学 2020-11-25 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Deep Equilibrium Models (DEQs) have emerged as a powerful paradigm in deep learning, offering the ability to model infinite-depth networks with constant memory usage. However, DEQs incur significant inference latency due to the iterative…

机器学习 · 计算机科学 2026-02-04 Junchao Lin , Zenan Ling , Jingwen Xu , Robert C. Qiu

The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data has led to an inverse problem, which consists of recovering the HD signal from the compressed and noisy measurement. While…

图像与视频处理 · 电气工程与系统科学 2023-03-01 Yaping Zhao , Siming Zheng , Xin Yuan

Deep equilibrium models (DEQs) achieve infinitely deep network representations without stacking layers by exploring fixed points of layer transformations in neural networks. Such models constitute an innovative approach that achieves…

机器学习 · 计算机科学 2026-02-04 Naoki Sato , Hideaki Iiduka

Deep Equilibrium Models (DEQs) are implicit neural networks with fixed points, which have recently gained attention for learning image regularization functionals, particularly in settings involving Gaussian fidelities, where assumptions on…

最优化与控制 · 数学 2025-11-19 Christian Daniele , Silvia Villa , Samuel Vaiter , Luca Calatroni

Deep Equilibrium Models (DEQs) are a class of implicit neural networks that solve for a fixed point of a neural network in their forward pass. Traditionally, DEQs take sequences as inputs, but have since been applied to a variety of data.…

机器学习 · 计算机科学 2025-03-25 Jonathan Geuter , Clément Bonet , Anna Korba , David Alvarez-Melis

Deep equilibrium networks (DEQs) are a new class of models that eschews traditional depth in favor of finding the fixed point of a single nonlinear layer. These models have been shown to achieve performance competitive with the…

机器学习 · 计算机科学 2021-06-29 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Implicit deep learning has recently gained popularity with applications ranging from meta-learning to Deep Equilibrium Networks (DEQs). In its general formulation, it relies on expressing some components of deep learning pipelines…

机器学习 · 计算机科学 2023-05-25 Zaccharie Ramzi , Pierre Ablin , Gabriel Peyré , Thomas Moreau

Magnetic particle imaging (MPI) offers unparalleled contrast and resolution for tracing magnetic nanoparticles. A common imaging procedure calibrates a system matrix (SM) that is used to reconstruct data from subsequent scans. The ill-posed…

图像与视频处理 · 电气工程与系统科学 2023-09-07 Alper Güngör , Baris Askin , Damla Alptekin Soydan , Can Barış Top , Emine Ulku Saritas , Tolga Çukur

Deep equilibrium models (DEQs) have proven to be very powerful for learning data representations. The idea is to replace traditional (explicit) feedforward neural networks with an implicit fixed-point equation, which allows to decouple the…

机器学习 · 计算机科学 2023-04-25 Bac Nguyen , Lukas Mauch

Deep equilibrium (DEQ) models are widely recognized as a memory efficient alternative to standard neural networks, achieving state-of-the-art performance in language modeling and computer vision tasks. These models solve a fixed point…

机器学习 · 计算机科学 2024-06-25 Mateusz Gabor , Tomasz Piotrowski , Renato L. G. Cavalcante

Deep equilibrium models (DEQs) refrain from the traditional layer-stacking paradigm and turn to find the fixed point of a single layer. DEQs have achieved promising performance on different applications with featured memory efficiency. At…

机器学习 · 计算机科学 2023-06-05 Zonghan Yang , Tianyu Pang , Yang Liu
‹ 上一页 1 2 3 10 下一页 ›