中文
相关论文

相关论文: Deep Equilibrium Models for Video Snapshot Compres…

200 篇论文

We consider the problem of video snapshot compressive imaging (SCI), where sequential high-speed frames are modulated by different masks and captured by a single measurement. The underlying principle of reconstructing multi-frame images…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Siming Zheng , Xin Yuan

Dual-view snapshot compressive imaging (SCI) aims to capture videos from two field-of-views (FoVs) using a 2D sensor (detector) in a single snapshot, achieving joint FoV and temporal compressive sensing, and thus enjoying the advantages of…

图像与视频处理 · 电气工程与系统科学 2021-09-14 Ruiying Lu , Bo Chen , Guanliang Liu , Ziheng Cheng , Mu Qiao , Xin Yuan

Deep equilibrium models (DEQs) have proven to be very powerful for learning data representations. The idea is to replace traditional (explicit) feedforward neural networks with an implicit fixed-point equation, which allows to decouple the…

机器学习 · 计算机科学 2023-04-25 Bac Nguyen , Lukas Mauch

Deep equilibrium networks (DEQs) are a new class of models that eschews traditional depth in favor of finding the fixed point of a single nonlinear layer. These models have been shown to achieve performance competitive with the…

机器学习 · 计算机科学 2021-06-29 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Hyperspectral imaging is one of the most promising techniques for intraoperative tissue characterisation. Snapshot mosaic cameras, which can capture hyperspectral data in a single exposure, have the potential to make a real-time…

图像与视频处理 · 电气工程与系统科学 2021-12-02 Peichao Li , Michael Ebner , Philip Noonan , Conor Horgan , Anisha Bahl , Sebastien Ourselin , Jonathan Shapey , Tom Vercauteren

Snapshot compressive imaging (SCI) systems aim to capture high-dimensional ($\ge3$D) images in a single shot using 2D detectors. SCI devices include two main parts: a hardware encoder and a software decoder. The hardware encoder typically…

图像与视频处理 · 电气工程与系统科学 2020-12-16 Ziyi Meng , Shirin Jalali , Xin Yuan

Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled measurements, thereby reducing scan time. Recently, deep learning has shown great potential for reconstructing high-fidelity images from highly…

图像与视频处理 · 电气工程与系统科学 2025-04-07 Armeet Singh Jatyani , Jiayun Wang , Aditi Chandrashekar , Zihui Wu , Miguel Liu-Schiaffini , Bahareh Tolooshams , Anima Anandkumar

Compressive imaging (CI) reconstruction, such as snapshot compressive imaging (SCI) and compressive sensing magnetic resonance imaging (MRI), aims to recover high-dimensional images from low-dimensional compressed measurements. This process…

图像与视频处理 · 电气工程与系统科学 2025-07-11 Zhenyu Jin , Yisi Luo , Xile Zhao , Deyu Meng

We propose a new class of implicit networks, the multiscale deep equilibrium model (MDEQ), suited to large-scale and highly hierarchical pattern recognition domains. An MDEQ directly solves for and backpropagates through the equilibrium…

机器学习 · 计算机科学 2020-11-25 Shaojie Bai , Vladlen Koltun , J. Zico Kolter

Cascaded computation, whereby predictions are recurrently refined over several stages, has been a persistent theme throughout the development of landmark detection models. In this work, we show that the recently proposed Deep Equilibrium…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Paul Micaelli , Arash Vahdat , Hongxu Yin , Jan Kautz , Pavlo Molchanov

Deep learning has emerged as a powerful tool for solving inverse problems in imaging, including computed tomography (CT). However, most approaches require paired training data with ground truth images, which can be difficult to obtain,…

图像与视频处理 · 电气工程与系统科学 2025-06-25 Tatiana A. Bubba , Matteo Santacesaria , Andrea Sebastiani

Deep Equilibrium Models (DEQs) are a class of implicit neural networks that solve for a fixed point of a neural network in their forward pass. Traditionally, DEQs take sequences as inputs, but have since been applied to a variety of data.…

机器学习 · 计算机科学 2025-03-25 Jonathan Geuter , Clément Bonet , Anna Korba , David Alvarez-Melis

Snapshot compressive imaging (SCI) encodes high-speed scene video into a snapshot measurement and then computationally makes reconstructions, allowing for efficient high-dimensional data acquisition. Numerous algorithms, ranging from…

图像与视频处理 · 电气工程与系统科学 2022-10-19 Honghao Huang , Jiajie Teng , Yu Liang , Chengyang Hu , Minghua Chen , Sigang Yang , Hongwei Chen

Many recent state-of-the-art (SOTA) optical flow models use finite-step recurrent update operations to emulate traditional algorithms by encouraging iterative refinements toward a stable flow estimation. However, these RNNs impose large…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Shaojie Bai , Zhengyang Geng , Yash Savani , J. Zico Kolter

Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in…

图像与视频处理 · 电气工程与系统科学 2021-06-04 Davis Gilton , Gregory Ongie , Rebecca Willett

We apply reinforcement learning to video compressive sensing to adapt the compression ratio. Specifically, video snapshot compressive imaging (SCI), which captures high-speed video using a low-speed camera is considered in this work, in…

计算机视觉与模式识别 · 计算机科学 2021-05-19 Sidi Lu , Xin Yuan , Aggelos K Katsaggelos , Weisong Shi

A deep equilibrium model (DEQ) is implicitly defined through an equilibrium point of an infinite-depth weight-tied model with an input-injection. Instead of infinite computations, it solves an equilibrium point directly with root-finding…

机器学习 · 计算机科学 2023-03-30 Zenan Ling , Xingyu Xie , Qiuhao Wang , Zongpeng Zhang , Zhouchen Lin

Many tasks in deep learning involve optimizing over the \emph{inputs} to a network to minimize or maximize some objective; examples include optimization over latent spaces in a generative model to match a target image, or adversarially…

机器学习 · 计算机科学 2021-11-29 Swaminathan Gurumurthy , Shaojie Bai , Zachary Manchester , J. Zico Kolter

Video snapshot compressive imaging (SCI) captures multiple sequential video frames by a single measurement using the idea of computational imaging. The underlying principle is to modulate high-speed frames through different masks and these…

图像与视频处理 · 电气工程与系统科学 2022-09-09 Lishun Wang , Miao Cao , Yong Zhong , Xin Yuan

Deep Equilibrium Model (DEQ), which serves as a typical implicit neural network, emphasizes their memory efficiency and competitive performance compared to explicit neural networks. However, there has been relatively limited theoretical…

机器学习 · 计算机科学 2024-12-05 Haixiang Sun , Ye Shi