English
Related papers

Related papers: Deep Optics for Video Snapshot Compressive Imaging

200 papers

We introduce a novel video-rate hyperspectral imager with high spatial, and temporal resolutions. Our key hypothesis is that spectral profiles of pixels in a super-pixel of an oversegmented image tend to be very similar. Hence, a…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Vishwanath Saragadam , Michael DeZeeuw , Richard Baraniuk , Ashok Veeraraghavan , Aswin Sankaranarayanan

Hyperspectral image (HSI) reconstruction aims to recover the 3D spatial-spectral signal from a 2D measurement in the coded aperture snapshot spectral imaging (CASSI) system. The HSI representations are highly similar and correlated across…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Yuanhao Cai , Jing Lin , Xiaowan Hu , Haoqian Wang , Xin Yuan , Yulun Zhang , Radu Timofte , Luc Van Gool

Existing image compressed sensing (CS) coding frameworks usually solve an inverse problem based on measurement coding and optimization-based image reconstruction, which still exist the following two challenges: 1) The widely used random…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Wenxue Cui , Xingtao Wang , Xiaopeng Fan , Shaohui Liu , Xinwei Gao , Debin Zhao

We propose DeepMultiCap, a novel method for multi-person performance capture using sparse multi-view cameras. Our method can capture time varying surface details without the need of using pre-scanned template models. To tackle with the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Yang Zheng , Ruizhi Shao , Yuxiang Zhang , Tao Yu , Zerong Zheng , Qionghai Dai , Yebin Liu

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

Existing low-light image enhancement techniques are mostly not only difficult to deal with both visual quality and computational efficiency but also commonly invalid in unknown complex scenarios. In this paper, we develop a new…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Long Ma , Tengyu Ma , Risheng Liu , Xin Fan , Zhongxuan Luo

We present a new effective way for performance capture of deforming meshes with fine-scale time-varying surface detail from multi-view video. Our method builds up on coarse 4D surface reconstructions, as obtained with commonly used…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Nadia Robertini , Edilson De Aguiar , Thomas Helten , Christian Theobalt

With joint learning of sampling and recovery, the deep learning-based compressive sensing (DCS) has shown significant improvement in performance and running time reduction. Its reconstructed image, however, losses high-frequency content…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Thuong Nguyen Canh , Byeungwoo Jeon

A blind compressive sensing algorithm is proposed to reconstruct hyperspectral images from spectrally-compressed measurements.The wavelength-dependent data are coded and then superposed, mapping the three-dimensional hyperspectral datacube…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Xin Yuan , Tsung-Han Tsai , Ruoyu Zhu , Patrick Llull , David Brady , Lawrence Carin

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

Human performance capture is a highly important computer vision problem with many applications in movie production and virtual/augmented reality. Many previous performance capture approaches either required expensive multi-view setups or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

Recently, deep learning methods have made a significant improvement in compressive sensing image reconstruction task. In the existing methods, the scene is measured block by block due to the high computational complexity. This results in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Jiang Du , Xuemei Xie , Chenye Wang , Guangming Shi , Xun Xu , Yuxiang Wang

Occlusion is a common issue in 3D reconstruction from RGB-D videos, often blocking the complete reconstruction of objects and presenting an ongoing problem. In this paper, we propose a novel framework, empowered by a 2D diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yubin Hu , Sheng Ye , Wang Zhao , Matthieu Lin , Yuze He , Yu-Hui Wen , Ying He , Yong-Jin Liu

Most deep network methods for compressive sensing reconstruction suffer from the black-box characteristic of DNN. In this paper, a deep neural network with interpretable motion estimation named CSMCNet is proposed. The network is able to…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Bowen Huang , Xiao Yan , Jinjia Zhou , Yibo Fan

Reconstructing the 3D shape of a deformable environment from the information captured by a moving depth camera is highly relevant to surgery. The underlying challenge is the fact that simultaneously estimating camera motion and tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Guido Caccianiga , Julian Nubert , Cesar Cadena , Marco Hutter , Katherine J. Kuchenbecker

Compressive sensing (CS) works to acquire measurements at sub-Nyquist rate and recover the scene images. Existing CS methods always recover the scene images in pixel level. This causes the smoothness of recovered images and lack of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Jiang Du , Xuemei Xie , Chenye Wang , Guangming Shi

Compressed sensing (CS) is a sampling theory that allows reconstruction of sparse (or compressible) signals from an incomplete number of measurements, using of a sensing mechanism implemented by an appropriate projection matrix. The CS…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Duc Minh Nguyen , Evaggelia Tsiligianni , Nikos Deligiannis

This paper describes a coded aperture and keyed exposure approach to compressive video measurement which admits a small physical platform, high photon efficiency, high temporal resolution, and fast reconstruction algorithms. The proposed…

Information Theory · Computer Science 2013-06-27 Zachary T. Harmany , Roummel F. Marcia , Rebecca M. Willett

Deep network-based image and video Compressive Sensing(CS) has attracted increasing attentions in recent years. However, in the existing deep network-based CS methods, a simple stacked convolutional network is usually adopted, which not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Tong Zhang , Wenxue Cui , Chen Hui , Feng Jiang

Massive collection and explosive growth of biomedical data, demands effective compression for efficient storage, transmission and sharing. Readily available visual data compression techniques have been studied extensively but tailored for…

Image and Video Processing · Electrical Eng. & Systems 2022-11-24 Runzhao Yang , Tingxiong Xiao , Yuxiao Cheng , Qianni Cao , Jinyuan Qu , Jinli Suo , Qionghai Dai