English
Related papers

Related papers: Event-Enhanced Snapshot Compressive Videography at…

200 papers

Compressive sensing (CS) is a new approach for the acquisition and recovery of sparse signals and images that enables sampling rates significantly below the classical Nyquist rate. Despite significant progress in the theory and methods of…

Computer Vision and Pattern Recognition · Computer Science 2013-06-27 Aswin C Sankaranarayanan , Pavan K Turaga , Rama Chellappa , Richard G Baraniuk

Video snapshot compressive imaging (SCI) utilizes a 2D detector to capture sequential video frames and compress them into a single measurement. Various reconstruction methods have been developed to recover the high-speed video frames from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruiying Lu , Ziheng Cheng , Bo Chen , Xin Yuan

The task of capturing and rendering 3D dynamic scenes from 2D images has become increasingly popular in recent years. However, most conventional cameras are bandwidth-limited to 30-60 FPS, restricting these methods to static or slowly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 David Novikov , Eilon Vaknin , Narek Tumanyan , Mark Sheinin

Sampling high-dimensional images is challenging due to limited availability of sensors; scanning is usually necessary in these cases. To mitigate this challenge, snapshot compressive imaging (SCI) was proposed to capture the…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Xin Yuan

Every generation of mobile devices strives to capture video at higher resolution and frame rate than previous ones. This quality increase also requires additional power and computation to capture and encode high-quality media. We propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Hidekazu Takahashi , Takefumi Nagumo , Kensei Jo , Aumiller Andreas , Saeed Rad , Rodrigo Caye Daudt , Yoshitaka Miyatani , Hayato Wakabayashi , Christian Brandli

Spatial multiplexing cameras (SMCs) acquire a (typically static) scene through a series of coded projections using a spatial light modulator (e.g., a digital micro-mirror device) and a few optical sensors. This approach finds use in imaging…

Computer Vision and Pattern Recognition · Computer Science 2015-08-06 Aswin C. Sankaranarayanan , Lina Xu , Christoph Studer , Yun Li , Kevin Kelly , Richard G. Baraniuk

The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data depends on the advent of novel optical designs to sample the HD data as two-dimensional (2D) compressed measurements. Nonetheless,…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Yaping Zhao , Edmund Y. Lam

The emerging technology of snapshot compressive imaging (SCI) enables capturing high dimensional (HD) data in an efficient way. It is generally implemented by two components: an optical encoder that compresses HD signals into a 2D…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Jiamian Wang , Yulun Zhang , Xin Yuan , Yun Fu , Zhiqiang Tao

The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data has led to an inverse problem, which consists of recovering the HD signal from the compressed and noisy measurement. While…

Image and Video Processing · Electrical Eng. & Systems 2023-03-01 Yaping Zhao , Siming Zheng , Xin Yuan

Compressed sensing (CS) is a powerful method routinely employed to accelerate image acquisition. It is particularly suited to situations when the image under consideration is sparse but can be sampled in a basis where it is non-sparse. Here…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Xudong Lv , Ashok Ajoy

Event cameras offer significant advantages, including a wide dynamic range, high temporal resolution, and immunity to motion blur, making them highly promising for addressing challenging visual conditions. Extracting and utilizing effective…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xin Dong , Yiwei Zhang , Yangjie Cui , Jinwu Xiang , Daochun Li , Zhan Tu

Snapshot compressive imaging (SCI) aims to capture the high-dimensional (usually 3D) images using a 2D sensor (detector) in a single snapshot. Though enjoying the advantages of low-bandwidth, low-power and low-cost, applying SCI to…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Xin Yuan , Yang Liu , Jinli Suo , Qionghai Dai

Video snapshot compressive imaging (SCI) enables the reconstruction of dynamic scenes from a single snapshot measurement. Recently, NeRF-based methods have shown promising reconstruction performance. However, such methods typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yubo Dong , Danhua Liu , Anqi Li , Zhenyuan Lin

Event-based cameras measure intensity changes (called `events') with microsecond accuracy under high-speed motion and challenging lighting conditions. With the `active pixel sensor' (APS), the `Dynamic and Active-pixel Vision Sensor'…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Liyuan Pan , Richard Hartley , Cedric Scheerlinck , Miaomiao Liu , Xin Yu , Yuchao Dai

Snapshot compressed sensing (CS) refers to compressive imaging systems in which multiple frames are mapped into a single measurement frame. Each pixel in the acquired frame is a noisy linear mapping of the corresponding pixels in the frames…

Information Theory · Computer Science 2019-04-30 Shirin Jalali , Xin Yuan

Video Captioning (VC) is a challenging multi-modal task since it requires describing the scene in language by understanding various and complex videos. For machines, the traditional VC follows the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianqiao Sun , Yudi Su , Hao Zhang , Ziheng Cheng , Zequn Zeng , Zhengjue Wang , Bo Chen , Xin Yuan

Event cameras detect changes in per-pixel intensity to generate asynchronous `event streams'. They offer great potential for accurate semantic map retrieval in real-time autonomous systems owing to their much higher temporal resolution and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Shristi Das Biswas , Adarsh Kosta , Chamika Liyanagedera , Marco Apolinario , Kaushik Roy

Snapshot compressive imaging (SCI) refers to the recovery of three-dimensional data cubes-such as videos or hyperspectral images-from their two-dimensional projections, which are generated by a special encoding of the data with a mask. SCI…

Information Theory · Computer Science 2025-02-05 Mengyu Zhao , Shirin Jalali

Traditional cameras face a trade-off between low-light performance and high-speed imaging: longer exposure times to capture sufficient light results in motion blur, whereas shorter exposures result in Poisson-corrupted noisy images. While…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Manasi Muglikar , Siddharth Somasundaram , Akshat Dave , Edoardo Charbon , Ramesh Raskar , Davide Scaramuzza

We demonstrate an approach that allows taking videos at very high-speeds of over 100,000 frames per second (fps) by exploiting the fast sampling rate of the standard rolling-shutter readout mechanism, common to most conventional sensors,…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Gil Weinberg , Ori Katz