Related papers: Minimalist Vision with Freeform Pixels
Image simulation remains under-exploited for the most widely used biological phase microscopy methods, because of difficulties in simulating partially coherent illumination. We describe an open-source toolbox, microlith…
With the rapid development of high-speed communication and artificial intelligence technologies, human perception of real-world scenes is no longer limited to the use of small Field of View (FoV) and low-dimensional scene detection devices.…
We study the nano- and micro-structures that increase the optical efficiency of the CMOS image pixels in visible and infrared. We consider the difference between the micro-holes at the pixels' bottom and the top and the holes that are…
Using the complementary wave- and particle-like natures of photons, it is possible to make ``interaction-free'' measurements where the presence of an object can be determined with no photons being absorbed. We investigated several…
Data protection methods like cryptography, despite being effective, inadvertently signal the presence of secret communication, thereby drawing undue attention. Here, we introduce an optical information hiding camera integrated with an…
We present a physics-driven framework for accurate evaluation of discrete spectral bands using a low-cost multispectral setup built from off-the-shelf RGB cameras and narrow multi-band optical filters. The approach starts by explicitly…
A recent technology known as transparent screens is transforming windows into displays. These smart windows are present in buses, airports and offices. They can remain transparent, as a normal window, or display relevant information that…
Current automatic vision systems face two major challenges: scalability and extreme variability of appearance. First, the computational time required to process an image typically scales linearly with the number of pixels in the image,…
Illumination is the deliberate utilization of light to realize practical or aesthetic effects. The designers combine with the environmental considerations, energy-saving goals, and technology advances with fundamental physics to develop…
Polarization imaging captures the polarization state of light, revealing information invisible to the human eye yet valuable in domains such as biomedical diagnostics, autonomous driving, and remote sensing. However, conventional…
We propose a new method for six-degree-of-freedom (6-DoF) autonomous camera movement for minimally invasive surgery, which, unlike previous methods, takes into account both the position and orientation information from structures in the…
One of the main limitations for the resolution of optical instruments is the size of the sensor's pixels. In this paper we introduce a new sub pixel resolution algorithm to enhance the resolution of images. This method is based on the…
We propose FreeSim, a camera simulation method for autonomous driving. FreeSim emphasizes high-quality rendering from viewpoints beyond the recorded ego trajectories. In such viewpoints, previous methods have unacceptable degradation…
We analyze a physically motivated fine-grained mesh-connected computer model, assuming that a word of information takes a fixed area and that it takes unit time and unit energy to move a word unit distance. This is a representation of…
Light-field cameras allow the acquisition of both the spatial and angular components of the light. This has a wide range of applications from image refocusing to 3D reconstruction of a scene. The conventional way to perform such…
Masked Image Modeling (MIM) is a powerful self-supervised strategy for visual pre-training without the use of labels. MIM applies random crops to input images, processes them with an encoder, and then recovers the masked inputs with a…
It is hard for us humans to recognize things in nature until we have invented them ourselves. For image-forming optics, nature has made virtually every kind of lens humans have devised. But what about lensless "imaging"? Recently, we showed…
We present UltraZoom, a system for generating gigapixel-resolution images of objects from casually captured inputs, such as handheld phone photos. Given a full-shot image (global, low-detail) and one or more close-ups (local, high-detail),…
This paper describes a multimodal vision sensor that integrates three types of cameras, including a stereo camera, a polarization camera and a panoramic camera. Each sensor provides a specific dimension of information: the stereo camera…
Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time,…