English
Related papers

Related papers: Multimodal Medical Volume Colorization from 2D Sty…

200 papers

Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessary in representing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yean Cheng , Renjie Wan , Shuchen Weng , Chengxuan Zhu , Yakun Chang , Boxin Shi

A metric-accurate semantic 3D representation is essential for many robotic tasks. This work proposes a simple, yet powerful, way to integrate the 2D embeddings of a Vision-Language Model in a metric-accurate 3D representation at real-time.…

Robotics · Computer Science 2025-08-11 Christian Rauch , Björn Ellensohn , Linus Nwankwo , Vedant Dave , Elmar Rueckert

The task of capturing and rendering 3D dynamic scenes from 2D images has become increasingly popular in recent years. However, most conventional cameras are bandwidth-limited to 30-60 FPS, restricting these methods to static or slowly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 David Novikov , Eilon Vaknin , Narek Tumanyan , Mark Sheinin

Imaging an object embedded within a scattering medium requires the correction of complex sample-induced wave distortions. Existing approaches have been designed to resolve them by optimizing signal waves recorded in each 2D image. Here, we…

Optics · Physics 2022-10-17 Ye-Ryoung Lee , Dong-Young Kim , Yonghyeon Jo , Moonseok Kim , Wonshik Choi

Conventional and deep learning-based methods have shown great potential in the medical imaging domain, as means for deriving diagnostic, prognostic, and predictive biomarkers, and by contributing to precision medicine. However, these…

Conventional visualization media such as MRI prints and computer screens are inherently two dimensional, making them incapable of displaying true 3D volume data sets. By applying only transparency or intensity projection, and ignoring…

Graphics · Computer Science 2007-05-23 Gibby Koldenhof

Computer-aided medical image analysis plays a significant role in assisting medical practitioners for expert clinical diagnosis and deciding the optimal treatment plan. At present, convolutional neural networks (CNN) are the preferred…

Image and Video Processing · Electrical Eng. & Systems 2022-04-29 S Niyas , S J Pawan , M Anand Kumar , Jeny Rajan

In this work, we develop intuitive controls for editing the style of 3D objects. Our framework, Text2Mesh, stylizes a 3D mesh by predicting color and local geometric details which conform to a target text prompt. We consider a disentangled…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Oscar Michel , Roi Bar-On , Richard Liu , Sagie Benaim , Rana Hanocka

Medical imaging is the technique used to create images of the human body or parts of it for clinical purposes. Medical images always have large sizes and they are commonly corrupted by single or multiple noise type at the same time, due to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Nora Youssef , Abeer M. Mahmoud , El-Sayed M. El-Horbaty

Multi-site structural MRI is increasingly used in neuroimaging studies to diversify subject cohorts. However, combining MR images acquired from various sites/centers may introduce site-related non-biological variations. Retrospective image…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Mengqi Wu , Minhui Yu , Shuaiming Jing , Pew-Thian Yap , Zhengwu Zhang , Mingxia Liu

Photorealism is a complex concept that cannot easily be formulated mathematically. Deep Photo Style Transfer is an attempt to transfer the style of a reference image to a content image while preserving its photorealism. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Sebastian Penhouët , Paul Sanzenbacher

Medical image segmentation is an increasingly popular area of research in medical imaging processing and analysis. However, many researchers who are new to the field struggle with basic concepts. This tutorial paper aims to provide an…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Diedre Carmo , Gustavo Pinheiro , Lívia Rodrigues , Thays Abreu , Roberto Lotufo , Letícia Rittner

Current Computer-Aided Diagnosis (CAD) methods mainly depend on medical images. The clinical information, which usually needs to be considered in practical clinical diagnosis, has not been fully employed in CAD. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Songxiao Yang , Xiabi Liu , Zhongshu Zheng , Wei Wang , Xiaohong Ma

We present a tool for resolution recovery in multimodal clinical magnetic resonance imaging (MRI). Such images exhibit great variability, both biological and instrumental. This variability makes automated processing with neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Mikael Brudfors , Yael Balbastre , Parashkev Nachev , John Ashburner

Color encoding of depth is shown to occur naturally in holograms that are reconstructed under white light illumination. It can be registered in a common color photograph, allowing a simple method of visual decoding by means of ordinary…

Optics · Physics 2015-06-26 J. J. Lunazzi

We present a method for compositing virtual objects into a photograph such that the object colors appear to have been processed by the photo's camera imaging pipeline. Compositing in such a camera-aware manner is essential for high realism,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Jun Gao , Xiao Li , Liwei Wang , Sanja Fidler , Stephen Lin

The objective of this work is to achieve sensorless reconstruction of a 3D volume from a set of 2D freehand ultrasound images with deep implicit representation. In contrast to the conventional way that represents a 3D volume as a discrete…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Pak-Hei Yeung , Linde Hesse , Moska Aliasi , Monique Haak , the INTERGROWTH-21st Consortium , Weidi Xie , Ana I. L. Namburete

Colorizing grayscale images offers an engaging visual experience. Existing automatic colorization methods often fail to generate satisfactory results due to incorrect semantic colors and unsaturated colors. In this work, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Han Wang , Xinning Chai , Yiwen Wang , Yuhong Zhang , Rong Xie , Li Song

Despite significant advancements in automatic brain tumor segmentation methods, their performance is not guaranteed when certain MR sequences are missing. Addressing this issue, it is crucial to synthesize the missing MR images that reflect…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Jihoon Cho , Seunghyuck Park , Jinah Park

We present a differentiable volume rendering solution that provides differentiability of all continuous parameters of the volume rendering process. This differentiable renderer is used to steer the parameters towards a setting with an…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Rüdiger Westermann