English
Related papers

Related papers: Multimodal Medical Volume Colorization from 2D Sty…

200 papers

We propose a three-dimensional (3D) multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration. To the best of our knowledge, these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jhacson Meza , Sonia H. Contreras-Ortiz , Lenny A. Romero , Andres G. Marrugo

In this work, we propose a new paradigm of iterative model-based reconstruction algorithms for providing real-time solution for zooming-in and refining a region of interest in medical and clinical tomographic images. This algorithmic…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Junqi Tang , Guixian Xu , Jinglai Li

This research introduces a transformative framework for integrating Vision-Enhanced Large Language Models (LLMs) with advanced transformer-based architectures to tackle challenges in high-resolution image synthesis and multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Karthikeya KV

Deep learning has become a prominent computational modeling tool in the areas of computer vision and image processing in recent years. This research comprehensively analyzes the different deep-learning methods used for image-to-image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Yuda Bi

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

This paper discusses current methods and trends for 3D bounding box detection in volumetric medical image data. For this purpose, an overview of relevant papers from recent years is given. 2D and 3D implementations are discussed and…

Image and Video Processing · Electrical Eng. & Systems 2021-05-18 Daria Kern , Andre Mastmeyer

Acquiring accurate three-dimensional depth information conventionally requires expensive multibeam LiDAR devices. Recently, researchers have developed a less expensive option by predicting depth information from two-dimensional color…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Peng Yin , Jianing Qian , Yibo Cao , David Held , Howie Choset

We present a deep learning approach to reconstruct scene appearance from unstructured images captured under collocated point lighting. At the heart of Deep Reflectance Volumes is a novel volumetric scene representation consisting of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Kriegman , Ravi Ramamoorthi

Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Fan Bai , Yuxin Du , Tiejun Huang , Max Q. -H. Meng , Bo Zhao

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

In recent years, text-driven image editing has made significant progress. However, due to the inherent ambiguity and discreteness of natural language, color editing still faces challenges such as insufficient precision and difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuqi Yang , Dongliang Chang , Yuanchen Fang , Yi-Zhe SonG , Zhanyu Ma , Jun Guo

Medical imaging is an invaluable resource in medicine as it enables to peer inside the human body and provides scientists and physicians with a wealth of information indispensable for understanding, modelling, diagnosis, and treatment of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hanene Ben Yedder , Ben Cardoen , Ghassan Hamarneh

Image based rendering is a fundamental problem in computer vision and graphics. Modern techniques often rely on depth image for the 3D construction. However for most of the existing depth cameras, the large and unpredictable noises can be…

Computer Vision and Pattern Recognition · Computer Science 2016-02-17 Rashi Chaudhary , Himanshu Dasgupta

Purpose: Different Magnetic resonance imaging (MRI) modalities of the same anatomical structure are required to present different pathological information from the physical level for diagnostic needs. However, it is often difficult to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Yuchen Fei , Bo Zhan , Mei Hong , Xi Wu , Jiliu Zhou , Yan Wang

Physical visualizations (i.e., data representations by means of physical objects) have been used for many centuries in medical and anatomical education. Recently, 3D printing techniques started also to emerge. Still, other medical…

Human-Computer Interaction · Computer Science 2020-11-12 Marwin Schindler , Hsiang-Yun Wu , Renata Georgia Raidou

We present a data-driven approach that colorizes 3D furniture models and indoor scenes by leveraging indoor images on the internet. Our approach is able to colorize the furniture automatically according to an example image. The core is to…

Graphics · Computer Science 2017-03-01 Jie Zhu , Yanwen Guo , Han Ma

Magnetic resonance (MR) imaging is commonly used in the clinical setting to non-invasively monitor the body. There exists a large variability in MR imaging due to differences in scanner hardware, software, and protocol design. Ideally, a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Savannah P. Hays , Samuel W. Remedios , Lianrui Zuo , Ellen M. Mowry , Scott D. Newsome , Peter A. Calabresi , Aaron Carass , Blake E. Dewey , Jerry L. Prince

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view synthesis for handling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hsin-Ping Huang , Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang

The work proposes a novel deep-learning framework for the synthesis of three-dimensional MRI volumes from corresponding 3D ultrasound images of the brain, leveraging a modified iteration of the Pix2Pix Generative Adversarial Network (GAN)…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Shubham Singh , Mrunal Bewoor , Ammar Ranapurwala , Satyam Rai , Sheetal Patil