English
Related papers

Related papers: DepthPilot: From Controllability to Interpretabili…

200 papers

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Unsupervised deformable image registration requires aligning complex anatomical structures without reference labels, making interpretability and reliability critical. Existing deep learning methods achieve considerable accuracy but often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zafar Iqbal , Anwar Ul Haq , Srimannarayana Grandhi

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zirong Li , Siyuan Mei , Weiwen Wu , Andreas Maier , Lina Gölz , Yan Xia

High-fidelity surgical video generation can greatly improve medical training and the development of AI, adapting these generative models for precise video editing remains a formidable challenge. Modifying surgical attributes, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ritul Jangir , Arkya Jyoti Bagchi , Aiman Farooq , Mangalton Okram , Saurabh Seetaram Korgaonkar , Deepak Mishra

Colonic polyps are well-recognized precursors to colorectal cancer (CRC), typically detected during colonoscopy. However, the variability in appearance, location, and size of these polyps complicates their detection and removal, leading to…

Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving. However, there still lacks a driving-targeted dense geometry perception model that can adapt to different scenarios and camera…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Shengyin Jiang , Long Chen , Zhi-Xin Yang , Jiwen Lu

Automated diagnostic systems (ADS) have shown significant potential in the early detection of polyps during endoscopic examinations, thereby reducing the incidence of colorectal cancer. However, due to high annotation costs and strict…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Shengyuan Liu , Zhen Chen , Qiushi Yang , Weihao Yu , Di Dong , Jiancong Hu , Yixuan Yuan

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Existing video generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability. To overcome these limitations, we introduce PhysCtrl, a novel framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chen Wang , Chuhao Chen , Yiming Huang , Zhiyang Dou , Yuan Liu , Jiatao Gu , Lingjie Liu

This work presents EndoStreamDepth, a monocular depth estimation framework for endoscopic video streams. It provides accurate depth maps with sharp anatomical boundaries for each frame, temporally consistent predictions across frames, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Hao Li , Daiwei Lu , Jiacheng Wang , Robert J. Webster , Ipek Oguz

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Human video generation remains challenging due to the difficulty of jointly modeling human appearance, motion, and camera viewpoint under limited multi-view data. Existing methods often address these factors separately, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zhengwentai Sun , Keru Zheng , Chenghong Li , Hongjie Liao , Xihe Yang , Heyuan Li , Yihao Zhi , Shuliang Ning , Shuguang Cui , Xiaoguang Han

Reconstruction of static visual stimuli from non-invasion brain activity fMRI achieves great success, owning to advanced deep learning models such as CLIP and Stable Diffusion. However, the research on fMRI-to-video reconstruction remains…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Zixuan Gong , Guangyin Bao , Qi Zhang , Zhongwei Wan , Duoqian Miao , Shoujin Wang , Lei Zhu , Changwei Wang , Rongtao Xu , Liang Hu , Ke Liu , Yu Zhang

We propose DeepV2D, an end-to-end deep learning architecture for predicting depth from video. DeepV2D combines the representation ability of neural networks with the geometric principles governing image formation. We compose a collection of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Zachary Teed , Jia Deng

Colonoscopy is the most common procedure for early detection and removal of polyps, a critical component of colorectal cancer prevention. Insufficient visual coverage of the colon surface during the procedure often results in missed polyps.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Emmanuelle Muhlethaler , Erez Posner , Moshe Bouhnik

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Boah Kim , Jong Chul Ye

Diffusion-based video depth estimation methods have achieved remarkable success with strong generalization ability. However, predicting depth for long videos remains challenging. Existing methods typically split videos into overlapping…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yue-Jiang Dong , Wang Zhao , Jiale Xu , Ying Shan , Song-Hai Zhang

Image-to-3D models increasingly rely on hierarchical generation to disentangle geometry and texture. However, the design choices underlying these two-stage models--particularly the optimal choice of intermediate geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Rishabh Kabra , Drew A. Hudson , Sjoerd van Steenkiste , Joao Carreira , Niloy J. Mitra

In the field of 3D medical imaging, accurately extracting and representing the blood vessels with curvilinear structures holds paramount importance for clinical diagnosis. Previous methods have commonly relied on discrete representation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziwei Zhao , Zhixing Zhang , Yuhang Liu , Zhao Zhang , Haojun Yu , Dong Wang , Liwei Wang

Pre-training on image-text colonoscopy records offers substantial potential for improving endoscopic image analysis, but faces challenges including non-informative background images, complex medical terminology, and ambiguous multi-lesion…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Yili He , Yan Zhu , Peiyao Fu , Ruijie Yang , Tianyi Chen , Zhihua Wang , Quanlin Li , Pinghong Zhou , Xian Yang , Shuo Wang