English
Related papers

Related papers: NeuroSeg Meets DINOv3: Transferring 2D Self-Superv…

200 papers

Human perception of 3D shapes goes beyond reconstructing them as a set of points or a composition of geometric primitives: we also effortlessly understand higher-level shape structure such as the repetition and reflective symmetry of object…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

Impressive progress in 3D shape extraction led to representations that can capture object geometries with high fidelity. In parallel, primitive-based methods seek to represent objects as semantically consistent part arrangements. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Despoina Paschalidou , Angelos Katharopoulos , Andreas Geiger , Sanja Fidler

We propose Panoptic Lifting, a novel approach for learning panoptic 3D volumetric representations from images of in-the-wild scenes. Once trained, our model can render color images together with 3D-consistent panoptic segmentation from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Buló , Norman Müller , Matthias Nießner , Angela Dai , Peter Kontschieder

Benchmarking 3D spatial understanding of foundation models is essential for real-world applications such as robotics and autonomous driving. Existing evaluations often rely on downstream fine-tuning with linear heads or task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Valentina Lilova , Toyesh Chakravorty , Julian I. Bibo , Emma Boccaletti , Brandon Li , Lívia Baxová , Cees G. M. Snoek , Mohammadreza Salehi

Accurately reconstructing dense and semantically annotated 3D meshes from monocular images remains a challenging task due to the lack of geometry guidance and imperfect view-dependent 2D priors. Though we have witnessed recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhenhua Du , Binbin Xu , Haoyu Zhang , Kai Huo , Shuaifeng Zhi

The application of 3D ViTs to medical image segmentation has seen remarkable strides, somewhat overshadowing the budding advancements in Convolutional Neural Network (CNN)-based models. Large kernel depthwise convolution has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Ho Hin Lee , Quan Liu , Qi Yang , Xin Yu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

Many AI models trained on natural images develop representations that resemble those of the human brain. However, the factors that drive this brain-model similarity remain poorly understood. To disentangle how the model, training and data…

Artificial Intelligence · Computer Science 2025-08-26 Joséphine Raugel , Marc Szafraniec , Huy V. Vo , Camille Couprie , Patrick Labatut , Piotr Bojanowski , Valentin Wyart , Jean-Rémi King

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Accurate segmentation of tubular structures in medical images, such as vessels and airway trees, is crucial for computer-aided diagnosis, radiotherapy, and surgical planning. However, significant challenges exist in algorithm design when…

Image and Video Processing · Electrical Eng. & Systems 2025-04-11 Yi Huang , Ke Zhang , Wei Liu , Yuanyuan Wang , Vishal M. Patel , Le Lu , Xu Han , Dakai Jin , Ke Yan

Recent advancements in medical image segmentation techniques have achieved compelling results. However, most of the widely used approaches do not take into account any prior knowledge about the shape of the biomedical structures being…

Image and Video Processing · Electrical Eng. & Systems 2019-09-18 Zhou He , Siqi Bao , Albert Chung

Vision Foundation Models trained via large-scale self-supervised learning have demonstrated strong generalization in visual perception; however, their practical role and performance limits in agricultural settings remain insufficiently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Rui-Feng Wang , Daniel Petti , Yue Chen , Changying Li

Generating synthetic CT images from CBCT or MRI has a potential for efficient radiation dose planning and adaptive radiotherapy. However, existing CNN-based models lack global semantic understanding, while Transformers often overfit small…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xianhao Zhou , Jianghao Wu , Ku Zhao , Jinlong He , Huangxuan Zhao , Lei Chen , Shaoting Zhang , Guotai Wang

Background: Automated segmentation of spinal MR images plays a vital role both scientifically and clinically. However, accurately delineating posterior spine structures presents challenges. Methods: This retrospective study, approved by the…

Accurate and efficient 3D medical image segmentation is essential for clinical AI, where models must remain reliable under stringent memory, latency, and data availability constraints. Transformer-based methods achieve strong accuracy but…

Machine Learning · Computer Science 2026-03-10 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

We address the problem of extending the capabilities of vision foundation models such as DINO, SAM, and CLIP, to 3D tasks. Specifically, we introduce a novel method to uplift 2D image features into Gaussian Splatting representations of 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Juliette Marrie , Romain Menegaux , Michael Arbel , Diane Larlus , Julien Mairal

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks…

Image and Video Processing · Electrical Eng. & Systems 2023-06-22 Mingjie Pan , Yulu Gan , Fangxu Zhou , Jiaming Liu , Aimin Wang , Shanghang Zhang , Dawei Li

We present SAM4EM, a novel approach for 3D segmentation of complex neural structures in electron microscopy (EM) data by leveraging the Segment Anything Model (SAM) alongside advanced fine-tuning strategies. Our contributions include the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Uzair Shah , Marco Agus , Daniya Boges , Vanessa Chiappini , Mahmood Alzubaidi , Jens Schneider , Markus Hadwiger , Pierre J. Magistretti , Mowafa Househ , Corrado Calı

Conventional MRI reconstruction methods treat images and coil sensitivities as discrete objects, leading to high memory demands and limited structural awareness that hamper effective regularization. These limitations hinder accurate…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Ray Sheombarsing , Max van Riel , David Heesterbeek , Nico van den Berg , Alessandro Sbrizzi

Automated sample preparation and electron microscopy enables acquisition of very large image data sets. These technical advances are of special importance to the field of neuroanatomy, as 3D reconstructions of neuronal processes at the nm…

Semantic segmentation provides pixel-level scene understanding essential for autonomous driving and fine-grained perception tasks. However, training segmentation models requires costly, labor-intensive annotations on real-world datasets.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yerin Cheon , Aruna Balasubramanian , Francois Rameau