English
Related papers

Related papers: A Multimodal Deep Learning Approach for White Matt…

200 papers

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. We opt for top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Fenggen Yu , Kun Liu , Yan Zhang , Chenyang Zhu , Kai Xu

We introduce OpenShape, a method for learning multi-modal joint representations of text, image, and point clouds. We adopt the commonly used multi-modal contrastive learning framework for representation alignment, but with a specific focus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Minghua Liu , Ruoxi Shi , Kaiming Kuang , Yinhao Zhu , Xuanlin Li , Shizhong Han , Hong Cai , Fatih Porikli , Hao Su

We present a rotation-equivariant unsupervised learning framework for the sparse deconvolution of non-negative scalar fields defined on the unit sphere. Spherical signals with multiple peaks naturally arise in Diffusion MRI (dMRI), where…

Image and Video Processing · Electrical Eng. & Systems 2021-02-19 Axel Elaldi , Neel Dey , Heejong Kim , Guido Gerig

Diffusion MRI tractography parcellation classifies streamlines into anatomical fiber tracts to enable quantification and visualization for clinical and scientific applications. Current tractography parcellation methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Tengfei Xue , Yuqian Chen , Chaoyi Zhang , Alexandra J. Golby , Nikos Makris , Yogesh Rathi , Weidong Cai , Fan Zhang , Lauren J. O'Donnell

Traditional machine learning (ML) algorithms, such as multiple regression, require human analysts to make decisions on how to treat the data. These decisions can make the model building process subjective and difficult to replicate for…

Machine Learning · Computer Science 2022-01-31 William Franz Lamberti

A tractogram is a virtual representation of the brain white matter. It is composed of millions of virtual fibers, encoded as 3D polylines, which approximate the white matter axonal pathways. To date, tractograms are the most accurate white…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Pietro Astolfi , Ruben Verhagen , Laurent Petit , Emanuele Olivetti , Silvio Sarubbo , Jonathan Masci , Davide Boscaini , Paolo Avesani

Tractography fiber clustering using diffusion MRI (dMRI) is a crucial strategy for white matter (WM) parcellation. Current methods primarily use the geometric information of fibers (i.e., the spatial trajectories) to group similar fibers…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Jin Wang , Bocheng Guo , Yijie Li , Junyi Wang , Yuqian Chen , Jarrett Rushmore , Nikos Makris , Yogesh Rathi , Lauren J O'Donnell , Fan Zhang

The purpose of this work is to develop a framework for single-subject analysis of diffusion tensor imaging (DTI) data. This framework (termed TOADDI) is capable of testing whether an individual tract as represented by the major eigenvector…

We present a new deep learning approach for matching deformable shapes by introducing {\it Shape Deformation Networks} which jointly encode 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

For the task of mobility analysis of 3D shapes, we propose joint analysis for simultaneous motion part segmentation and motion attribute estimation, taking a single 3D model as input. The problem is significantly different from those…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Xiaogang Wang , Bin Zhou , Yahao Shi , Xiaowu Chen , Qinping Zhao , Kai Xu

Statistical shape modeling (SSM) is a powerful computational framework for quantifying and analyzing the geometric variability of anatomical structures, facilitating advancements in medical research, diagnostics, and treatment planning.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Krithika Iyer , Jadie Adams , Shireen Y. Elhabian

Sequential DeepFake detection is an emerging task that predicts the manipulation sequence in order. Existing methods typically formulate it as an image-to-sequence problem, employing conventional Transformer architectures. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yunfei Li , Yuezun Li , Baoyuan Wu , Junyu Dong , Guopu Zhu , Siwei Lyu

We introduce Point2Skeleton, an unsupervised method to learn skeletal representations from point clouds. Existing skeletonization methods are limited to tubular shapes and the stringent requirement of watertight input, while our method aims…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Cheng Lin , Changjian Li , Yuan Liu , Nenglun Chen , Yi-King Choi , Wenping Wang

Diffusion-weighted magnetic resonance imaging (DW-MRI) is a critical imaging method for capturing and modeling tissue microarchitecture at a millimeter scale. A common practice to model the measured DW-MRI signal is via fiber orientation…

Deep networks for image classification often rely more on texture information than object shape. While efforts have been made to make deep-models shape-aware, it is often difficult to make such models simple, interpretable, or rooted in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Rajhans Singh , Ankita Shukla , Pavan Turaga

This paper presents DDTracking, a novel deep generative framework for diffusion MRI tractography that formulates streamline propagation as a conditional denoising diffusion process. In DDTracking, we introduce a dual-pathway encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yijie Li , Wei Zhang , Xi Zhu , Ye Wu , Yogesh Rathi , Lauren J. O'Donnell , Fan Zhang

Accurate prediction of perceptual attributes of haptic textures is essential for advancing VR and AR applications and enhancing robotic interaction with physical surfaces. This paper presents a deep learning-based multi-modal framework,…

Human-Computer Interaction · Computer Science 2025-06-24 Mudassir Ibrahim Awan , Seokhee Jeon

The amygdala plays a vital role in emotional processing and exhibits structural diversity that necessitates fine-scale parcellation for a comprehensive understanding of its anatomico-functional correlations. Diffusion MRI tractography is an…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Haolin He , Ce Zhu , Le Zhang , Yipeng Liu , Xiao Xu , Yuqian Chen , Leo Zekelman , Jarrett Rushmore , Yogesh Rathi , Nikos Makris , Lauren J. O'Donnell , Fan Zhang

Accurately identifying white matter tracts in medical images is essential for various applications, including surgery planning and tract-specific analysis. Supervised machine learning models have reached state-of-the-art solving this task…

Image and Video Processing · Electrical Eng. & Systems 2023-08-04 Robin Peretzke , Klaus Maier-Hein , Jonas Bohn , Yannick Kirchhoff , Saikat Roy , Sabrina Oberli-Palma , Daniela Becker , Pavlina Lenga , Peter Neher

The structure and variability of the brain's connections can be investigated via prediction of non-imaging phenotypes using neural networks. However, known neuroanatomical relationships between input features are generally ignored in…

Image and Video Processing · Electrical Eng. & Systems 2023-01-06 Yuqian Chen , Fan Zhang , Leo R. Zekelman , Tengfei Xue , Chaoyi Zhang , Yang Song , Nikos Makris , Yogesh Rathi , Weidong Cai , Lauren J. O'Donnell