English
Related papers

Related papers: Deep learning with 4D spatio-temporal data represe…

200 papers

The task of occupancy forecasting (OCF) involves utilizing past and present perception data to predict future occupancy states of autonomous vehicle surrounding environments, which is critical for downstream tasks such as obstacle avoidance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jingyi Xu , Xieyuanli Chen , Junyi Ma , Jiawei Huang , Jintao Xu , Yue Wang , Ling Pei

This paper presents a learning-based approach for accurately estimating the 3D shape of flexible continuum robots subjected to external loads. The proposed method introduces a spatiotemporal neural network architecture that fuses…

Robotics · Computer Science 2025-10-28 Enyi Wang , Zhen Deng , Chuanchuan Pan , Bingwei He , Jianwei Zhang

Optical coherence tomography (OCT) is a non-invasive volumetric imaging modality with high spatial and temporal resolution. For imaging larger tissue structures, OCT probes need to be moved to scan the respective area. For handheld…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Suresh Guttikonda , Maximilian Neidhardt , Vidas Raudonis , Alexander Schlaefer

Optical coherence tomography angiography (OCTA) is a non-invasive imaging technique widely used to study vascular structures and micro-circulation dynamics in the retina and choroid. OCTA has been widely used in clinics for diagnosing…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Kejie Chen , Guanbing Gao , Xiaochun Yang , Wenbo Wang , Jing Na

We construct an accurate imaging theory for optical coherence tomography/microscopy (OCT/OCM) without approximations to calculate precise optical resolution and imaging characteristics. Our theory represents a broadband light source using a…

Optics · Physics 2025-05-22 Naoki Fukutake , Shuichi Makita , Yoshiaki Yasuno

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

Optical coherence tomography (OCT) is a non-invasive 3D modality widely used in ophthalmology for imaging the retina. Achieving automated, anatomically coherent retinal layer segmentation on OCT is important for the detection and monitoring…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Botond Fazekas , Guilherme Aresta , Dmitrii Lachinov , Sophie Riedl , Julia Mai , Ursula Schmidt-Erfurth , Hrvoje Bogunovic

Oblique Decision Tree (ODT) separates the feature space by linear projections, as opposed to the conventional Decision Tree (DT) that forces axis-parallel splits. ODT has been proven to have a stronger representation ability than DT, as it…

Machine Learning · Computer Science 2025-02-04 Shen-Huan Lyu , Yi-Xiao He , Yanyan Wang , Zhihao Qu , Bin Tang , Baoliu Ye

Understanding 3D fundamental processes is crucial for academic and industrial applications. Nowadays, X-ray time-resolved tomography, or tomoscopy, is a leading technique for in-situ and operando 4D (3D+time) characterization. Despite its…

Optical coherence tomography (OCT) captures cross-sectional data and is used for the screening, monitoring, and treatment planning of retinal diseases. Technological developments to increase the speed of acquisition often results in systems…

Image and Video Processing · Electrical Eng. & Systems 2023-01-03 Timothy T. Yu , Da Ma , Jayden Cole , Myeong Jin Ju , Mirza F. Beg , Marinko V. Sarunic

Inverse scattering in optical coherence tomography (OCT) seeks to recover both structural images and intrinsic tissue optical properties, including refractive index, scattering coefficient, and anisotropy. This inverse problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Jinglun Yu , Yaning Wang , Wenhan Guo , Yuan Gao , Yu Sun , Jin U. Kang

Purpose: The integration of multimodal imaging into operating rooms paves the way for comprehensive surgical scene understanding. In ophthalmic surgery, by now, two complementary imaging modalities are available: operating microscope (OPMI)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Nikolo Rohrmoser , Ghazal Ghazaei , Michael Sommersperger , Nassir Navab

Deep-Learning-based video recognition has shown promising improvements along with the development of large-scale datasets and spatiotemporal network architectures. In image recognition, learning spatially invariant features is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Taeoh Kim , Hyeongmin Lee , MyeongAh Cho , Ho Seong Lee , Dong Heon Cho , Sangyoun Lee

3D occupancy becomes a promising perception representation for autonomous driving to model the surrounding environment at a fine-grained scale. However, it remains challenging to efficiently aggregate 3D occupancy over time across multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ziyang Leng , Jiawei Yang , Wenlong Yi , Bolei Zhou

High spatiotemporal resolution dynamic magnetic resonance imaging (MRI) is a powerful clinical tool for imaging moving structures as well as to reveal and quantify other physical and physiological dynamics. The low speed of MRI necessitates…

Image and Video Processing · Electrical Eng. & Systems 2019-10-14 Yuhua Chen , Jaime L. Shaw , Yibin Xie , Debiao Li , Anthony G. Christodoulou

Vision-language-action (VLA) models show potential for general robotic tasks, but remain challenging in spatiotemporally coherent manipulation, which requires fine-grained representations. Typically, existing methods embed 3D positions into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

Autism spectrum disorder (ASD) is associated with behavioral and communication problems. Often, functional magnetic resonance imaging (fMRI) is used to detect and characterize brain changes related to the disorder. Recently, machine…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Marcel Bengs , Nils Gessert , Alexander Schlaefer

4D Flow Magnetic Resonance Imaging (4D Flow MRI) is a non-invasive technique for volumetric, time-resolved blood flow quantification. However, apparent trade-offs between acquisition time, image noise, and resolution limit clinical…

Accurate simulation of brain deformation is a key component for developing realistic, interactive neurosurgical simulators, as complex nonlinear deformations must be captured to ensure realistic tool-tissue interactions. However,…

Muscle forces and joint kinematics estimated with musculoskeletal (MSK) modeling techniques offer useful metrics describing movement quality. Model-based computational MSK models can interpret the dynamic interaction between the neural…

Machine Learning · Computer Science 2023-09-13 Yue Shi , Shuhao Ma , Yihui Zhao