English
Related papers

Related papers: Brain-JEPA: Brain Dynamics Foundation Model with G…

200 papers

We study whether 3D self-supervised pretraining with Point--JEPA enables label-efficient grasp joint-angle prediction. Meshes are sampled to point clouds and tokenized; a ShapeNet-pretrained Point--JEPA encoder feeds a $K{=}5$…

Robotics · Computer Science 2025-09-26 Jed Guzelkabaagac , Boris Petrović

Reliable large-scale cell detection and segmentation is the fundamental first step to understanding biological processes in the brain. The ability to phenotype cells at scale can accelerate preclinical drug evaluation and system-level brain…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Son T. Ly , Bai Lin , Hung Q. Vo , Dragan Maric , Badri Roysam , Hien V. Nguyen

Temporally aware image representations are crucial for capturing disease progression in 3D volumes of longitudinal medical datasets. However, recent state-of-the-art self-supervised learning approaches like Masked Autoencoding (MAE),…

Widely used traditional pipelines for subcortical brain segmentation are often inefficient and slow, particularly when processing large datasets. Furthermore, deep learning models face challenges due to the high resolution of MRI images and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Aaron Cao , Zongyu Li , Jordan Jomsky , Andrew F. Laine , Jia Guo

Brain age is a critical measure that reflects the biological ageing process of the brain. The gap between brain age and chronological age, referred to as brain PAD (Predicted Age Difference), has been utilized to investigate…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Lemuel Puglisi , Alessia Rondinella , Linda De Meo , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì

This work introduces JEMA (Joint Embedding with Multimodal Alignment), a novel co-learning framework tailored for laser metal deposition (LMD), a pivotal process in metal additive manufacturing. As Industry 5.0 gains traction in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Joao Sousa , Roya Darabi , Armando Sousa , Frank Brueckner , Luís Paulo Reis , Ana Reis

Different brain imaging modalities offer unique insights into brain function and structure. Combining them enhances our understanding of neural mechanisms. Prior multimodal studies fusing functional MRI (fMRI) and structural MRI (sMRI) have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Oktay Agcaoglu , Rogers F. Silva , Deniz Alacam , Sergey Plis , Tulay Adali , Vince Calhoun

This paper introduces a novel application of Video Joint-Embedding Predictive Architectures (V-JEPAs) for Facial Expression Recognition (FER). Departing from conventional pre-training methods for video understanding that rely on pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Lennart Eing , Cristina Luna-Jiménez , Silvan Mertes , Elisabeth André

Inspired by the success of generative pretraining in natural language, we ask whether the same principles can yield strong self-supervised visual learners. Instead of training models to output features for downstream use, we train them to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Sihan Xu , Ziqiao Ma , Wenhao Chai , Xuweiyi Chen , Weiyang Jin , Joyce Chai , Saining Xie , Stella X. Yu

Many tasks in robot-assisted surgery require planning and controlling manipulators' motions that interact with highly deformable objects. This study proposes a realistic, time-bounded simulator based on Position-based Dynamics (PBD)…

Time series foundation models (TSFMs) pretrained on data from multiple domains have shown strong performance on diverse modeling tasks. Various efforts have been made to develop foundation models specific to electroencephalography (EEG)…

Machine Learning · Computer Science 2026-05-07 Brad Shook , Abby Turner , Jieshi Chen , Michał Wiliński , Mononito Goswami , Jonathan Elmer , Artur Dubrawski

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Self-supervised learning of visual representations has been focusing on learning content features, which do not capture object motion or location, and focus on identifying and differentiating objects in images and videos. On the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Adrien Bardes , Jean Ponce , Yann LeCun

Representing dynamical systems through data-driven universal spaces has proven effective; however, achieving this universality for human brain activity remains a significant challenge, further aggravated by diverse cognitive states and…

Quantitative Methods · Quantitative Biology 2026-05-06 Ronghua Zheng , Chengyuan Qian , Weiyang Ding

Longitudinal biomedical studies monitor individuals over time to capture dynamics in brain development, disease progression, and treatment effects. However, estimating trajectories of brain biomarkers is challenging due to biological…

Machine Learning · Computer Science 2025-04-15 Vasiliki Tassopoulou , Haochang Shou , Christos Davatzikos

The human brain is a complex inter-wired system that emerges spontaneous functional fluctuations. In spite of tremendous success in the experimental neuroscience field, a system-level understanding of how brain anatomy supports various…

Neurons and Cognition · Quantitative Biology 2024-05-28 Tingting Dan , Ziquan Wei , Won Hwa Kim , Guorong Wu

State-space models (SSMs) have become a cornerstone for unraveling brain dynamics, revealing how latent neural states evolve over time and give rise to observed signals. By combining the flexibility of deep learning with the principled…

Machine Learning · Computer Science 2026-02-03 Tingting Dan , Jiaqi Ding , Guorong Wu

Human motion prediction (HMP) has emerged as a popular research topic due to its diverse applications, but it remains a challenging task due to the stochastic and aperiodic nature of future poses. Traditional methods rely on hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiexin Wang , Yujie Zhou , Wenwen Qiang , Ying Ba , Bing Su , Ji-Rong Wen

In recent years, there has been increasing interest in developing models and tools to address the complex patterns of connectivity found in brain tissue. Specifically, this is due to a need to understand how emergent properties emerge from…

Neurons and Cognition · Quantitative Biology 2022-04-15 Sean Knight , Navjot Gadda

Task failures in prior fine-grained robotic manipulation methods often stem from suboptimal initial grasping, which is critical for subsequent manipulation and reducing the requirement for complex pose adjustments. To address this, we…

Robotics · Computer Science 2025-11-20 Juyi Sheng , Yangjun Liu , Sheng Xu , Zhixin Yang , Mengyuan Liu