English
Related papers

Related papers: Brain-JEPA: Brain Dynamics Foundation Model with G…

200 papers

This work explores the potential of foundation models, specifically a Mamba-based selective state space model, for enhancing EEG analysis in neurological disorder diagnosis. EEG, crucial for diagnosing conditions like epilepsy, presents…

Machine Learning · Computer Science 2025-09-04 Saarang Panchavati , Corey Arnold , William Speier

Existing methods for self-supervised representation learning of geospatial regions and map entities rely extensively on the design of pretext tasks, often involving augmentations or heuristic sampling of positive and negative pairs based on…

Machine Learning · Computer Science 2025-03-11 Theodor Lundqvist , Ludvig Delvret

Self-supervised learning (SSL) has become an important approach in pretraining large neural networks, enabling unprecedented scaling of model and dataset sizes. While recent advances like I-JEPA have shown promising results for Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 András Kalapos , Bálint Gyires-Tóth

Electroencephalography (EEG) has wide-ranging applications, from clinical diagnosis to brain-computer interfaces (BCIs). With the increasing volume and variety of EEG data, there has been growing interest in establishing foundation models…

Machine Learning · Computer Science 2025-10-21 Zitao Fang , Chenxuan Li , Hongting Zhou , Shuyang Yu , Guodong Du , Ashwaq Qasem , Yang Lu , Jing Li , Junsong Zhang , Sim Kuan Goh

Joint Embedding Predictive Architectures (JEPAs) learn representations able to solve numerous downstream tasks out-of-the-box. JEPAs combine two objectives: (i) a latent-space prediction term, i.e., the representation of a slightly…

Machine Learning · Computer Science 2025-10-08 Randall Balestriero , Nicolas Ballas , Mike Rabbat , Yann LeCun

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

The growing availability of longitudinal Magnetic Resonance Imaging (MRI) datasets has facilitated Artificial Intelligence (AI)-driven modeling of disease progression, making it possible to predict future medical scans for individual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Lemuel Puglisi , Daniel C. Alexander , Daniele Ravì

Pretraining Vision-Language-Action (VLA) policies on internet-scale video is appealing, yet current latent-action objectives often learn the wrong thing: they remain anchored to pixel variation rather than action-relevant state transitions,…

Robotics · Computer Science 2026-02-17 Jingwen Sun , Wenyao Zhang , Zekun Qi , Shaojie Ren , Zezhi Liu , Hanxin Zhu , Guangzhong Sun , Xin Jin , Zhibo Chen

Humans learn efficiently from their environment by engaging multiple interacting neural systems that support distinct yet complementary forms of control, including model-based (goal-directed) planning, model-free (habitual) responding, and…

Machine Learning · Computer Science 2026-02-02 Babak Shahbaba , Zahra Moslemi

We develop a new methodology for determining the location and dynamics of brain activity from combined magnetoencephalography (MEG) and electroencephalography (EEG) data. The resulting inverse problem is ill-posed and is one of the most…

Applications · Statistics 2019-07-23 Yin Song , Farouk S. Nathoo , Arif Babul

Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Xinru Zhang , Ni Ou , Berke Doga Basaran , Marco Visentin , Mengyun Qiao , Renyang Gu , Cheng Ouyang , Yaou Liu , Paul M. Matthew , Chuyang Ye , Wenjia Bai

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

Latent diffusion models have emerged as powerful generative models in medical imaging, enabling the synthesis of high quality brain magnetic resonance imaging scans. In particular, predicting the evolution of a patients brain can aid in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Duy-Phuong Dao , Muhammad Taqiyuddin , Jahae Kim , Sang-Heon Lee , Hye-Won Jung , Jaehoo Choi , Hyung-Jeong Yang

Autonomous driving, as an agent operating in the physical world, requires the fundamental capability to build \textit{world models} that capture how the environment evolves spatiotemporally in order to support long-term planning. At the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Haoran Zhu , Anna Choromanska

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Electroencephalography (EEG) is a non-invasive technique widely used in brain-computer interfaces and clinical applications, yet existing EEG foundation models face limitations in modeling spatio-temporal brain dynamics and lack channel…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Danny Dongyeop Han , Ahhyun Lucy Lee , Taeyang Lee , Yonghyeon Gwon , Sebin Lee , Seongjin Lee , David Keetae Park , Shinjae Yoo , Jiook Cha , Chun Kee Chung

Language representation learning has emerged as a promising approach for sequential recommendation, thanks to its ability to learn generalizable representations. However, despite its advantages, this approach still struggles with data…

Information Retrieval · Computer Science 2025-08-08 Minh-Anh Nguyen , Dung D. Le

The development of multimodal models for pulmonary nodule diagnosis is limited by the scarcity of labeled data and the tendency for these models to overfit on the training distribution. In this work, we leverage self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Thomas Z. Li , Aravind R. Krishnan , Lianrui Zuo , John M. Still , Kim L. Sandler , Fabien Maldonado , Thomas A. Lasko , Bennett A. Landman

Two competing paradigms exist for self-supervised learning of data representations. Joint Embedding Predictive Architecture (JEPA) is a class of architectures in which semantically similar inputs are encoded into representations that are…

Machine Learning · Computer Science 2024-07-08 Etai Littwin , Omid Saremi , Madhu Advani , Vimal Thilak , Preetum Nakkiran , Chen Huang , Joshua Susskind

In this work, we propose a novel data-driven machine learning (ML) technique to model and predict the dynamics of the wireless propagation environment in latent space. Leveraging the idea of channel charting, which learns compressed…

Machine Learning · Computer Science 2024-09-17 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis