English
Related papers

Related papers: Clinically-Inspired Multi-Agent Transformers for D…

200 papers

Multimodal demand forecasting aims at predicting product demand utilizing visual, textual, and contextual information. This paper proposes a method for multimodal product demand forecasting using convolutional, graph-based, and…

Machine Learning · Computer Science 2023-07-07 Maarten Sukel , Stevan Rudinac , Marcel Worring

Robust forecasting of the future anatomical changes inflicted by an ongoing disease is an extremely challenging task that is out of grasp even for experienced healthcare professionals. Such a capability, however, is of great importance…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Dmitrii Lachinov , Arunava Chakravarty , Christoph Grechenig , Ursula Schmidt-Erfurth , Hrvoje Bogunovic

Healthcare and medicine are multimodal disciplines that deal with multimodal data for reasoning and diagnosing multiple diseases. Although some multimodal reasoning models have emerged for reasoning complex tasks in scientific domains,…

Artificial Intelligence · Computer Science 2025-09-16 Susanta Mitra

The prediction of mild cognitive impairment (MCI) conversion to Alzheimer's disease (AD) is important for early treatment to prevent or slow the progression of AD. To accurately predict the MCI conversion to stable MCI or progressive MCI,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Linfeng Liu , Junyan Lyu , Siyu Liu , Xiaoying Tang , Shekhar S. Chandra , Fatima A. Nasrallah

In this study, we employ a transformer encoder model to characterize the significance of longitudinal patient data for forecasting the progression of Alzheimer's Disease (AD). Our model, Longitudinal Forecasting Model for Alzheimer's…

Machine Learning · Computer Science 2024-05-28 Batuhan K. Karaman , Mert R. Sabuncu

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

The longitudinal modeling of neuroanatomical changes related to Alzheimer's disease (AD) is crucial for studying the progression of the disease. To this end, we introduce TransforMesh, a spatio-temporal network based on transformers that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Ignacio Sarasua , Sebastian Pölsterl , Christian Wachinger

Motion forecasts of road users (i.e., agents) vary in complexity depending on the number of agents, scene constraints, and interactions. In particular, the output space of joint trajectory distributions grows exponentially with the number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Royden Wagner , Omer Sahin Tas , Felix Hauser , Marlon Steiner , Dominik Strutz , Abhishek Vivekanandan , Jaime Villa , Yinzhe Shen , Carlos Fernandez , Christoph Stiller

Human intention prediction is a growing area of research where an activity in a video has to be anticipated by a vision-based system. To this end, the model creates a representation of the past, and subsequently, it produces future…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nada Osman , Guglielmo Camporese , Lamberto Ballan

We address multi-modal trajectory forecasting of agents in unknown scenes by formulating it as a planning problem. We present an approach consisting of three models; a goal prediction model to identify potential goals of the agent, an…

Robotics · Computer Science 2019-05-30 Nachiket Deo , Mohan M. Trivedi

Disorders of consciousness are a heterogeneous mixture of different diseases or injuries. Although some indicators and models have been proposed for prognostication, any single method when used alone carries a high risk of false prediction.…

Neurons and Cognition · Quantitative Biology 2018-09-10 Ming Song , Yi Yang , Jianghong He , Zhengyi Yang , Shan Yu , Qiuyou Xie , Xiaoyu Xia , Yuanyuan Dang , Qiang Zhang , Xinhuai Wu , Yue Cui , Bing Hou , Ronghao Yu , Ruxiang Xu , Tianzi Jiang

Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jaewoo Jeong , Daehee Park , Kuk-Jin Yoon

Autonomous transportation systems such as road vehicles or vessels require the consideration of the static and dynamic environment to dislocate without collision. Anticipating the behavior of an agent in a given situation is required to…

Machine Learning · Computer Science 2024-06-06 Kathrin Donandt , Dirk Söffker

Progressive diseases worsen over time and are characterised by monotonic change in features that track disease progression. Here we connect ideas from two formerly separate methodologies -- event-based and hidden Markov modelling -- to…

Machine Learning · Computer Science 2021-06-07 Peter A. Wijeratne , Daniel C. Alexander

This study addresses the challenges of symptom evolution complexity and insufficient temporal dependency modeling in Parkinson's disease progression prediction. It proposes a unified prediction framework that integrates structural…

Machine Learning · Computer Science 2025-08-22 Jiacheng Hu , Bo Zhang , Ting Xu , Haifeng Yang , Min Gao

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Aishik Konwer , Xuan Xu , Joseph Bae , Chao Chen , Prateek Prasanna

Fusing structural-functional images of the brain has shown great potential to analyze the deterioration of Alzheimer's disease (AD). However, it is a big challenge to effectively fuse the correlated and complementary information from…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Qiankun Zuo , Junren Pan , Shuqiang Wang

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei

Predicting motion of surrounding agents is critical to real-world applications of tactical path planning for autonomous driving. Due to the complex temporal dependencies and social interactions of agents, on-line trajectory prediction is a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jingwen Zhao , Xuanpeng Li , Qifan Xue , Weigong Zhang

Knee osteoarthritis frequently exhibits discordance between structural damage observed in imaging and patient-reported symptoms such as pain. This mismatch complicates clinical interpretation and patient stratification and remains…

Machine Learning · Computer Science 2026-04-21 Pegah Ahadian , Mingrui Yang , Sixu Chen , Xiaojuan Li , Qiang Guan