English
Related papers

Related papers: Clinically-Inspired Multi-Agent Transformers for D…

200 papers

Predicting the future behavior of agents is a fundamental task in autonomous vehicle domains. Accurate prediction relies on comprehending the surrounding map, which significantly regularizes agent behaviors. However, existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Chen Feng , Hangning Zhou , Huadong Lin , Zhigang Zhang , Ziyao Xu , Chi Zhang , Boyu Zhou , Shaojie Shen

Computational models that forecast the progression of Alzheimer's disease at the patient level are extremely useful tools for identifying high risk cohorts for early intervention and treatment planning. The state-of-the-art work in this…

Machine Learning · Computer Science 2019-12-30 Surya Teja Devarakonda , Joie Yeahuay Wu , Yi Ren Fung , Madalina Fiterau

In this study, we present a novel approach for predicting genomic information from medical imaging modalities using a transformer-based model. We aim to bridge the gap between imaging and genomics data by leveraging transformer networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Aiman Farooq , Deepak Mishra , Santanu Chaudhury

The development of statistical approaches for the joint modelling of the temporal changes of imaging, biochemical, and clinical biomarkers is of paramount importance for improving the understanding of neurodegenerative disorders, and for…

Applications · Statistics 2018-02-16 Marco Lorenzi , Maurizio Filippone , Daniel C. Alexander , Sebastien Ourselin

Recent deep learning research based on Transformer model architectures has demonstrated state-of-the-art performance across a variety of domains and tasks, mostly within the computer vision and natural language processing domains. While…

Machine Learning · Computer Science 2021-11-11 Benjamin Shickel , Patrick J. Tighe , Azra Bihorac , Parisa Rashidi

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Alzheimer's disease, a neurodegenerative disorder, is associated with neural, genetic, and proteomic factors while affecting multiple cognitive and behavioral faculties. Traditional AD prediction largely focuses on univariate disease…

Trajectory prediction and behavioral decision-making are two important tasks for autonomous vehicles that require good understanding of the environmental context; behavioral decisions are better made by referring to the outputs of…

Machine Learning · Computer Science 2022-06-20 Hongyu Hu , Qi Wang , Zhengguang Zhang , Zhengyi Li , Zhenhai Gao

Prediction of the future trajectory of a disease is an important challenge for personalized medicine and population health management. However, many complex chronic diseases exhibit large degrees of heterogeneity, and furthermore there is…

Machine Learning · Statistics 2016-08-17 Joseph Futoma , Mark Sendak , C. Blake Cameron , Katherine Heller

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Forecasting the trajectory of pedestrians in shared urban traffic environments is still considered one of the challenging problems facing the development of autonomous vehicles (AVs). In the literature, this problem is often tackled using…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Khaled Saleh

Joint models for longitudinal and time-to-event data are commonly used in longitudinal studies to forecast disease trajectories over time. While there are many advantages to joint modeling, the standard forms suffer from limitations that…

Machine Learning · Statistics 2019-09-09 Bryan Lim , Mihaela van der Schaar

Trajectory forecasting, or trajectory prediction, of multiple interacting agents in dynamic scenes, is an important problem for many applications, such as robotic systems and autonomous driving. The problem is a great challenge because of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yanliang Zhu , Dongchun Ren , Mingyu Fan , Deheng Qian , Xin Li , Huaxia Xia

Agent modeling is a critical component in developing effective policies within multi-agent systems, as it enables agents to form beliefs about the behaviors, intentions, and competencies of others. Many existing approaches assume access to…

Multiagent Systems · Computer Science 2025-08-06 Conor Wallace , Umer Siddique , Yongcan Cao

Predicting the behaviour (i.e., manoeuvre/trajectory) of other road users, including vehicles, is critical for the safe and efficient operation of autonomous vehicles (AVs), a.k.a., automated driving systems (ADSs). Due to the uncertain…

Machine Learning · Computer Science 2023-07-27 Sajjad Mozaffari , Mreza Alipour Sormoli , Konstantinos Koufos , Mehrdad Dianati

Motion prediction plays an important role in autonomous driving. This study presents LMFormer, a lane-aware transformer network for trajectory prediction tasks. In contrast to previous studies, our work provides a simple mechanism to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen

Clinical predictions using clinical data by computational methods are common in bioinformatics. However, clinical predictions using information from genomics datasets as well is not a frequently observed phenomenon in research. Precision…

Genomics · Quantitative Biology 2021-06-25 Moeez M. Subhani , Ashiq Anjum

Event-Based Models (EBMs) infer biomarker progression from cross-sectional data but typically only as ordinal sequences and rely on rigid model assumptions. We propose \textsc{Tempo}, a Transformer architecture that learns both ordinal and…

Machine Learning · Computer Science 2026-04-28 Hongtao Hao , Joseph L. Austerweil

Pre-symptomatic (or Preclinical) Alzheimer's Disease is defined by biomarker evidence of fibrillar amyloid beta pathology in the absence of clinical symptoms. Clinical trials in this early phase of disease are challenging due to the slow…

Applications · Statistics 2020-03-10 Dan Li , Samuel Iddi , Paul S. Aisen , Wesley K. Thompson , Michael C. Donohue