English
Related papers

Related papers: Longitudinal Self-supervised Learning Using Neural…

200 papers

A large and diverse set of measurements are regularly collected during a patient's hospital stay to monitor their health status. Tools for integrating these measurements into severity scores, that accurately track changes in illness…

Artificial Intelligence · Computer Science 2015-11-13 Kirill Dyagilev , Suchi Saria

Inferring unbiased treatment effects has received widespread attention in the machine learning community. In recent years, our community has proposed numerous solutions in standard settings, high-dimensional treatment settings, and even…

Machine Learning · Computer Science 2024-03-19 Krzysztof Kacprzyk , Samuel Holt , Jeroen Berrevoets , Zhaozhi Qian , Mihaela van der Schaar

We detail a novel class of implicit neural models. Leveraging time-parallel methods for differential equations, Multiple Shooting Layers (MSLs) seek solutions of initial value problems via parallelizable root-finding algorithms. MSLs…

Machine Learning · Computer Science 2021-06-09 Stefano Massaroli , Michael Poli , Sho Sonoda , Taji Suzuki , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Glaucoma is a chronic eye disease characterized by optic neuropathy, leading to irreversible vision loss. It progresses gradually, often remaining undiagnosed until advanced stages. Early detection is crucial to monitor atrophy and develop…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Sayan Mandal

We propose a novel continual self-supervised learning method (CSSL) considering medical domain knowledge in chest CT images. Our approach addresses the challenge of sequential learning by effectively capturing the relationship between…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Ren Tasai , Guang Li , Ren Togo , Minghui Tang , Takaaki Yoshimura , Hiroyuki Sugimori , Kenji Hirata , Takahiro Ogawa , Kohsuke Kudo , Miki Haseyama

Neural ordinary differential equations (Neural ODEs) is a class of machine learning models that approximate the time derivative of hidden states using a neural network. They are powerful tools for modeling continuous-time dynamical systems,…

Machine Learning · Statistics 2024-07-16 Wenbo Hao

The idea of neural Ordinary Differential Equations (ODE) is to approximate the derivative of a function (data model) instead of the function itself. In residual networks, instead of having a discrete sequence of hidden layers, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Seyedalireza Khoshsirat , Chandra Kambhamettu

Discovering the underlying relationships among variables from temporal observations has been a longstanding challenge in numerous scientific disciplines, including biology, finance, and climate science. The dynamics of such systems are…

Machine Learning · Computer Science 2024-05-07 Benjie Wang , Joel Jennings , Wenbo Gong

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

This work introduces Neural Chronos Ordinary Differential Equations (Neural CODE), a deep neural network architecture that fits a continuous-time ODE dynamics for predicting the chronology of a system both forward and backward in time. To…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of these systems' stochastic…

Machine Learning · Computer Science 2022-07-26 Jared O'Leary , Joel A. Paulson , Ali Mesbah

Identifying objective neuroimaging biomarkers to forecast Alzheimer's disease (AD) progression is crucial for timely intervention. However, this task remains challenging due to the complex dysfunctions in the spatio-temporal characteristics…

The scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Gerda Bortsova , Florian Dubost , Laurens Hogeweg , Ioannis Katramados , Marleen de Bruijne

Disease progression modeling (DPM) using longitudinal data is a challenging task in machine learning for healthcare that can provide clinicians with better tools for diagnosis and monitoring of disease. Existing DPM algorithms neglect…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Mostafa Mehdipour Ghazi , Mads Nielsen , Akshay Pai , M. Jorge Cardoso , Marc Modat , Sebastien Ourselin , Lauge Sørensen

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Neural Ordinary Differential Equations model dynamical systems with ODEs learned by neural networks. However, ODEs are fundamentally inadequate to model systems with long-range dependencies or discontinuities, which are common in…

Machine Learning · Computer Science 2022-06-15 Samuel Holt , Zhaozhi Qian , Mihaela van der Schaar

Discovering a suitable neural network architecture for modeling complex dynamical systems poses a formidable challenge, often involving extensive trial and error and navigation through a high-dimensional hyper-parameter space. In this…

Machine Learning · Computer Science 2024-03-26 Chinmay Datar , Adwait Datar , Felix Dietrich , Wil Schilders