English
Related papers

Related papers: Self-Organizing Score-based Data Assimilation

200 papers

Active learning is to design label-efficient algorithms by sampling the most representative samples to be labeled by an oracle. In this paper, we propose a state relabeling adversarial active learning model (SRAAL), that leverages both the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Beichen Zhang , Liang Li , Shijie Yang , Shuhui Wang , Zheng-Jun Zha , Qingming Huang

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

Handling sparse and unstructured geometric data, such as point clouds or event-based vision, is a pressing challenge in the field of machine vision. Recently, sequence models such as Transformers and state-space models entered the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Mark Schöne , Yash Bhisikar , Karan Bania , Khaleelulla Khan Nazeer , Christian Mayr , Anand Subramoney , David Kappel

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

We apply two data assimilation (DA) methods, a smoother and a filter, and a model-free machine learning (ML) shallow network to forecast two weakly turbulent systems. We analyse the effect of the spatial sparsity of observations on accuracy…

Fluid Dynamics · Physics 2024-07-16 Vikrant Gupta , Yuanqing Chen , Minping Wan

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

In the era of big data, many big organizations are integrating machine learning into their work pipelines to facilitate data analysis. However, the performance of their trained models is often restricted by limited and imbalanced data…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Jiaying Zhou , Jie Ding , Yi Zhou

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future…

Machine Learning · Statistics 2020-07-27 Julien Brajard , Alberto Carassi , Marc Bocquet , Laurent Bertino

Prediction of chaotic systems relies on a floating fusion of sensor data (observations) with a numerical model to decide on a good system trajectory and to compensate nonlinear feedback effects. Ensemble-based data assimilation (DA) is a…

Computational Engineering, Finance, and Science · Computer Science 2020-11-26 Sebastian Friedemann , Bruno Raffin

Semi-supervised domain adaptation (SSDA) is to adapt a learner to a new domain with only a small set of labeled samples when a large labeled dataset is given on a source domain. In this paper, we propose a pair-based SSDA method that adapts…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Jeongbeen Yoon , Dahyun Kang , Minsu Cho

Many econometric analyses involve spatio--temporal data. A considerable amount of literature has addressed spatio--temporal models, with Spatial Dynamic Panel Data (SDPD) being widely investigated and applied. In real data applications,…

Methodology · Statistics 2016-07-18 Maria Lucia Parrella

The machine learning community is increasingly recognizing the importance of fostering trust and safety in modern generative AI (GenAI) models. We posit machine unlearning (MU) as a crucial foundation for developing safe, secure, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Tianqi Chen , Shujian Zhang , Mingyuan Zhou

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In…

Machine Learning · Computer Science 2021-10-13 Foozhan Ataiefard , Mohammad Jafar Mashhadi , Hadi Hemmati , Niel Walkinshaw

State-space models can be used to incorporate subject knowledge on the underlying dynamics of a time series by the introduction of a latent Markov state-process. A user can specify the dynamics of this process together with how the state…

Computation · Statistics 2017-09-14 Paul Fearnhead , Hans Künsch

Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction…

Machine Learning · Statistics 2023-03-07 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis , Petros Koumoutsakos

Healthcare providers are increasingly using machine learning to predict patient outcomes to make meaningful interventions. However, despite innovations in this area, deep learning models often struggle to match performance of shallow linear…

Machine Learning · Computer Science 2020-12-18 Rohan S. Kodialam , Rebecca Boiarsky , Justin Lim , Neil Dixit , Aditya Sai , David Sontag

This paper presents a fast algorithm for estimating hidden states of Bayesian state space models. The algorithm is a variation of amortized simulation-based inference algorithms, where a large number of artificial datasets are generated at…

Econometrics · Economics 2022-10-14 Ramis Khabibullin , Sergei Seleznev

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on…

Machine Learning · Computer Science 2025-10-08 Hedi Zisling , Ilan Naiman , Nimrod Berman , Supasorn Suwajanakorn , Omri Azencot

State estimation for a class of linear time-invariant systems with distributed output measurements (distributed sensors) and unknown inputs is addressed in this paper. The objective is to design a network of observers such that the state…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Guitao Yang , Angelo Barboni , Hamed Rezaee , Thomas Parisini

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li