English
Related papers

Related papers: Machine Learning Techniques for Data Reduction of …

200 papers

Accurately representing surface weather at the sub-kilometer scale is crucial for optimal decision-making in a wide range of applications. This motivates the use of statistical techniques to provide accurate and calibrated probabilistic…

Atmospheric and Oceanic Physics · Physics 2024-11-15 Francesco Zanetta , Daniele Nerini , Matteo Buzzi , Henry Moss

This study examines the predictability of artificial intelligence (AI) models for weather prediction. Using a simple deep-learning architecture based on convolutional long short-term memory and the ERA5 data for training, we show that…

Atmospheric and Oceanic Physics · Physics 2024-10-07 Chanh Kieu

As a signal recovery algorithm, compressed sensing is particularly useful when the data has low-complexity and samples are rare, which matches perfectly with the task of quantum phase estimation (QPE). In this work we present a new…

Quantum Physics · Physics 2025-01-01 Changhao Yi , Cunlu Zhou , Jun Takahashi

Quantum autoencoder (QAE) compresses a bipartite quantum state into its subsystem by a self-checking mechanism. How to characterize the lost information in this process is essential to understand the compression mechanism of QAE\@. Here we…

Quantum Physics · Physics 2024-04-15 Yibin Huang , Muchun Yang , D. L. Zhou

Classical autoencoders are neural networks that can learn efficient low dimensional representations of data in higher dimensional space. The task of an autoencoder is, given an input $x$, is to map $x$ to a lower dimensional point $y$ such…

Quantum Physics · Physics 2017-12-25 Jonathan Romero , Jonathan P. Olson , Alan Aspuru-Guzik

Sharing forecasts of network timeseries data, such as cellular or electricity load patterns, can improve independent control applications ranging from traffic scheduling to power generation. Typically, forecasts are designed without…

Machine Learning · Computer Science 2021-10-06 Jiangnan Cheng , Marco Pavone , Sachin Katti , Sandeep Chinchali , Ao Tang

Data-driven modelling techniques provide a method for deriving models of dynamical systems directly from complicated data streams. However, tracking and forecasting such data streams poses a significant challenge to most methods, as they…

Dynamical Systems · Mathematics 2025-03-25 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

Existing methods for learning 3D representations are deep neural networks trained and tested on classical hardware. Quantum machine learning architectures, despite their theoretically predicted advantages in terms of speed and the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Lakshika Rathi , Edith Tretschk , Christian Theobalt , Rishabh Dabral , Vladislav Golyanik

Data encoding is a common and central operation in most data analysis tasks. The performance of other models downstream in the computational process highly depends on the quality of data encoding. One of the most powerful ways to encode…

Machine Learning · Computer Science 2025-09-03 Teddy Lazebnik , Liron Simon-Keren

Combinatorial optimization is a promising area for achieving quantum speedup. Quantum approximate optimization algorithm (QAOA) is designed to search for low-energy states of the Ising model, which correspond to near-optimal solutions of…

Quantum Physics · Physics 2025-10-14 Tatsuhiko Shirai , Nozomu Togawa

We introduce and study the problem of Online Continual Compression, where one attempts to simultaneously learn to compress and store a representative dataset from a non i.i.d data stream, while only observing each sample once. A naive…

Machine Learning · Computer Science 2020-08-24 Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Joelle Pineau

As the costs of sensors and associated IT infrastructure decreases - as exemplified by the Internet of Things - increasing volumes of observational data are becoming available for use by environmental scientists. However, as the number of…

Machine Learning · Statistics 2022-01-26 Charlie Kirkwood , Theo Economou , Henry Odbert , Nicolas Pugeault

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

Real-world data typically contain repeated and periodic patterns. This suggests that they can be effectively represented and compressed using only a few coefficients of an appropriate basis (e.g., Fourier, Wavelets, etc.). However, distance…

Machine Learning · Statistics 2014-05-26 Michail Vlachos , Nikolaos Freris , Anastasios Kyrillidis

The proliferation of data-driven models in weather and climate sciences has marked a significant paradigm shift, with advanced models demonstrating exceptional skill in medium-range forecasting. However, these models are often limited by…

Machine Learning · Computer Science 2026-02-17 Haiwen Guan , Moein Darman , Dibyajyoti Chakraborty , Troy Arcomano , Ashesh Chattopadhyay , Romit Maulik

Subsurface earth models (referred to as geo-models) are crucial for characterizing complex subsurface systems. Multiple-point statistics are commonly used to generate geo-models. In this paper, a deep-learning-based generative method is…

Geophysics · Physics 2023-08-23 Jungang Chen , Chung-Kan Huang , Jose F. Delgado , Siddharth Misra

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

We propose an iterative proposal to estimate critical points for statistical models based on configurations by combing machine-learning tools. Firstly, phase scenarios and preliminary boundaries of phases are obtained by…

Disordered Systems and Neural Networks · Physics 2019-10-23 X. L. Zhao , L. B. Fu

This paper proposes a model-free nonparametric estimator of conditional quantile of a time series regression model where the covariate vector is repeated many times for different values of the response. This type of data is abound in…

Methodology · Statistics 2021-07-07 Soudeep Deb , Kaushik Jana

Climate and weather prediction traditionally relies on complex numerical simulations of atmospheric physics. Deep learning approaches, such as transformers, have recently challenged the simulation paradigm with complex network forecasts.…

Artificial Intelligence · Computer Science 2024-04-17 Yogesh Verma , Markus Heinonen , Vikas Garg