English
Related papers

Related papers: BlackBox: Generalizable Reconstruction of Extremal…

200 papers

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

A method for estimating return values from ensembles of forecasts at advanced lead times is presented. Return values of significant wave height in the North-East Atlantic, the Norwegian Sea and the North Sea are computed from archived…

Atmospheric and Oceanic Physics · Physics 2013-04-05 Øyvind Breivik , Ole Johan Aarnes , Jean-Raymond Bidlot , Ana Carrasco , Øyvind Saetra

We introduce the problem of reconstructing a sequence of multidimensional real vectors where some of the data are missing. This problem contains regression and mapping inversion as particular cases where the pattern of missing data is…

Machine Learning · Computer Science 2011-09-16 Miguel Á. Carreira-Perpiñán

The spatio-temporal relations of impacts of extreme events and their drivers in climate data are not fully understood and there is a need of machine learning approaches to identify such spatio-temporal relations from data. The task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Mohamad Hakam Shams Eddin , Juergen Gall

Data-driven algorithms, in particular neural networks, can emulate the effect of sub-grid scale processes in coarse-resolution climate models if trained on high-resolution climate simulations. However, they may violate key physical…

Atmospheric and Oceanic Physics · Physics 2020-04-21 Tom Beucler , Michael Pritchard , Pierre Gentine , Stephan Rasp

We study distributional robustness in the context of Extreme Value Theory (EVT). We provide a data-driven method for estimating extreme quantiles in a manner that is robust against incorrect model assumptions underlying the application of…

Statistics Theory · Mathematics 2020-06-09 Jose Blanchet , Fei He , Karthyek R. A. Murthy

We present a new data-driven model to reconstruct nonlinear flow from spatially sparse observations. The model is a version of a conditional variational auto-encoder (CVAE), which allows for probabilistic reconstruction and thus uncertainty…

Machine Learning · Statistics 2021-02-24 Kristian Gundersen , Anna Oleynik , Nello Blaser , Guttorm Alendal

Extreme weather events have significant consequences, dominating the impact of climate on society. While high-resolution weather models can forecast many types of extreme events on synoptic timescales, long-term climatological risk…

Atmospheric and Oceanic Physics · Physics 2023-01-25 Justin Finkel , Edwin P. Gerber , Dorian S. Abbot , Jonathan Weare

Extreme value statistics provides accurate estimates for the small occurrence probabilities of rare events. While theory and statistical tools for univariate extremes are well-developed, methods for high-dimensional and complex data sets…

Methodology · Statistics 2021-01-06 Sebastian Engelke , Jevgenijs Ivanovs

Accurate reconstruction of environmental scalar fields from sparse onboard observations is essential for autonomous vehicles engaged in aquatic monitoring. Beyond point estimates, principled uncertainty quantification is critical for active…

It is often desirable to be able to recognize when inputs to a recognition function learned in a supervised manner correspond to classes unseen at training time. With this ability, new class labels could be assigned to these inputs by a…

Machine Learning · Computer Science 2017-05-23 Ethan M. Rudd , Lalit P. Jain , Walter J. Scheirer , Terrance E. Boult

We introduce $\textit{InExtremIS}$, a weakly supervised 3D approach to train a deep image segmentation network using particularly weak train-time annotations: only 6 extreme clicks at the boundary of the objects of interest. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Reuben Dorent , Samuel Joutard , Jonathan Shapey , Aaron Kujawa , Marc Modat , Sebastien Ourselin , Tom Vercauteren

In this paper we are concerned with the analysis of heavy-tailed data when a portion of the extreme values is unavailable. This research was motivated by an analysis of the degree distributions in a large social network. The degree…

Statistics Theory · Mathematics 2018-12-20 Jingjing Zou , Richard A. Davis , Gennady Samorodnitsky

Conventional methods for extreme event estimation rely on well-chosen parametric models asymptotically justified from extreme value theory (EVT). These methods, while powerful and theoretically grounded, could however encounter a difficult…

Methodology · Statistics 2023-01-05 Yuanlu Bai , Henry Lam , Xinyu Zhang

Although a large number of optimization algorithms have been proposed for black box optimization problems, the no free lunch theorems inform us that no algorithm can beat others on all types of problems. Different types of optimization…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Yaodong He , Shiu Yin Yuen

Extreme response assessment is important in the design and operation of engineering structures, and is a crucial part of structural risk and reliability analyses. Structures should be designed in a way that enables them to withstand the…

Computation · Statistics 2025-03-04 Sebastian Winter , Christian Agrell , Juan Camilo Guevara Gómez , Erik Vanem

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

The lack of interpretability often makes black-box models difficult to be applied to many practical domains. For this reason, the current work, from the black-box model input port, proposes to incorporate data-based prior information into…

Machine Learning · Statistics 2019-02-05 Shaohan Chen , Chuanhou Gao , Ping Zhang

Modeling the risk of extreme weather events in a changing climate is essential for developing effective adaptation and mitigation strategies. Although the available low-resolution climate models capture different scenarios, accurate risk…

Atmospheric and Oceanic Physics · Physics 2022-12-06 Anamitra Saha , Sai Ravela

Today, data analysts largely rely on intuition to determine whether missing or withheld rows of a dataset significantly affect their analyses. We propose a framework that can produce automatic contingency analysis, i.e., the range of values…

Databases · Computer Science 2020-04-09 Xi Liang , Zechao Shang , Aaron J. Elmore , Sanjay Krishnan , Michael J. Franklin