English
Related papers

Related papers: Ocean Data Quality Assessment through Outlier Dete…

200 papers

Global climate change plays an essential role in our daily life. Mesoscale ocean eddies have a significant impact on global warming, since they affect the ocean dynamics, the energy as well as the mass transports of ocean circulation. From…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Katharina Franz , Ribana Roscher , Andres Milioto , Susanne Wenzel , Jürgen Kusche

Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These…

Machine Learning · Computer Science 2021-03-31 Zejiang Shen , Jian Zhao , Melissa Dell , Yaoliang Yu , Weining Li

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Outlier detection (OD) has received continuous research interests due to its wide applications. With the development of deep learning, increasingly deep OD algorithms are proposed. Despite the availability of numerous deep OD models,…

Machine Learning · Computer Science 2023-05-29 Yihong Huang , Yuang Zhang , Liping Wang , Xuemin Lin

With diverse IoT workloads, placing compute and analytics close to where data is collected is becoming increasingly important. We seek to understand what is the performance and the cost implication of running analytics on IoT data at the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Karthick Shankar , Pengcheng Wang , Ran Xu , Ashraf Mahgoub , Somali Chaterji

Machines of all kinds from vehicles to industrial equipment are increasingly instrumented with hundreds of sensors. Using such data to detect anomalous behaviour is critical for safety and efficient maintenance. However, anomalies occur…

Artificial Intelligence · Computer Science 2016-05-06 Mohit Yadav , Pankaj Malhotra , Lovekesh Vig , K Sriram , Gautam Shroff

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly…

Databases · Computer Science 2025-11-26 Mariana M Garcez Duarte , Mahmoud Sakr

In this article, we consider the problem of outlier-robust state estimation where the measurement noise can be correlated. Outliers in data arise due to many reasons like sensor malfunctioning, environmental behaviors, communication…

Signal Processing · Electrical Eng. & Systems 2024-08-21 Aamir Hussain Chughtai , Muhammad Tahir , Momin Uppal

We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals…

Numerical Analysis · Mathematics 2024-01-23 Petr Karnakov , Sergey Litvinov , Petros Koumoutsakos

Annotating the right set of data amongst all available data points is a key challenge in many machine learning applications. Batch active learning is a popular approach to address this, in which batches of unlabeled data points are selected…

Machine Learning · Statistics 2021-04-20 Amirata Ghorbani , James Zou , Andre Esteva

We present a method to estimate two-dimensional, time-invariant oceanic flow fields based on data from both ensemble forecasts and online measurements. Our method produces a realistic estimate in a computationally efficient manner suitable…

Robotics · Computer Science 2021-03-24 K. Y. Cadmus To , Felix H. Kong , Ki Myung Brian Lee , Chanyeol Yoo , Stuart Anstee , Robert Fitch

Using unlabeled data to regularize the machine learning models has demonstrated promise for improving safety and reliability in detecting out-of-distribution (OOD) data. Harnessing the power of unlabeled in-the-wild data is non-trivial due…

Machine Learning · Computer Science 2024-02-07 Xuefeng Du , Zhen Fang , Ilias Diakonikolas , Yixuan Li

Machine learning and data analysis have been used in many robotics fields, especially for modelling. Data are usually the result of sensor measurements and, as such, they might be subjected to noise and outliers. The presence of outliers…

Robotics · Computer Science 2019-08-26 Francesco Cursi , Guang-Zhong Yang

Anomaly detection methods are part of the systems where rare events may endanger an operation's profitability, safety, and environmental aspects. Although many state-of-the-art anomaly detection methods were developed to date, their…

Machine Learning · Computer Science 2023-02-01 Marek Wadinger , Michal Kvasnica

Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID) data, causing a…

Machine Learning · Computer Science 2022-10-14 Yi-Xuan Sun , Wei Wang

We perform an out-of-distribution analysis of ~12,000,000 semi-independent 128x128 pixel^2 SST regions, which we define as cutouts, from all nighttime granules in the MODIS R2019 Level-2 public dataset to discover the most complex or…

Atmospheric and Oceanic Physics · Physics 2023-05-11 J. Xavier Prochaska , Peter C. Cornillon , David M. Reiman

Modern production data processing and machine learning pipelines on the cloud are critical components for many cloud-based companies. These pipelines are typically composed of complex workflows represented by directed acyclic graphs (DAGs).…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-14 Erica Lin , Luna Xu , Suraj Bramhavar , Marco Montes de Oca , Sean Gorsky , Lingyun Yi , Arianna Groetsema , Jeffrey Chou

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Siyu Huang , Tianyang Wang , Haoyi Xiong , Jun Huan , Dejing Dou

Radar sensors are emerging as solutions for perceiving surroundings and estimating ego-motion in extreme weather conditions. Unfortunately, radar measurements are noisy and suffer from mutual interference, which degrades the performance of…

Robotics · Computer Science 2023-03-06 Hyungtae Lim , Kawon Han , Gunhee Shin , Giseop Kim , Songcheol Hong , Hyun Myung

Seasonal climate forecasts are socioeconomically important for managing the impacts of extreme weather events and for planning in sectors like agriculture and energy. Climate predictability on seasonal timescales is tied to boundary effects…

Atmospheric and Oceanic Physics · Physics 2024-06-14 Chenggong Wang , Michael S. Pritchard , Noah Brenowitz , Yair Cohen , Boris Bonev , Thorsten Kurth , Dale Durran , Jaideep Pathak