English
Related papers

Related papers: Evaluation Challenges for Geospatial ML

200 papers

We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics that better capture the value delivered by their model in practical applications. For a specific class…

Machine Learning · Computer Science 2021-12-14 Fabio Casati , Pierre-André Noël , Jie Yang

While most work on evaluating machine learning (ML) models focuses on computing accuracy on batches of data, tracking accuracy alone in a streaming setting (i.e., unbounded, timestamp-ordered datasets) fails to appropriately identify when…

Machine Learning · Computer Science 2022-05-24 Shreya Shankar , Bernease Herman , Aditya G. Parameswaran

Current test and evaluation (T&E) methods for assessing machine learning (ML) system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating…

Software Engineering · Computer Science 2022-04-11 Violet Turri , Rachel Dzombak , Eric Heim , Nathan VanHoudnos , Jay Palat , Anusha Sinha

Image geolocation is a critical task in various image-understanding applications. However, existing methods often fail when analyzing challenging, in-the-wild images. Inspired by the exceptional background knowledge of multimodal language…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zhiqiang Wang , Dejia Xu , Rana Muhammad Shahroz Khan , Yanbin Lin , Zhiwen Fan , Xingquan Zhu

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are…

Machine Learning · Computer Science 2025-02-17 Tommaso Baldi , Javier Campos , Olivia Weng , Caleb Geniesse , Nhan Tran , Ryan Kastner , Alessandro Biondi

This paper describes and discusses our vision to develop and reason about best practices and novel ways of curating data-centric geosciences knowledge (data, experiments, models, methods, conclusions, and interpretations). This knowledge is…

In recent years, the geospatial industry has been developing at a steady pace. This growth implies the addition of satellite constellations that produce a copious supply of satellite imagery and other Remote Sensing data on a daily basis.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Alexandru Munteanu , Marian Neagul

Local spatial models such as Geographically Weighted Regression (GWR) and Multiscale Geographically Weighted Regression (MGWR) serve as instrumental tools to capture intrinsic contextual effects through the estimates of the local intercepts…

Comparing model performances on benchmark datasets is an integral part of measuring and driving progress in artificial intelligence. A model's performance on a benchmark dataset is commonly assessed based on a single or a small set of…

Artificial Intelligence · Computer Science 2021-11-09 Kathrin Blagec , Georg Dorffner , Milad Moradi , Matthias Samwald

Geocoding systems are widely used in both scientific research for spatial analysis and everyday life through location-based services. The quality of geocoded data significantly impacts subsequent processes and applications, underscoring the…

Deep learning tasks are often complicated and require a variety of components working together efficiently to perform well. Due to the often large scale of these tasks, there is a necessity to iterate quickly in order to attempt a variety…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Ritwik Gupta , Carson D. Sestili , Javier A. Vazquez-Trejo , Matthew E. Gaston

In recent years, machine learning has transitioned from a field of academic research interest to a field capable of solving real-world business problems. However, the deployment of machine learning models in production systems can present a…

Machine Learning · Computer Science 2022-05-20 Andrei Paleyes , Raoul-Gabriel Urma , Neil D. Lawrence

Spatial data is playing an emerging role in new technologies such as web and mobile mapping and Geographic Information Systems (GIS). Important decisions in political, social and many other aspects of modern human life are being made using…

Databases · Computer Science 2016-05-17 Bagher Saberi , Nasser Ghadiri

Combining satellite imagery with machine learning (SIML) has the potential to address global challenges by remotely estimating socioeconomic and environmental conditions in data-poor regions, yet the resource requirements of SIML limit its…

A large variety of geospatial data layers is available around the world ranging from remotely-sensed raster data like satellite imagery, digital elevation models, predicted land cover maps, and human-annotated data, to data derived from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Arjun Rao , Esther Rolf

When extreme weather events affect large areas, their regional to sub-continental spatial scale is important for their impacts. We propose a novel machine learning (ML) framework that integrates spatial extreme-value theory to model weather…

Applications · Statistics 2025-05-29 Jonathan Koh , Daniel Steinfeld , Olivia Martius

In the field of robotics, the point cloud has become an essential map representation. From the perspective of downstream tasks like localization and global path planning, points corresponding to dynamic objects will adversely affect their…

Robotics · Computer Science 2023-07-17 Qingwen Zhang , Daniel Duberg , Ruoyu Geng , Mingkai Jia , Lujia Wang , Patric Jensfelt

Spatial documentation is exponentially increasing given the availability of Big IoT Data, enabled by the devices miniaturization and data storage capacity. Bayesian spatial statistics is a useful statistical tool to determine the dependence…

Methodology · Statistics 2020-10-01 Francisco Louzada , Diego C. Nascimento , Osafu Augustine Egbon

The characteristics and determinants of health and disease are often organised in space, reflecting our spatially extended nature. Understanding the influence of such factors requires models capable of capturing spatial relations. Though a…

Successfully predicting gentrification could have many social and commercial applications; however, real estate sales are difficult to predict because they belong to a chaotic system comprised of intrinsic and extrinsic characteristics,…

Machine Learning · Statistics 2019-02-05 Timothy J. Kiely , Nathaniel D. Bastian