English
Related papers

Related papers: Living Synthetic Benchmarks: A Neutral and Cumulat…

200 papers

Simulation studies are indispensable for evaluating statistical methods and ubiquitous in statistical research. The most common simulation approach is parametric simulation, where the data-generating mechanism (DGM) corresponds to a…

Method comparisons are essential to provide recommendations and guidance for applied researchers, who often have to choose from a plethora of available approaches. While many comparisons exist in the literature, these are often not neutral…

Methodology · Statistics 2022-12-07 Sarah Friedrich , Tim Friede

Synthetic datasets are important for evaluating and testing machine learning models. When evaluating real-life recommender systems, high-dimensional categorical (and sparse) datasets are often considered. Unfortunately, there are not many…

Information Retrieval · Computer Science 2024-12-11 Miha Malenšek , Blaž Škrlj , Blaž Mramor , Jure Demšar

Discrete choice models (DCMs) have been widely utilized in various scientific fields, especially economics, for many years. These models consider a stochastic environment influencing each decision maker's choices. Extensive research has…

General Economics · Economics 2026-01-13 Amirreza Talebi

Comparative simulation studies are workhorse tools for benchmarking statistical methods. As with other empirical studies, the success of simulation studies hinges on the quality of their design, execution and reporting. If not conducted…

Methodology · Statistics 2023-03-10 Samuel Pawel , Lucas Kook , Kelly Reeve

Benchmark experiments are required to test, compare, tune, and understand optimization algorithms. Ideally, benchmark problems closely reflect real-world problem behavior. Yet, real-world problems are not always readily available for…

Neural and Evolutionary Computing · Computer Science 2020-08-17 Martin Zaefferer , Frederik Rehbach

In statistics, it is important to have realistic data sets available for a particular context to allow an appropriate and objective method comparison. For many use cases, benchmark data sets for method comparison are already available…

Applications · Statistics 2024-05-30 Maria Thurow , Ina Dormuth , Christina Sauer , Marc Ditzhaus , Markus Pauly

While synthetic data hold great promise for privacy protection, their statistical analysis poses significant challenges that necessitate innovative solutions. The use of deep generative models (DGMs) for synthetic data generation is known…

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

The ability to research and synthesize knowledge is central to human expertise and progress. A new class of AI systems--designed for generative research synthesis--aims to automate this process by retrieving information from the live web…

Computation and Language · Computer Science 2026-02-10 Liana Patel , Negar Arabzadeh , Harshit Gupta , Ankita Sundar , Ion Stoica , Matei Zaharia , Carlos Guestrin

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Dynamic benchmarks interweave model fitting and data collection in an attempt to mitigate the limitations of static benchmarks. In contrast to an extensive theoretical and empirical study of the static setting, the dynamic counterpart lags…

Machine Learning · Computer Science 2023-03-03 Ali Shirali , Rediet Abebe , Moritz Hardt

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of interest; this task is…

Machine Learning · Computer Science 2023-12-29 Ellis R. Crabtree , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

We introduce dynamic nested sampling: a generalisation of the nested sampling algorithm in which the number of "live points" varies to allocate samples more efficiently. In empirical tests the new method significantly improves calculation…

Computation · Statistics 2019-08-27 Edward Higson , Will Handley , Mike Hobson , Anthony Lasenby

This survey aims at providing a comprehensive overview of the recent trends in the field of modeling and simulation (M&S) of interactions between users and recommender systems and applications of the M&S to the performance improvement of…

Simulators are a critical component of modern robotics research. Strategies for both perception and decision making can be studied in simulation first before deployed to real world systems, saving on time and costs. Despite significant…

Machine Learning · Computer Science 2020-11-19 Bhairav Mehta , Ankur Handa , Dieter Fox , Fabio Ramos

This paper presents a novel collaborative generative modeling (CGM) framework that incentivizes collaboration among self-interested parties to contribute data to a pool for training a generative model (e.g., GAN), from which synthetic data…

Machine Learning · Computer Science 2021-12-20 Sebastian Shenghong Tay , Xinyi Xu , Chuan Sheng Foo , Bryan Kian Hsiang Low

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

Deep Generative Models (DGMs) are versatile tools for learning data representations while adequately incorporating domain knowledge such as the specification of conditional probability distributions. Recently proposed DGMs tackle the…

Machine Learning · Computer Science 2024-01-30 Romain Lopez , Jan-Christian Huetter , Ehsan Hajiramezanali , Jonathan Pritchard , Aviv Regev

Deep Generative Models (DGMs) have been shown to be powerful tools for generating tabular data, as they have been increasingly able to capture the complex distributions that characterize them. However, to generate realistic synthetic data,…

Machine Learning · Computer Science 2024-02-08 Mihaela Cătălina Stoian , Salijona Dyrmishi , Maxime Cordy , Thomas Lukasiewicz , Eleonora Giunchiglia
‹ Prev 1 2 3 10 Next ›