English
Related papers

Related papers: Can You Rely on Your Model Evaluation? Improving M…

200 papers

Synthetic-to-real data translation using generative adversarial learning has achieved significant success in improving synthetic data. Yet, limited studies focus on deep evaluation and comparison of adversarial training on general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Tingwei Shen , Ganning Zhao , Suya You

A common approach to synthetic data is to sample from a fitted model. We show that under general assumptions, this approach results in a sample with inefficient estimators and whose joint distribution is inconsistent with the true…

Statistics Theory · Mathematics 2026-02-18 Jordan Awan , Zhanrui Cai

Ensuring the reliability of autonomous driving perception systems requires extensive environment-based testing, yet real-world execution is often impractical. Synthetic datasets have therefore emerged as a promising alternative, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Dingyi Yao , Xinyao Han , Ruibo Ming , Zhihang Song , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

Artificial Intelligence · Computer Science 2026-01-27 Michael Majurski , Cynthia Matuszek

The use of synthetic data to deidentify data and to improve predictive models is well-attested to. The augmentation of datasets using synthetically generated data is an alluring proposition: in the best case, it generates realistic data…

Methodology · Statistics 2026-03-20 Reid Dale , Jordan Rodu , Mike Baiocchi

Simulation methods have always been instrumental in finance, and data-driven methods with minimal model specification, commonly referred to as generative models, have attracted increasing attention, especially after the success of deep…

Portfolio Management · Quantitative Finance 2025-04-24 Adil Rengim Cetingoz , Charles-Albert Lehalle

Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many…

Machine Learning · Computer Science 2023-09-29 Shin'ya Yamaguchi

Synthetic data generation has become a key ingredient for training machine learning procedures, addressing tasks such as data augmentation, analysing privacy-sensitive data, or visualising representative samples. Assessing the quality of…

Machine Learning · Statistics 2022-06-02 Wenkai Xu , Gesine Reinert

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently…

Computation and Language · Computer Science 2023-10-16 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ming Yin

Causal inference is essential for developing and evaluating medical interventions, yet real-world medical datasets are often difficult to access due to regulatory barriers. This makes synthetic data a potentially valuable asset that enables…

Machine Learning · Computer Science 2025-10-22 Harry Amad , Zhaozhi Qian , Dennis Frauen , Julianna Piskorz , Stefan Feuerriegel , Mihaela van der Schaar

As the demand for high-quality training data escalates, researchers have increasingly turned to generative models to create synthetic data, addressing data scarcity and enabling continuous model improvement. However, reliance on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Zeliang Zhang , Xin Liang , Mingqian Feng , Susan Liang , Chenliang Xu

The evaluation of supervised machine learning models is a critical stage in the development of reliable predictive systems. Despite the widespread availability of machine learning libraries and automated workflows, model assessment is often…

Machine Learning · Computer Science 2026-04-16 Xuanyan Liu , Ignacio Cabrera Martin , Marcello Trovati , Xiaolong Xu , Nikolaos Polatidis

A growing number of approaches exist to generate explanations for image classification. However, few of these approaches are subjected to human-subject evaluations, partly because it is challenging to design controlled experiments with…

Artificial Intelligence · Computer Science 2021-05-07 Martin Schuessler , Philipp Weiß , Leon Sixt

Within the evolving landscape of deep learning, the dilemma of data quantity and quality has been a long-standing problem. The recent advent of Large Language Models (LLMs) offers a data-centric solution to alleviate the limitations of…

Computation and Language · Computer Science 2024-06-24 Lin Long , Rui Wang , Ruixuan Xiao , Junbo Zhao , Xiao Ding , Gang Chen , Haobo Wang

Generative models can serve as surrogates for some real data sources by creating synthetic training datasets, but in doing so they may transfer biases to downstream tasks. We focus on protecting quality and diversity when generating…

Computers and Society · Computer Science 2025-09-08 Allen Chang , Matthew C. Fontaine , Serena Booth , Maja J. Matarić , Stefanos Nikolaidis

Phase III randomized clinical trials play a monumentally critical role in the evaluation of new medical products. Because of the intrinsic nature of uncertainty embedded in our capability in assessing the efficacy of a medical product,…

Methodology · Statistics 2019-02-25 Changyu Shen , Xiaochun Li

Deep neural networks have achieved impressive performance on many computer vision benchmarks in recent years. However, can we be confident that impressive performance on benchmarks will translate to strong performance in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Josh Goldman , John K. Tsotsos

In recent years fully-parametric fast simulation methods based on generative models have been proposed for a variety of high-energy physics detectors. By their nature, the quality of data-driven models degrades in the regions of the phase…

Machine Learning · Computer Science 2023-03-03 Lucio Anderlini , Constantine Chimpoesh , Nikita Kazeev , Agata Shishigina

Due to the difficulty of acquiring extensive real-world data, robot simulation has become crucial for parallel training and sim-to-real transfer, highlighting the importance of scalable simulated robotic tasks. Foundation models have…

Robotics · Computer Science 2024-10-11 Feng Chen , Botian Xu , Pu Hua , Peiqi Duan , Yanchao Yang , Yi Ma , Huazhe Xu
‹ Prev 1 3 4 5 6 7 10 Next ›