English
Related papers

Related papers: Selection-Bias-Corrected Visualization via Dynamic…

200 papers

Variable selection in ultra-high dimensional regression problems has become an important issue. In such situations, penalized regression models may face computational problems and some pre screening of the variables may be necessary. A…

Methodology · Statistics 2020-05-01 Abhik Ghosh , Magne Thoresen

Today's scientific simulations generate exceptionally large volumes of data, challenging the capacities of available I/O bandwidth and storage space. This necessitates a substantial reduction in data volume, for which error-bounded lossy…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-02 Daoce Wang , Jesus Pulido , Pascal Grosset , Jiannan Tian , James Ahrens , Dingwen Tao

Data cleaning is often framed as a technical preprocessing step, yet in practice it relies heavily on human judgment. We report results from a controlled survey study in which participants performed error detection, data repair and…

Databases · Computer Science 2026-03-26 Hazim AbdElazim , Shadman Islam , Mostafa Milani

With the rapid development of vision tasks and the scaling on datasets and models, redundancy reduction in vision datasets has become a key area of research. To address this issue, dataset distillation (DD) has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yinjie Zhao , Heng Zhao , Bihan Wen , Yew-Soon Ong , Joey Tianyi Zhou

While the need for well-trained, fair ML systems is increasing ever more, measuring fairness for modern models and datasets is becoming increasingly difficult as they grow at an unprecedented pace. One key challenge in scaling common…

Artificial Intelligence · Computer Science 2022-01-19 Alex Bäuerle , Aybuke Gul Turker , Ken Burke , Osman Aka , Timo Ropinski , Christina Greer , Mani Varadarajan

Selection of covariates is crucial in the estimation of average treatment effects given observational data with high or even ultra-high dimensional pretreatment variables. Existing methods for this problem typically assume sparse linear…

Methodology · Statistics 2023-03-20 Juan Chen , Yingchun Zhou

Automated visualization recommendations (vis-rec) help users to derive crucial insights from new datasets. Typically, such automated vis-rec models first calculate a large number of statistics from the datasets and then use machine-learning…

Artificial Intelligence · Computer Science 2024-12-02 Ghazi Shazan Ahmad , Shubham Agarwal , Subrata Mitra , Ryan Rossi , Manav Doshi , Vibhor Porwal , Syam Manoj Kumar Paila

Post-click conversion, as a strong signal indicating the user preference, is salutary for building recommender systems. However, accurately estimating the post-click conversion rate (CVR) is challenging due to the selection bias, i.e., the…

Machine Learning · Computer Science 2022-01-11 Siyuan Guo , Lixin Zou , Yiding Liu , Wenwen Ye , Suqi Cheng , Shuaiqiang Wang , Hechang Chen , Dawei Yin , Yi Chang

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

When faced with new data, we often conduct a cluster analysis to obtain a better understanding of the data's structure and the archetypical samples present in the data. This process often includes visualization of the data, either as a way…

Applications · Statistics 2026-04-06 Justin Lin , Julia Fukuyama

The development of fair and ethical AI systems requires careful consideration of bias mitigation, an area often overlooked or ignored. In this study, we introduce a novel and efficient approach for addressing biases called Targeted Data…

Machine Learning · Computer Science 2023-08-23 Agnieszka Mikołajczyk-Bareła , Maria Ferlin , Michał Grochowski

The rapid development of tools for acquisition and storage of information has lead to the formation of enormous medical databases. The large quantity of data definitely surpasses the abilities of humans for efficient usage without…

Information Retrieval · Computer Science 2009-04-03 Petar Kormushev

Research on cognitive biases and heuristics has become increasingly popular in the visualization literature in recent years. Researchers have studied the effects of biases on visualization interpretation and subsequent decision-making.…

Human-Computer Interaction · Computer Science 2025-03-07 Ali Baigelenov , Prakash Shukla , Zixu Zhang , Paul Parsons

Symbolic regression (SR) aims to discover explicit mathematical expressions that explain observed data and is widely used in domains where interpretability is essential. Because interpretability requires expressions to reflect meaningful…

Neural and Evolutionary Computing · Computer Science 2026-05-18 Koki Ikeda , Masahiro Nomura , Ryoki Hamano

In scheduling problems common in the industry and various real-world scenarios, responding in real-time to disruptive events is essential. Recent methods propose the use of deep reinforcement learning (DRL) to learn policies capable of…

Artificial Intelligence · Computer Science 2024-01-31 Imanol Echeverria , Maialen Murua , Roberto Santana

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation,…

Machine Learning · Statistics 2023-05-26 Aditya Ravuri , Francisco Vargas , Vidhi Lalchand , Neil D. Lawrence

High-dimensional data that evolve dynamically feature predominantly in the modern data era. As a partial response to this, recent years have seen increasing emphasis to address the dimensionality challenge. However, the non-static nature of…

Methodology · Statistics 2019-01-21 Binyan Jiang , Ziqi Chen , Chenlei Leng

Finding the similarities and differences between groups of datasets is a fundamental analysis task. For high-dimensional data, dimensionality reduction (DR) methods are often used to find the characteristics of each group. However, existing…

Machine Learning · Computer Science 2021-10-28 Takanori Fujiwara , Xinhai Wei , Jian Zhao , Kwan-Liu Ma

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao