English
Related papers

Related papers: Data Quality Measures and Data Cleansing for Resea…

200 papers

The world is becoming increasingly complex, both in terms of the rich sources of data we have access to as well as in terms of the statistical and computational methods we can use on those data. These factors create an ever-increasing risk…

Computation · Statistics 2021-08-09 Ricardo Sanchez , Beth Ann Griffin , Joseph Pane , Daniel McCaffrey

Research data and software are widely accepted as an outcome of scientific work. However, in comparison to text-based publications, there is not yet an established process to assess and evaluate quality of research data and research…

Information retrieval systems such as open web search and recommendation systems are ubiquitous and significantly impact how people receive and consume online information. Previous research has shown the importance of fairness in…

Information Retrieval · Computer Science 2025-03-28 Fumian Chen , Hui Fang

In clinical diagnosis, diagnostic images that are obtained from the scanning devices serve as preliminary evidence for further investigation in the process of delivering quality healthcare. However, often the medical image may contain fault…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Karthik K , Sowmya Kamath S

The wide use of machine learning is fundamentally changing the software development paradigm (a.k.a. Software 2.0) where data becomes a first-class citizen, on par with code. As machine learning is used in sensitive applications, it becomes…

Databases · Computer Science 2019-04-25 Ki Hyun Tae , Yuji Roh , Young Hun Oh , Hyunsu Kim , Steven Euijong Whang

The quality of underlying training data is very crucial for building performant machine learning models with wider generalizabilty. However, current machine learning (ML) tools lack streamlined processes for improving the data quality. So,…

Machine Learning · Computer Science 2021-12-16 Atindriyo Sanyal , Vikram Chatterji , Nidhi Vyas , Ben Epstein , Nikita Demir , Anthony Corletti

The increasing size and availability of web data make data quality a core challenge in many applications. Principles of data quality are recognized as essential to ensure that data fit for their intended use in operations, decision-making,…

Digital Libraries · Computer Science 2013-05-20 Ahmad Assaf , Aline Senart

In supervised learning, the question of data quality and curation has been over-shadowed in recent years by increasingly more powerful and expressive models that can ingest internet-scale data. However, in offline learning for robotics, we…

Robotics · Computer Science 2023-06-06 Suneel Belkhale , Yuchen Cui , Dorsa Sadigh

The overwhelming volume of data generated and indexed by search engines poses a significant challenge in retrieving documents from the index efficiently and effectively. Even with a well-crafted query, several relevant documents often get…

Information Retrieval · Computer Science 2023-10-17 Aman Sinha , Priyanshu Raj Mall , Dwaipayan Roy

Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods,…

Ranked lists are frequently used by information retrieval (IR) systems to present results believed to be relevant to the users information need. Fairness is a relatively new but important aspect of these rankings to measure, joining a rich…

Information Retrieval · Computer Science 2022-01-11 Amifa Raj , Michael D. Ekstrand

Deep learning benefits from the growing abundance of available data. Meanwhile, efficiently dealing with the growing data scale has become a challenge. Data publicly available are from different sources with various qualities, and it is…

Data is evolving with the rapid progress of population and communication for various types of devices such as networks, cloud computing, Internet of Things (IoT), actuators, and sensors. The increment of data and communication content goes…

Machine Learning · Computer Science 2021-02-05 Swarajya Lakshmi V Papineni , Snigdha Yarlagadda , Harita Akkineni , A. Mallikarjuna Reddy

The emergence of "big data" offers unprecedented opportunities for not only accelerating scientific advances but also enabling new modes of discovery. Scientific progress in many disciplines is increasingly enabled by our ability to examine…

Computers and Society · Computer Science 2017-07-03 Vasant G. Honavar , Mark D. Hill , Katherine Yelick

This research aims to examine the usefulness of integrating various feature selection methods with regression algorithms for sleep quality prediction. A publicly accessible sleep quality dataset is used to analyze the effect of different…

Machine Learning · Computer Science 2023-03-07 Sai Rohith Tanuku , Venkat Tummala

Multiple advantages had been identified with the integration of data acquisition into any existing system configuration and implementation. Using data acquisition as a support into a monitoring system has not only improved its overall…

Systems and Control · Electrical Eng. & Systems 2025-07-15 Chito A. Petilla

Test collections are crucial for evaluating Information Retrieval (IR) systems. Creating a diverse set of user queries for these collections can be challenging, and obtaining relevance judgments, which indicate how well retrieved documents…

Information Retrieval · Computer Science 2025-10-07 Hossein A. Rahmani , Varsha Ramineni , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

Offline evaluation is a popular approach to determine the best algorithm in terms of the chosen quality metric. However, if the chosen metric calculates something unexpected, this miscommunication can lead to poor decisions and wrong…

Information Retrieval · Computer Science 2022-06-28 Yan-Martin Tamm , Rinchin Damdinov , Alexey Vasilev

Software quality is considered as one of the most important challenges in software engineering. It has many dimensions which differ from users' point of view that depend on their requirements. Therefore, those dimensions lead to difficulty…

Software Engineering · Computer Science 2019-06-21 Anas Shatnawi

Various techniques have been proposed to leverage the capabilities of code language models (CLMs) for SE tasks. While these techniques typically evaluate their effectiveness using publicly available datasets, the evaluation can be subject…

Software Engineering · Computer Science 2024-03-29 Jialun Cao , Wuqi Zhang , Shing-Chi Cheung