English
Related papers

Related papers: Tackling dataset curation challenges towards relia…

200 papers

Machine Learning (ML) is an expressive framework for turning data into computer programs. Across many problem domains -- both in industry and policy settings -- the types of computer programs needed for accurate prediction or optimal…

Machine Learning · Computer Science 2023-12-21 Elliot Creager

Training of Machine Learning (ML) models in real contexts often deals with big data sets and high-class imbalance samples where the class of interest is unrepresented (minority class). Practical solutions using classical ML models address…

Machine Learning · Computer Science 2022-10-11 Germán E. Melo-Acosta , Freddy Duitama-Muñoz , Julián D. Arias-Londoño

Machine learning (ML) can process large sets of data generated from complex systems, which is ideal for classification tasks as often appeared in critical phenomena. Meanwhile ML techniques have been found effective in detecting critical…

Computational Physics · Physics 2024-05-07 Shen Jianmin , Wang Shanshan , Li Wei , Xu Dian , Yang Yuxiang , Wang Yanyang , Gao Feng , Zhu Yueying , Tuo Kui

Deep learning on large-scale data is dominant nowadays. The unprecedented scale of data has been arguably one of the most important driving forces for the success of deep learning. However, there still exist scenarios where collecting data…

Machine Learning · Computer Science 2022-07-19 Xiaofeng Cao , Weiyang Liu , Ivor W. Tsang

Regression machine learning is widely applied to predict various materials. However, insufficient materials data usually leads to a poor performance. Here, we develop a new voting data-driven method that could generally improve the…

Materials Science · Physics 2020-12-22 Xing-Yu Ma , Hou-Yi Lyu , Xue-Juan Dong , Zhen Zhang , Kuan-Rong Hao , Qing-Bo Yan , Gang Su

The scarcity of high-quality, logically sound data is a critical bottleneck for advancing the mathematical reasoning of Large Language Models (LLMs). Our work confronts this challenge by turning decades of automated theorem proving research…

Computation and Language · Computer Science 2025-09-09 Valentin Quesnel , Damien Sileo

To curate a high-quality dataset, identifying data variance between the internal and external sources is a fundamental and crucial step. However, methods to detect shift or variance in data have not been significantly researched. Challenges…

Image and Video Processing · Electrical Eng. & Systems 2021-12-30 Xiaoyuan Guo , Judy Wawira Gichoya , Hari Trivedi , Saptarshi Purkayastha , Imon Banerjee

The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn…

Machine Learning · Computer Science 2018-11-09 Ivan Olier , Oghenejokpeme I. Orhobor , Joaquin Vanschoren , Ross D. King

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

The revolution in materials in the past century was built on a knowledge of the atomic arrangements and the structure-property relationship. The sine qua non for obtaining quantitative structural information is single crystal…

Computational Physics · Physics 2023-12-27 Gabe Guo , Judah Goldfeder , Ling Lan , Aniv Ray , Albert Hanming Yang , Boyuan Chen , Simon JL Billinge , Hod Lipson

Despite enormous efforts over the last decades to establish the relationship between concrete proportioning and strength, a robust knowledge-based model for accurate concrete strength predictions is still lacking. As an alternative to…

Machine Learning · Computer Science 2020-05-01 Boya Ouyang , Yuhai Li , Yu Song , Feishu Wu , Huizi Yu , Yongzhe Wang , Mathieu Bauchy , Gaurav Sant

The integration of large language model (LLM) and data management (DATA) is rapidly redefining both domains. In this survey, we comprehensively review the bidirectional relationships. On the one hand, DATA4LLM, spanning large-scale data…

Modification of physical properties of materials and design of materials with on-demand characteristics is at the heart of modern technology. Rare application relies on pure materials--most devices and technologies require careful design of…

Data science and artificial intelligence are playing an increasingly important role in the physical sciences. Unfortunately, in the field of energetic materials data scarcity limits the accuracy and even applicability of ML tools. To…

Two-dimensional (2D) materials have been a central focus of recent research because they host a variety of properties, making them attractive both for fundamental science and for applications. It is thus crucial to be able to identify…

Materials Science · Physics 2022-11-18 Mohammad Tohidi Vahdat , Kumar Agrawal Varoon , Giovanni Pizzi

The combination of high-throughput experimentation techniques and machine learning (ML) has recently ushered in a new era of accelerated material discovery, enabling the identification of materials with cutting-edge properties. However, the…

Over the past years, the industrial sector has seen many innovations brought about by automation. Inherent in this automation is the installation of sensor networks for status monitoring and data collection. One of the major challenges in…

Machine Learning · Computer Science 2020-05-28 Paulito Palmes , Joern Ploennigs , Niall Brady

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

Machine Learning · Computer Science 2023-06-09 Aleksa Bisercic , Mladen Nikolic , Mihaela van der Schaar , Boris Delibasic , Pietro Lio , Andrija Petrovic

Currently, there are many difficulties regarding the interoperability of medical data and related population data sources. These complications get in the way of the generation of high-quality data sets at city, region and national levels.…

Computers and Society · Computer Science 2023-10-13 Anna Andreychenko , Viktoriia Korzhuk , Stanislav Kondratenko , Polina Cheraneva