English
Related papers

Related papers: Mining CFD Rules on Big Data

200 papers

Causal structure discovery from observational data is fundamental to the causal understanding of autonomous systems such as medical decision support systems, advertising campaigns and self-driving cars. This is essential to solve well-known…

When selecting data for training large-scale models, standard practice is to filter for examples that match human notions of data quality. Such filtering yields qualitatively clean datapoints that intuitively should improve model behavior.…

Machine Learning · Computer Science 2024-01-24 Logan Engstrom , Axel Feldmann , Aleksander Madry

Rapid development in deep learning model construction has prompted an increased need for appropriate training data. The popularity of large datasets - sometimes known as "big data" - has diverted attention from assessing their quality.…

Machine Learning · Computer Science 2022-10-25 Jay Bishnu , Andrew Gondoputro

Learning the cumulative distribution function (CDF) of an outcome variable conditional on a set of features remains challenging, especially in high-dimensional settings. Conditional transformation models provide a semi-parametric approach…

Machine Learning · Computer Science 2021-10-05 Philipp F. M. Baumann , Torsten Hothorn , David Rügamer

Ensuring data quality in large tabular datasets is a critical challenge, typically addressed through data wrangling tasks. Traditional statistical methods, though efficient, cannot often understand the semantic context and deep learning…

Machine Learning · Computer Science 2025-02-25 Ashlesha Akella , Krishnasuri Narayanam

Motivation: Algorithms that discover variables which are causally related to a target may inform the design of experiments. With observational gene expression data, many methods discover causal variables by measuring each variable's degree…

Quantitative Methods · Quantitative Biology 2014-07-30 Eric V. Strobl , Shyam Visweswaran

Errors or failures in a high-volume manufacturing environment can have significant impact that can result in both the loss of time and money. Identifying such failures early has been a top priority for manufacturing industries and various…

Machine Learning · Computer Science 2024-07-15 Siddarth Reddy Karuka , Abhinav Sunderrajan , Zheng Zheng , Yong Woon Tiean , Ganesh Nagappan , Allan Luk

Complex systems in science and engineering sometimes exhibit behavior that changes across different regimes. Traditional global models struggle to capture the full range of this complex behavior, limiting their ability to accurately…

Machine Learning · Computer Science 2023-07-24 Okezzi F. Ukorigho , Opeoluwa Owoyele

Learning interpretable models has become a major focus of machine learning research, given the increasing prominence of machine learning in socially important decision-making. Among interpretable models, rule lists are among the best-known…

Machine Learning · Computer Science 2024-06-19 Leonardo Pellegrina , Fabio Vandin

Machine learning (ML)-accelerated discovery requires large amounts of high-fidelity data to reveal predictive structure-property relationships. For many properties of interest in materials discovery, the challenging nature and high cost of…

Chemical Physics · Physics 2021-11-04 Aditya Nandy , Chenru Duan , Heather J. Kulik

A major factor in the recent success of large language models is the use of enormous and ever-growing text datasets for unsupervised pre-training. However, naively training a model on all available data may not be optimal (or feasible), as…

This paper introduces a new causal structure learning method for nonstationary time series data, a common data type found in fields such as finance, economics, healthcare, and environmental science. Our work builds upon the constraint-based…

Statistical Finance · Quantitative Finance 2024-06-10 Agathe Sadeghi , Achintya Gopal , Mohammad Fesanghary

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

Driven by the advancement of GPUs and AI, the field of Computational Fluid Dynamics (CFD) is undergoing significant transformations. This paper bridges the gap between the machine learning and CFD communities by deconstructing…

Fluid Dynamics · Physics 2025-11-26 Neil Ashton , Johannes Brandstetter , Siddhartha Mishra

The problem of complex data analysis is a central topic of modern statistical science and learning systems and is becoming of broader interest with the increasing prevalence of high-dimensional data. The challenge is to develop statistical…

Machine Learning · Statistics 2018-03-05 Faicel Chamroukhi , Hien D. Nguyen

Data mining, machine learning, and natural language processing are powerful techniques that can be used together to extract information from large texts. Depending on the task or problem at hand, there are many different approaches that can…

Information Retrieval · Computer Science 2017-11-08 Ricardo Baeza-Yates , Zeinab Liaghat

Recently, several large-scale RDF knowledge bases have been built and applied in many knowledge-based applications. To further increase the number of facts in RDF knowledge bases, logic rules can be used to predict new facts based on the…

Artificial Intelligence · Computer Science 2015-12-25 Zhichun Wang , Juanzi Li

Randomised controlled trials (RCTs) are the most effective approach to causal discovery, but in many circumstances it is impossible to conduct RCTs. Therefore observational studies based on passively observed data are widely accepted as an…

Artificial Intelligence · Computer Science 2016-11-11 Jiuyong Li , Thuc Duy Le , Lin Liu , Jixue Liu , Zhou Jin , Bingyu Sun , Saisai Ma

A challenge for data imputation is the lack of knowledge. In this paper, we attempt to address this challenge by involving extra knowledge from web. To achieve high-performance web-based imputation, we use the dependency, i.e.FDs and CFDs,…

Databases · Computer Science 2016-11-15 Yiwen Tang , Hongzhi Wang , Shiwei Zhang , Huijun Zhang , Ruoxi Shi