English
Related papers

Related papers: Prespecification of Structure for Optimizing Data …

200 papers

Curating labeled training data has become the primary bottleneck in machine learning. Recent frameworks address this bottleneck with generative models to synthesize labels at scale from weak supervision sources. The generative model's…

Machine Learning · Computer Science 2017-09-12 Stephen H. Bach , Bryan He , Alexander Ratner , Christopher Ré

Learning the causal structure behind data is invaluable for improving generalization and obtaining high-quality explanations. We propose a novel framework, Invariant Structure Learning (ISL), that is designed to improve causal structure…

Machine Learning · Computer Science 2022-06-15 Yunhao Ge , Sercan Ö. Arik , Jinsung Yoon , Ao Xu , Laurent Itti , Tomas Pfister

Time series prediction is a widespread and well studied problem with applications in many domains (medical, geoscience, network analysis, finance, econometry etc.). In the case of multivariate time series, the key to good performances is to…

Machine Learning · Computer Science 2022-02-09 Darko Drakulic , Jean-Marc Andreoli

In order to improve the fault diagnosis capability of multivariate statistical methods, this article introduces a fault isolation framework based on structured sparsity modeling. The developed method relies on the reconstruction based…

Applications · Statistics 2020-12-22 Wei Chen , Jiusun Zeng , Xiaobin Xu , Shihua Luo , Chuanhou Gao

Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the…

Machine Learning · Computer Science 2019-07-02 Rohit Bhattacharya , Daniel Malinsky , Ilya Shpitser

We develop a general formalism for representing and understanding structure in complex systems. In our view, structure is the totality of relationships among a system's components, and these relationships can be quantified using information…

Statistical Mechanics · Physics 2014-09-17 Benjamin Allen , Blake C. Stacey , Yaneer Bar-Yam

Labeling training data is a key bottleneck in the modern machine learning pipeline. Recent weak supervision approaches combine labels from multiple noisy sources by estimating their accuracies without access to ground truth labels; however,…

Machine Learning · Statistics 2019-03-15 Paroma Varma , Frederic Sala , Ann He , Alexander Ratner , Christopher Ré

At the heart of causal structure learning from observational data lies a deceivingly simple question: given two statistically dependent random variables, which one has a causal effect on the other? This is impossible to answer using…

Machine Learning · Computer Science 2020-10-13 Nikolaos Nikolaou , Konstantinos Sechidis

Inferring causal directions on discrete and categorical data is an important yet challenging problem. Even though the additive noise models (ANMs) approach can be adapted to the discrete data, the functional structure assumptions make it…

Machine Learning · Statistics 2021-09-02 Austin Goddard , Yu Xiang

Recent works in Learning-Based Model Predictive Control of dynamical systems show impressive sample complexity performances using criteria from Information Theory to accelerate the learning procedure. However, the sequential exploration…

Machine Learning · Computer Science 2026-02-25 Rémy Hosseinkhan-Boucher , Onofrio Semeraro , Lionel Mathelin

Recent advancements in long-context large language models have attracted significant attention, yet their practical applications often suffer from suboptimal context utilization. This study investigates structuring training data to enhance…

Computation and Language · Computer Science 2025-03-03 Konrad Staniszewski , Szymon Tworkowski , Sebastian Jaszczur , Yu Zhao , Henryk Michalewski , Łukasz Kuciński , Piotr Miłoś

We study a pipeline that curates reasoning data from initial structured data for improving long-context reasoning in large language models (LLMs). Our approach, $\pi^2$, constructs high-quality reasoning data through rigorous QA curation:…

Computation and Language · Computer Science 2026-04-08 Quyet V. Do , Thinh Pham , Nguyen Nguyen , Sha Li , Pratibha Zunjare , Tu Vu

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

Machine Learning · Computer Science 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

Causal structure discovery from observational data is fundamental to the causal understanding of autonomous systems such as medical decision support systems, advertising campaigns and self-driving cars. This is essential to solve well-known…

Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when only…

Statistics Theory · Mathematics 2008-04-24 Dominik Janzing , Bernhard Schoelkopf

Causal discovery, beyond the inference of a network as a collection of connected dots, offers a crucial functionality in scientific discovery using artificial intelligence. The questions that arise in multiple domains, such as physics,…

Machine Learning · Computer Science 2021-06-03 M. Ali Vosoughi , Axel Wismuller

For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical…

Applications · Statistics 2014-07-22 Xiao Lin , Gabriel Terejanu

Structural causal models (SCMs) are a powerful tool for understanding the complex causal relationships that underlie many real-world systems. As these systems grow in size, the number of variables and complexity of interactions between them…

Artificial Intelligence · Computer Science 2023-10-13 Moritz Willig , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Causality plays a pivotal role in various fields of study. Based on the framework of causal graphical models, previous works have proposed identifying whether a variable is a cause or non-cause of a target in every Markov equivalent graph…

Machine Learning · Statistics 2024-08-16 Qingyuan Zheng , Yue Liu , Yangbo He

The growing complexity of legal cases has lead to an increasing interest in legal information retrieval systems that can effectively satisfy user-specific information needs. However, such downstream systems typically require documents to be…

Computation and Language · Computer Science 2021-05-18 Dennis Aumiller , Satya Almasian , Sebastian Lackner , Michael Gertz