English
Related papers

Related papers: Compositional World Knowledge leads to High Utilit…

200 papers

Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these…

Quantitative Methods · Quantitative Biology 2024-04-15 James D. Brunner , Aaron J. Robinson , Patrick S. G. Chain

Differential abundance analysis is at the core of statistical analysis of microbiome data. The compositional nature of microbiome sequencing data makes false positive control challenging. Here, we show that the compositional effects can be…

Methodology · Statistics 2022-03-15 Huijuan Zhou , Kejun He , Jun Chen , Xianyang Zhang

Machine learning models often perform poorly on subgroups that are underrepresented in the training data. Yet, little is understood on the variation in mechanisms that cause subpopulation shifts, and how algorithms generalize across such…

Machine Learning · Computer Science 2023-08-21 Yuzhe Yang , Haoran Zhang , Dina Katabi , Marzyeh Ghassemi

Modern semantic parsers suffer from two principal limitations. First, training requires expensive collection of utterance-program pairs. Second, semantic parsers fail to generalize at test time to new compositions/structures that have not…

Computation and Language · Computer Science 2021-09-07 Inbar Oren , Jonathan Herzig , Jonathan Berant

Data collection has become an increasingly important problem in robotic manipulation, yet there still lacks much understanding of how to effectively collect data to facilitate broad generalization. Recent works on large-scale robotic data…

Robotics · Computer Science 2024-05-22 Jensen Gao , Annie Xie , Ted Xiao , Chelsea Finn , Dorsa Sadigh

Compositional data (i.e., data comprising random variables that sum up to a constant) arises in many applications including microbiome studies, chemical ecology, political science, and experimental designs. Yet when compositional data serve…

Methodology · Statistics 2025-01-03 Ritwik Bhaduri , Siyuan Ma , Lucas Janson

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

Traditionally, in supervised machine learning, (a significant) part of the available data (usually 50% to 80%) is used for training and the rest for validation. In many problems, however, the data is highly imbalanced in regard to different…

Machine Learning · Computer Science 2020-04-21 Xiaowei Gu , Plamen P Angelov , Eduardo Almeida Soares

For several years till date, the major issues in terms of solving for classification problems are the issues of Imbalanced data. Because majority of the machine learning algorithms by default assumes all data are balanced, the algorithms do…

Machine Learning · Statistics 2020-10-12 Richmond Addo Danquah

A long-standing challenge in developing machine learning approaches has been the lack of high-quality labeled data. Recently, models trained with purely synthetic data, here termed synthetic clones, generated using large-scale pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Krishnakant Singh , Thanush Navaratnam , Jannik Holmer , Simone Schaub-Meyer , Stefan Roth

In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Zhuojun Tian , Mehdi Bennis

Synthetic data becomes crucial for large language model training, but its effectiveness is highly inconsistent. We provide an information-theoretic account of this inconsistency: synthetic data improves a model only when the…

Machine Learning · Computer Science 2026-05-19 Hanyu Li , Zhengqi Sun , Xiaotie Deng

The generation of synthetic financial data is a critical technology in the financial domain, addressing challenges posed by limited data availability. Traditionally, statistical models have been employed to generate synthetic data. However,…

Computational Finance · Quantitative Finance 2025-03-07 Yuki Tanaka , Ryuji Hashimoto , Takehiro Takayanagi , Zhe Piao , Yuri Murayama , Kiyoshi Izumi

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

Computation and Language · Computer Science 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen

Dataset distillation (DD) has emerged as a widely adopted technique for crafting a synthetic dataset that captures the essential information of a training dataset, facilitating the training of accurate neural models. Its applications span…

Machine Learning · Computer Science 2025-02-04 Saeed Vahidian , Mingyu Wang , Jianyang Gu , Vyacheslav Kungurtsev , Wei Jiang , Yiran Chen

Diffusion-based tabular data synthesis models have yielded promising results. However, when the data dimensionality increases, existing models tend to degenerate and may perform even worse than simpler, non-diffusion-based models. This is…

Machine Learning · Computer Science 2025-11-12 Zuqing Li , Junhao Gan , Jianzhong Qi

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

In the era of big data, the explosive growth of multi-source heterogeneous data offers many exciting challenges and opportunities for improving the inference of conditional average treatment effects. In this paper, we investigate…

Machine Learning · Statistics 2022-11-02 Xinyu Li , Yilin Li , Qing Cui , Longfei Li , Jun Zhou

Leveraging the compositional nature of our world to expedite learning and facilitate generalization is a hallmark of human perception. In machine learning, on the other hand, achieving compositional generalization has proven to be an…

Machine Learning · Computer Science 2023-07-13 Thaddäus Wiedemer , Prasanna Mayilvahanan , Matthias Bethge , Wieland Brendel

Compositional generalization refers to correctly interpret novel combinations of known primitives, which remains a major challenge. Existing approaches often rely on supervised fine-tuning, which encourages models to imitate target outputs.…

Machine Learning · Computer Science 2026-05-07 Xiyan Fu , Wei Liu