English
Related papers

Related papers: From Examples to Rules: Neural Guided Rule Synthes…

200 papers

Generative models can produce synthetic patient records for analytical tasks when real data is unavailable or limited. However, current methods struggle with adhering to domain-specific knowledge and removing invalid data. We present…

Machine Learning · Computer Science 2023-12-22 Brandon Theodorou , Shrusti Jain , Cao Xiao , Jimeng Sun

The neural networks have trained on incomplete sets that a doctor could collect. Trained neural networks have correctly classified all the presented instances. The number of intervals entered for encoding the quantitative variables is equal…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Vitaly Schetinin , Anatoly Brazhnikov

In this paper, we propose a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference…

Machine Learning · Statistics 2018-07-06 Akisato Kimura , Zoubin Ghahramani , Koh Takeuchi , Tomoharu Iwata , Naonori Ueda

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

Due to the practical importance of regular expressions (regexes, for short), there has been a lot of research to automatically generate regexes from positive and negative string examples. We tackle the problem of learning regexes faster…

Machine Learning · Computer Science 2022-05-24 Su-Hyeon Kim , Hyunjoon Cheon , Yo-Sub Han , Sang-Ki Ko

This work introduces a novel approach to pruning deep learning models by using distilled data. Unlike conventional strategies which primarily focus on architectural or algorithmic optimization, our method reconsiders the role of data in…

Machine Learning · Computer Science 2023-08-10 Luke McDermott , Daniel Cummings

Designing smart home services is a complex task when multiple services with a large number of sensors and actuators are deployed simultaneously. It may rely on knowledge-based or data-driven approaches. The former can use rule-based methods…

Artificial Intelligence · Computer Science 2022-07-20 Mingming Qiu , Elie Najm , Remi Sharrock , Bruno Traverson

A key theme in the past decade has been that when large neural networks and large datasets combine they can produce remarkable results. In deep reinforcement learning (RL), this paradigm is commonly made possible through experience replay,…

Machine Learning · Computer Science 2023-10-30 Cong Lu , Philip J. Ball , Yee Whye Teh , Jack Parker-Holder

We draw a formal connection between using synthetic training data to optimize neural network parameters and approximate, Bayesian, model-based reasoning. In particular, training a neural network using synthetic data can be viewed as…

Machine Learning · Computer Science 2017-03-03 Tuan Anh Le , Atilim Gunes Baydin , Robert Zinkov , Frank Wood

In the field of business data analysis, the ability to extract actionable insights from vast and varied datasets is essential for informed decision-making and maintaining a competitive edge. Traditional rule-based systems, while reliable,…

Computation and Language · Computer Science 2024-04-25 Aliaksei Vertsel , Mikhail Rumiantsau

Traditional approaches to extractive summarization rely heavily on human-engineered features. In this work we propose a data-driven approach based on neural networks and continuous sentence features. We develop a general framework for…

Computation and Language · Computer Science 2016-07-04 Jianpeng Cheng , Mirella Lapata

This paper discusses a data-driven, empirically-based framework to make algorithmic decisions or recommendations without expert knowledge. We improve the performance of two algorithmic case studies: the selection of a pivot rule for the…

Machine Learning · Computer Science 2021-09-30 Imran Adham , Jesus De Loera , Zhenyang Zhang

Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabilities enhanced by reinforcement learning (RL), real…

Computation and Language · Computer Science 2026-02-17 Yang Liu , Jiaqi Li , Zilong Zheng

Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of…

Machine Learning · Statistics 2023-10-11 Nick Polson , Vadim Sokolov

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

Information extraction (IE) aims to produce structured information from an input text, e.g., Named Entity Recognition and Relation Extraction. Various attempts have been proposed for IE via feature engineering or deep learning. However,…

Computation and Language · Computer Science 2019-12-09 Wenya Wang , Sinno Jialin Pan

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

In the artificial intelligence field, learning often corresponds to changing the parameters of a parameterized function. A learning rule is an algorithm or mathematical expression that specifies precisely how the parameters should be…

Artificial Intelligence · Computer Science 2017-06-13 Philip S. Thomas , Christoph Dann , Emma Brunskill

Using huge training datasets can be costly and inconvenient. This article explores various data distillation techniques that can reduce the amount of data required to successfully train deep networks. Inspired by recent ideas, we suggest…

Machine Learning · Computer Science 2022-03-17 Dmitry Medvedev , Alexander D'yakonov

Inspired by the principle of deliberate practice in human learning, we propose Deliberate Practice for Synthetic Data Generation (DP), a novel framework that improves sample efficiency through dynamic synthetic data generation. Prior work…