English
Related papers

Related papers: Towards Robust Neural Retrieval Models with Synthe…

200 papers

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

A key theme in the past decade has been that when large neural networks and large datasets combine they can produce remarkable results. In deep reinforcement learning (RL), this paradigm is commonly made possible through experience replay,…

Machine Learning · Computer Science 2023-10-30 Cong Lu , Philip J. Ball , Yee Whye Teh , Jack Parker-Holder

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

Recently, dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs). The final task-specific model often achieves…

Computation and Language · Computer Science 2022-10-25 Jiacheng Ye , Jiahui Gao , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong

Programming by example is the problem of synthesizing a program from a small set of input / output pairs. Recent works applying machine learning methods to this task show promise, but are typically reliant on generating synthetic examples…

Machine Learning · Computer Science 2019-11-11 Judith Clymo , Haik Manukian , Nathanaël Fijalkow , Adrià Gascón , Brooks Paige

Learning image representations using synthetic data allows training neural networks without some of the concerns associated with real images, such as privacy and bias. Existing work focuses on a handful of curated generative processes which…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Manel Baradad , Chun-Fu Chen , Jonas Wulff , Tongzhou Wang , Rogerio Feris , Antonio Torralba , Phillip Isola

Synthetic data is a standard component in training large language models, yet systematic comparisons across design dimensions, including rephrasing strategy, generator model, and source data, remain absent. We conduct extensive controlled…

Interactive Information Retrieval (IIR) and Reinforcement Learning (RL) share many commonalities, including an agent who learns while interacts, a long-term and complex goal, and an algorithm that explores and adapts. To successfully apply…

Information Retrieval · Computer Science 2021-06-10 Limin Chen , Zhiwen Tang , Grace Hui Yang

String representation Learning (SRL) is an important task in the field of Natural Language Processing, but it remains under-explored. The goal of SRL is to learn dense and low-dimensional vectors (or embeddings) for encoding character…

Computation and Language · Computer Science 2021-12-22 Urchade Zaratiana

Training on model-generated synthetic data is a promising approach for finetuning LLMs, but it remains unclear when it helps or hurts. In this paper, we investigate this question for math reasoning via an empirical study, followed by…

Machine Learning · Computer Science 2024-06-21 Amrith Setlur , Saurabh Garg , Xinyang Geng , Naman Garg , Virginia Smith , Aviral Kumar

Data-driven methods such as convolutional neural networks (CNNs) are known to deliver state-of-the-art performance on image recognition tasks when the training data are abundant. However, in some instances, such as change detection in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Maria Kolos , Anton Marin , Alexey Artemov , Evgeny Burnaev

Testing in production-like test environments is an essential part of quality assurance processes in many industries. Provisioning of such test environments, for information-intensive services, involves setting up databases that are…

Software Engineering · Computer Science 2024-07-09 Razieh Behjati , Erik Arisholm , Chao Tan , Margrethe M. Bedregal

Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a resource-rich language like English to fine-tune large-scale…

Machine Learning · Computer Science 2021-12-10 Nuo Chen , Linjun Shou , Min Gong , Jian Pei , Daxin Jiang

Web search provides a promising way for people to obtain information and has been extensively studied. With the surgence of deep learning and large-scale pre-training techniques, various neural information retrieval models are proposed and…

Information Retrieval · Computer Science 2022-03-02 Yujia Zhou , Jing Yao , Zhicheng Dou , Ledell Wu , Ji-Rong Wen

Recently, Convolutional Neural Networks (CNNs) have shown promising performance in super-resolution (SR). However, these methods operate primarily on Low Resolution (LR) inputs for memory efficiency but this limits, as we demonstrate, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Muneeb Aadil , Rafia Rahim , Sibt ul Hussain

Among the biggest challenges we face in utilizing neural networks trained on waveform data (i.e., seismic, electromagnetic, or ultrasound) is its application to real data. The requirement for accurate labels forces us to develop solutions…

Geophysics · Physics 2021-09-14 Tariq Alkhalifah , Hanchen Wang , Oleg Ovcharenko

Semi-supervised learning improves the performance of supervised machine learning by leveraging methods from unsupervised learning to extract information not explicitly available in the labels. Through the design of a system that enables a…

Robotics · Computer Science 2020-07-27 Simón C. Smith , Subramanian Ramamoorthy

Recently advancements in sequence-to-sequence neural network architectures have led to an improved natural language understanding. When building a neural network-based Natural Language Understanding component, one main challenge is to…

Computation and Language · Computer Science 2019-02-18 Stefan Constantin , Jan Niehues , Alex Waibel

Despite recent advances, standard sequence labeling systems often fail when processing noisy user-generated text or consuming the output of an Optical Character Recognition (OCR) process. In this paper, we improve the noise-aware training…

Computation and Language · Computer Science 2021-05-26 Marcin Namysl , Sven Behnke , Joachim Köhler

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Shreyank N Gowda