English
Related papers

Related papers: Counterfactual Learning from Bandit Feedback under…

200 papers

We consider an online decision making setting known as contextual bandit problem, and propose an approach for improving contextual bandit performance by using an adaptive feature extraction (representation learning) based on online…

Artificial Intelligence · Computer Science 2020-09-15 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Irina Rish

While synthetic bilingual corpora have demonstrated their effectiveness in low-resource neural machine translation (NMT), adding more synthetic data often deteriorates translation performance. In this work, we propose alternated training…

Computation and Language · Computer Science 2021-06-17 Rui Jiao , Zonghan Yang , Maosong Sun , Yang Liu

Thompson sampling (TS) is widely used in sequential decision making due to its ease of use and appealing empirical performance. However, many existing analytical and empirical results for TS rely on restrictive assumptions on reward…

Machine Learning · Computer Science 2023-06-16 Amin Karbasi , Nikki Lijing Kuang , Yi-An Ma , Siddharth Mitra

We propose an extensible deep learning method that uses reinforcement learning to train neural networks for offline ranking in information retrieval (IR). We call our method BanditRank as it treats ranking as a contextual bandit problem. In…

Information Retrieval · Computer Science 2019-10-24 Phanideep Gampa , Sumio Fujita

We propose a neural machine translation (NMT) approach that, instead of pursuing adequacy and fluency ("human-oriented" quality criteria), aims to generate translations that are best suited as input to a natural language processing…

Computation and Language · Computer Science 2019-10-02 Amirhossein Tebbifakhr , Luisa Bentivogli , Matteo Negri , Marco Turchi

Language style transferring rephrases text with specific stylistic attributes while preserving the original attribute-independent content. One main challenge in learning a style transfer system is a lack of parallel data where the source…

Computation and Language · Computer Science 2018-08-27 Zhirui Zhang , Shuo Ren , Shujie Liu , Jianyong Wang , Peng Chen , Mu Li , Ming Zhou , Enhong Chen

State-of-the-art machine translation models are still not on par with human translators. Previous work takes human interactions into the neural machine translation process to obtain improved results in target languages. However, not all…

Computation and Language · Computer Science 2019-08-14 Rongxiang Weng , Hao Zhou , Shujian Huang , Lei Li , Yifan Xia , Jiajun Chen

Multilingual Machine Translation (MMT) benefits from knowledge transfer across different language pairs. However, improvements in one-to-many translation compared to many-to-one translation are only marginal and sometimes even negligible.…

Computation and Language · Computer Science 2024-02-06 Yan Meng , Christof Monz

Speculative decoding has emerged as a popular method to accelerate the inference of Large Language Models (LLMs) while retaining their superior text generation performance. Previous methods either adopt a fixed speculative decoding…

Machine Learning · Computer Science 2025-11-21 Yunlong Hou , Fengzhuo Zhang , Cunxiao Du , Xuan Zhang , Jiachun Pan , Tianyu Pang , Chao Du , Vincent Y. F. Tan , Zhuoran Yang

We consider a special case of bandit problems, namely batched bandits. Motivated by natural restrictions of recommender systems and e-commerce platforms, we assume that a learning agent observes responses batched in groups over a certain…

Machine Learning · Computer Science 2021-11-04 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

Back-translation - data augmentation by translating target monolingual data - is a crucial component in modern neural machine translation (NMT). In this work, we reformulate back-translation in the scope of cross-entropy optimization of an…

Computation and Language · Computer Science 2019-06-19 Miguel Graça , Yunsu Kim , Julian Schamper , Shahram Khadivi , Hermann Ney

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

Machine Learning · Computer Science 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

We study the fundamental limits of learning in contextual bandits, where a learner's rewards depend on their actions and a known context, which extends the canonical multi-armed bandit to the case where side-information is available. We are…

Machine Learning · Statistics 2023-06-13 Moise Blanchard , Steve Hanneke , Patrick Jaillet

Machine translation (MT) has benefited from using synthetic training data originating from translating monolingual corpora, a technique known as backtranslation. Combining backtranslated data from different sources has led to better results…

Computation and Language · Computer Science 2020-05-04 Xabier Soto , Dimitar Shterionov , Alberto Poncelas , Andy Way

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Cross-domain sentiment analysis aims to predict the sentiment of texts in the target domain using the model trained on the source domain to cope with the scarcity of labeled data. Previous studies are mostly cross-entropy-based methods for…

Computation and Language · Computer Science 2022-08-19 Yun Luo , Fang Guo , Zihan Liu , Yue Zhang

Collaborative bandit learning, i.e., bandit algorithms that utilize collaborative filtering techniques to improve sample efficiency in online interactive recommendation, has attracted much research attention as it enjoys the best of both…

Machine Learning · Computer Science 2021-04-16 Chuanhao Li , Qingyun Wu , Hongning Wang

We consider the problem of controlling a known linear dynamical system under stochastic noise, adversarially chosen costs, and bandit feedback. Unlike the full feedback setting where the entire cost function is revealed after each decision,…

Machine Learning · Computer Science 2020-07-03 Asaf Cassel , Tomer Koren

We demonstrate that a wide array of machine learning algorithms are specific instances of one single paradigm: reciprocal learning. These instances range from active learning over multi-armed bandits to self-training. We show that all these…

Machine Learning · Statistics 2024-11-05 Julian Rodemann , Christoph Jansen , Georg Schollmeyer

Large transformer models trained on diverse datasets have shown a remarkable ability to learn in-context, achieving high few-shot performance on tasks they were not explicitly trained to solve. In this paper, we study the in-context…

Machine Learning · Computer Science 2023-06-27 Jonathan N. Lee , Annie Xie , Aldo Pacchiano , Yash Chandak , Chelsea Finn , Ofir Nachum , Emma Brunskill