English
Related papers

Related papers: An Exploration of Data Augmentation and Sampling T…

200 papers

Retrieval-based code question answering seeks to match user queries in natural language to relevant code snippets. Previous approaches typically rely on pretraining models using crafted bi-modal and uni-modal datasets to align text and code…

Computation and Language · Computer Science 2024-03-26 Zehan Li , Jianfei Zhang , Chuantao Yin , Yuanxin Ouyang , Wenge Rong

Knowledge base question answering (KBQA)is an important task in Natural Language Processing. Existing approaches face significant challenges including complex question understanding, necessity for reasoning, and lack of large end-to-end…

Retrieval augmented language models have recently become the standard for knowledge intensive tasks. Rather than relying purely on latent semantics within the parameters of large neural models, these methods enlist a semi-parametric memory…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen , Pat Verga , Michiel de Jong , John Wieting , William Cohen

Contrastive learning (CL) has become a ubiquitous approach for several natural language processing (NLP) downstream tasks, especially for question answering (QA). However, the major challenge, how to efficiently train the knowledge…

Computation and Language · Computer Science 2022-03-31 Wenshen Xu , Mieradilijiang Maimaiti , Yuanhang Zheng , Xin Tang , Ji Zhang

Machine Reading Comprehension with Unanswerable Questions is a difficult NLP task, challenged by the questions which can not be answered from passages. It is observed that subtle literal changes often make an answerable question…

Computation and Language · Computer Science 2022-08-03 Yunjie Ji , Liangyu Chen , Chenxiao Dou , Baochang Ma , Xiangang Li

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

Computation and Language · Computer Science 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

Computation and Language · Computer Science 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Question Answering has come a long way from answer sentence selection, relational QA to reading and comprehension. We shift our attention to generative question answering (gQA) by which we facilitate machine to read passages and answer…

Computation and Language · Computer Science 2018-07-10 Rajarshee Mitra

We introduce efficient deep learning-based methods for legal document processing including Legal Document Retrieval and Legal Question Answering tasks in the Automated Legal Question Answering Competition (ALQAC 2022). In this competition,…

Computation and Language · Computer Science 2022-11-07 Hieu Nguyen Van , Dat Nguyen , Phuong Minh Nguyen , Minh Le Nguyen

Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge. While promising, this approach requires to use models with billions of parameters, which are expensive to train and…

Computation and Language · Computer Science 2021-02-04 Gautier Izacard , Edouard Grave

Pretrained language models have achieved super-human performances on many Machine Reading Comprehension (MRC) benchmarks. Nevertheless, their relative inability to defend against adversarial attacks has spurred skepticism about their…

Artificial Intelligence · Computer Science 2023-02-02 Son Quoc Tran , Phong Nguyen-Thuan Do , Uyen Le , Matt Kretchmar

We conduct a feasibility study into the applicability of answer-agnostic question generation models to textbook passages. We show that a significant portion of errors in such systems arise from asking irrelevant or uninterpretable questions…

Computation and Language · Computer Science 2022-03-30 Liam Dugan , Eleni Miltsakaki , Shriyash Upadhyay , Etan Ginsberg , Hannah Gonzalez , Dayheon Choi , Chuning Yuan , Chris Callison-Burch

Pre-trained language models have brought significant improvements in performance in a variety of natural language processing tasks. Most existing models performing state-of-the-art results have shown their approaches in the separate…

Computation and Language · Computer Science 2022-04-05 Changwook Jun , Hansol Jang , Myoseop Sim , Hyun Kim , Jooyoung Choi , Kyungkoo Min , Kyunghoon Bae

Large language models (LLMs) are increasingly being used for generating text in a variety of use cases, including journalistic news articles. Given the potential malicious nature in which these LLMs can be used to generate disinformation at…

Computation and Language · Computer Science 2023-09-22 Amrita Bhattacharjee , Tharindu Kumarage , Raha Moraffah , Huan Liu

Meta learning with auxiliary languages has demonstrated promising improvements for cross-lingual natural language processing. However, previous studies sample the meta-training and meta-testing data from the same language, which limits the…

Computation and Language · Computer Science 2021-11-11 Qianying Liu , Fei Cheng , Sadao Kurohashi

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise required for annotation.…

Computation and Language · Computer Science 2020-05-05 Xiang Yue , Bernal Jimenez Gutierrez , Huan Sun

Answering counterfactual queries has important applications such as explainability, robustness, and fairness but is challenging when the causal variables are unobserved and the observations are non-linear mixtures of these latent variables,…

Machine Learning · Computer Science 2024-04-16 Zeyu Zhou , Ruqi Bai , Sean Kulinski , Murat Kocaoglu , David I. Inouye

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Counterfactual explanation is an important Explainable AI technique to explain machine learning predictions. Despite being studied actively, existing optimization-based methods often assume that the underlying machine-learning model is…

Artificial Intelligence · Computer Science 2022-06-01 Wenzhuo Yang , Jia Li , Caiming Xiong , Steven C. H. Hoi

Open-retrieval question answering systems are generally trained and tested on large datasets in well-established domains. However, low-resource settings such as new and emerging domains would especially benefit from reliable question…

Computation and Language · Computer Science 2022-01-28 Alon Albalak , Sharon Levy , William Yang Wang