中文
相关论文

相关论文: Zero-shot Cross-Lingual Transfer for Synthetic Dat…

200 篇论文

Zero-shot cross-lingual transfer is promising, however has been shown to be sub-optimal, with inferior transfer performance across low-resource languages. In this work, we envision languages as domains for improving zero-shot transfer by…

计算与语言 · 计算机科学 2023-03-07 Shanu Kumar , Abbaraju Soujanya , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Transformers that are pre-trained on multilingual corpora, such as, mBERT and XLM-RoBERTa, have achieved impressive cross-lingual transfer capabilities. In the zero-shot transfer setting, only English training data is used, and the…

计算与语言 · 计算机科学 2021-09-13 Yang Chen , Alan Ritter

Although rarely stated, in practice, Grammatical Error Correction (GEC) encompasses various models with distinct objectives, ranging from grammatical error detection to improving fluency. Traditional evaluation methods fail to fully capture…

计算与语言 · 计算机科学 2023-08-21 Robert Östling , Katarina Gillholm , Murathan Kurfalı , Marie Mattson , Mats Wirén

There has been an increased interest in data generation approaches to grammatical error correction (GEC) using pseudo data. However, these approaches suffer from several issues that make them inconvenient for real-world deployment including…

计算与语言 · 计算机科学 2021-06-08 Masato Mita , Hitomi Yanaka

Zero-shot learning strives to classify unseen categories for which no data is available during training. In the generalized variant, the test samples can further belong to seen or unseen categories. The state-of-the-art relies on Generative…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Sanath Narayan , Akshita Gupta , Fahad Shahbaz Khan , Cees G. M. Snoek , Ling Shao

Multilingual pre-trained contextual embedding models (Devlin et al., 2019) have achieved impressive performance on zero-shot cross-lingual transfer tasks. Finding the most effective fine-tuning strategy to fine-tune these models on…

计算与语言 · 计算机科学 2021-07-22 Weijia Xu , Batool Haider , Jason Krone , Saab Mansour

Grammar error handling (GEH) is an important topic in natural language processing (NLP). GEH includes both grammar error detection and grammar error correction. Recent advances in computation systems have promoted the use of deep learning…

计算与语言 · 计算机科学 2020-09-08 Mina Naghshnejad , Tarun Joshi , Vijayan N. Nair

Error detection (ED) in tabular data is crucial yet challenging due to diverse error types and the need for contextual understanding. Traditional ED methods often rely heavily on manual criteria and labels, making them labor-intensive.…

机器学习 · 计算机科学 2025-04-09 Wei Ni , Kaihang Zhang , Xiaoye Miao , Xiangyu Zhao , Yangyang Wu , Yaoshu Wang , Jianwei Yin

Recent works in Grammatical Error Correction (GEC) have leveraged the progress in Neural Machine Translation (NMT), to learn rewrites from parallel corpora of grammatically incorrect and corrected sentences, achieving state-of-the-art…

计算与语言 · 计算机科学 2020-10-07 Vipul Raheja , Dimitrios Alikaniotis

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are passed to the model…

计算与语言 · 计算机科学 2021-06-01 Kevin Parnow , Zuchao Li , Hai Zhao

We introduce unsupervised techniques based on phrase-based statistical machine translation for grammatical error correction (GEC) trained on a pseudo learner corpus created by Google Translation. We verified our GEC system through…

计算与语言 · 计算机科学 2019-07-24 Satoru Katsumata , Mamoru Komachi

Although humans engaged in face-to-face conversation simultaneously communicate both verbally and non-verbally, methods for joint and unified synthesis of speech audio and co-speech 3D gesture motion from text are a new and emerging field.…

Grammatical Error Correction (GEC) should not focus only on high accuracy of corrections but also on interpretability for language learning. However, existing neural-based GEC models mainly aim at improving accuracy, and their…

计算与语言 · 计算机科学 2022-03-15 Masahiro Kaneko , Sho Takase , Ayana Niwa , Naoaki Okazaki

Recent progress in the task of Grammatical Error Correction (GEC) has been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining data and through the publication of small and higher-quality…

计算与语言 · 计算机科学 2020-09-10 Jared Lichtarge , Chris Alberti , Shankar Kumar

Recently, much Chinese text error correction work has focused on Chinese Spelling Check (CSC) and Chinese Grammatical Error Diagnosis (CGED). In contrast, little attention has been paid to the complicated problem of Chinese Semantic Error…

计算与语言 · 计算机科学 2023-05-10 Bo Sun , Baoxin Wang , Yixuan Wang , Wanxiang Che , Dayong Wu , Shijin Wang , Ting Liu

This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings.…

计算机视觉与模式识别 · 计算机科学 2021-04-16 Po-Yao Huang , Mandela Patrick , Junjie Hu , Graham Neubig , Florian Metze , Alexander Hauptmann

Cross-lingual model transfer is a compelling and popular method for predicting annotations in a low-resource language, whereby parallel corpora provide a bridge to a high-resource language and its associated annotated corpora. However,…

计算与语言 · 计算机科学 2017-05-02 Meng Fang , Trevor Cohn

Zero-shot recognition models require extensive training data for generalization. However, in zero-shot 3D classification, collecting 3D data and captions is costly and laborintensive, posing a significant barrier compared to 2D vision.…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Kohei Torimi , Ryosuke Yamada , Daichi Otsuka , Kensho Hara , Yuki M. Asano , Hirokatsu Kataoka , Yoshimitsu Aoki

We report on novel investigations into training models that make sentences concise. We define the task and show that it is different from related tasks such as summarization and simplification. For evaluation, we release two test sets,…

计算与语言 · 计算机科学 2022-11-09 Felix Stahlberg , Aashish Kumar , Chris Alberti , Shankar Kumar

Information Extraction (IE) systems are traditionally domain-specific, requiring costly adaptation that involves expert schema design, data annotation, and model training. While Large Language Models have shown promise in zero-shot IE,…

计算与语言 · 计算机科学 2025-06-03 Neil De La Fuente , Oscar Sainz , Iker García-Ferrero , Eneko Agirre