English
Related papers

Related papers: Multilingual AMR Parsing with Noisy Knowledge Dist…

200 papers

Noisy channel models have been especially effective in neural machine translation (NMT). However, recent approaches like "beam search and rerank" (BSR) incur significant computation overhead during inference, making real-world application…

Computation and Language · Computer Science 2022-07-19 Richard Yuanzhe Pang , He He , Kyunghyun Cho

Although all-in-one-model multilingual neural machine translation (multilingual NMT) has achieved remarkable progress, the convergence inconsistency in the joint training is ignored, i.e., different language pairs reaching convergence in…

Computation and Language · Computer Science 2022-10-20 Yichong Huang , Xiaocheng Feng , Xinwei Geng , Bing Qin

Current state-of-the-art cross-lingual summarization models employ multi-task learning paradigm, which works on a shared vocabulary module and relies on the self-attention mechanism to attend among tokens in two languages. However,…

Computation and Language · Computer Science 2021-12-08 Thong Nguyen , Luu Anh Tuan

Despite substantial progress in multilingual extractive Question Answering (QA), models with high and uniformly distributed performance across languages remain challenging, especially for languages with limited resources. We study…

Computation and Language · Computer Science 2023-10-02 Casimiro Pio Carrino , Carlos Escolano , José A. R. Fonollosa

We propose a new end-to-end model that treats AMR parsing as a series of dual decisions on the input sequence and the incrementally constructed graph. At each time step, our model performs multiple rounds of attention, reasoning, and…

Computation and Language · Computer Science 2020-04-30 Deng Cai , Wai Lam

Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the…

Information Retrieval · Computer Science 2023-02-10 Dawn Lawrie , Eugene Yang , Douglas W. Oard , James Mayfield

We present a transition-based AMR parser that directly generates AMR parses from plain text. We use Stack-LSTMs to represent our parser state and make decisions greedily. In our experiments, we show that our parser achieves very competitive…

Computation and Language · Computer Science 2017-08-03 Miguel Ballesteros , Yaser Al-Onaizan

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

Computation and Language · Computer Science 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang

The number of scientific publications nowadays is rapidly increasing, causing information overload for researchers and making it hard for scholars to keep up to date with current trends and lines of work. Consequently, recent work on…

Computation and Language · Computer Science 2022-05-31 Sotaro Takeshita , Tommaso Green , Niklas Friedrich , Kai Eckert , Simone Paolo Ponzetto

Multilingual models have been widely used for cross-lingual transfer to low-resource languages. However, the performance on these languages is hindered by their underrepresentation in the pretraining data. To alleviate this problem, we…

Computation and Language · Computer Science 2023-05-29 Tomasz Limisiewicz , Dan Malkin , Gabriel Stanovsky

Large language models having hundreds of millions, and even billions, of parameters have performed extremely well on a variety of natural language processing (NLP) tasks. Their widespread use and adoption, however, is hindered by the lack…

Computation and Language · Computer Science 2022-12-23 Dan DeGenaro , Jugal Kalita

Knowledge distillation, a technique for model compression and performance enhancement, has gained significant traction in Neural Machine Translation (NMT). However, existing research primarily focuses on empirical applications, and there is…

Computation and Language · Computer Science 2023-12-27 Jingxuan Wei , Linzhuang Sun , Xu Tan , Bihui Yu , Ruifeng Guo

Automatic speech translation is sensitive to speech recognition errors, but in a multilingual scenario, the same content may be available in various languages via simultaneous interpreting, dubbing or subtitling. In this paper, we…

Computation and Language · Computer Science 2023-05-29 Dominik Macháček , Peter Polák , Ondřej Bojar , Raj Dabre

We introduce a new method to improve existing multilingual sentence embeddings with Abstract Meaning Representation (AMR). Compared with the original textual input, AMR is a structured semantic representation that presents the core concepts…

Computation and Language · Computer Science 2022-10-19 Deng Cai , Xin Li , Jackie Chun-Sing Ho , Lidong Bing , Wai Lam

Natural language processing of Low-Resource Languages (LRL) is often challenged by the lack of data. Therefore, achieving accurate machine translation (MT) in a low-resource environment is a real problem that requires practical solutions.…

Computation and Language · Computer Science 2023-03-03 Yewei Song , Saad Ezzini , Jacques Klein , Tegawende Bissyande , Clément Lefebvre , Anne Goujon

LLMs have become a go-to solution not just for text generation, but also for natural language understanding (NLU) tasks. Acquiring extensive knowledge through language modeling on web-scale corpora, they excel on English NLU, yet struggle…

Computation and Language · Computer Science 2024-06-19 Fabian David Schmidt , Philipp Borchert , Ivan Vulić , Goran Glavaš

Cross-lingual AMR parsing is the task of predicting AMR graphs in a target language when training data is available only in a source language. Due to the small size of AMR training data and evaluation data, cross-lingual AMR parsing has…

Computation and Language · Computer Science 2024-10-07 Jeongwoo Kang , Maximin Coavoux , Cédric Lopez , Didier Schwab

Lack of specialized data makes building a multi-domain neural machine translation tool challenging. Although emerging literature dealing with low resource languages starts to show promising results, most state-of-the-art models used…

Computation and Language · Computer Science 2020-04-17 Idriss Mghabbar , Pirashanth Ratnamogan

Speech emotion recognition (SER) performance deteriorates significantly in the presence of noise, making it challenging to achieve competitive performance in noisy conditions. To this end, we propose a multi-level knowledge distillation…

Sound · Computer Science 2023-12-22 Yang Liu , Haoqin Sun , Geng Chen , Qingyue Wang , Zhen Zhao , Xugang Lu , Longbiao Wang

The ability of learning from noisy labels is very useful in many visual recognition tasks, as a vast amount of data with noisy labels are relatively easy to obtain. Traditionally, the label noises have been treated as statistical outliers,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Yuncheng Li , Jianchao Yang , Yale Song , Liangliang Cao , Jiebo Luo , Li-Jia Li