English
Related papers

Related papers: Subword Sampling for Low Resource Word Alignment

200 papers

Despite being the seventh most widely spoken language in the world, Bengali has received much less attention in machine translation literature due to being low in resources. Most publicly available parallel corpora for Bengali are not large…

Computation and Language · Computer Science 2020-10-08 Tahmid Hasan , Abhik Bhattacharjee , Kazi Samin , Masum Hasan , Madhusudan Basak , M. Sohel Rahman , Rifat Shahriyar

Multilingual acoustic models have been successfully applied to low-resource speech recognition. Most existing works have combined many small corpora together and pretrained a multilingual model by sampling from each corpus uniformly. The…

Computation and Language · Computer Science 2019-08-06 Xinjian Li , Siddharth Dalmia , Alan W. Black , Florian Metze

Cross-lingual word embeddings aim to capture common linguistic regularities of different languages, which benefit various downstream tasks ranging from machine translation to transfer learning. Recently, it has been shown that these…

Computation and Language · Computer Science 2018-11-02 Pengcheng Yang , Fuli Luo , Shuangzhi Wu , Jingjing Xu , Dongdong Zhang , Xu Sun

Multilingual information retrieval has emerged as powerful tools for expanding knowledge sharing across languages. On the other hand, resources on high quality knowledge base are often scarce and in limited languages, therefore an effective…

Computation and Language · Computer Science 2025-06-04 Yingying Zhuang , Aman Gupta , Anurag Beniwal

Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve the latter problem…

Computation and Language · Computer Science 2020-04-21 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

Extractive Text Summarization is the process of selecting the most representative parts of a larger text without losing any key information. Recent attempts at extractive text summarization in Bengali, either relied on statistical…

Computation and Language · Computer Science 2024-11-28 Fahim Morshed , Md. Abdur Rahman , Sumon Ahmed

Despite the remarkable advances in language modeling, current mainstream decoding methods still struggle to generate texts that align with human texts across different aspects. In particular, sampling-based methods produce less-repetitive…

Computation and Language · Computer Science 2024-06-06 Haozhe Ji , Pei Ke , Hongning Wang , Minlie Huang

Semantic correspondence methods have advanced to obtaining high-quality correspondences employing complicated networks, aiming to maximize the model capacity. However, despite the performance improvements, they may remain constrained by the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jiwon Kim , Byeongho Heo , Sangdoo Yun , Seungryong Kim , Dongyoon Han

We propose a new unsupervised method for lexical substitution using pre-trained language models. Compared to previous approaches that use the generative capability of language models to predict substitutes, our method retrieves substitutes…

Computation and Language · Computer Science 2022-09-20 Takashi Wada , Timothy Baldwin , Yuji Matsumoto , Jey Han Lau

Unsupervised translation has reached impressive performance on resource-rich language pairs such as English-French and English-German. However, early studies have shown that in more realistic settings involving low-resource, rare languages,…

Computation and Language · Computer Science 2021-03-15 Xavier Garcia , Aditya Siddhant , Orhan Firat , Ankur P. Parikh

Word alignment is an important natural language processing task that indicates the correspondence between natural languages. Recently, unsupervised learning of log-linear models for word alignment has received considerable attention as it…

Computation and Language · Computer Science 2014-10-13 Yang Liu , Maosong Sun

The availability of parallel texts is crucial to the performance of machine translation models. However, most of the world's languages face the predominant challenge of data scarcity. In this paper, we propose strategies to synthesize…

Computation and Language · Computer Science 2024-02-06 Md Mahfuz Ibn Alam , Sina Ahmadi , Antonios Anastasopoulos

We introduce a novel discriminative word alignment model, which we integrate into a Transformer-based machine translation model. In experiments based on a small number of labeled examples (~1.7K-5K sentences) we evaluate its performance…

Computation and Language · Computer Science 2019-09-04 Elias Stengel-Eskin , Tzu-Ray Su , Matt Post , Benjamin Van Durme

Many automated processes such as auto-piloting rely on a good semantic segmentation as a critical component. To speed up performance, it is common to downsample the input frame. However, this comes at the cost of missed small objects and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Dmitrii Marin , Zijian He , Peter Vajda , Priyam Chatterjee , Sam Tsai , Fei Yang , Yuri Boykov

In recent years, embedding alignment has become the state-of-the-art machine translation approach, as it can yield high-quality translation without training on parallel corpora. However, existing research and application of embedding…

Computation and Language · Computer Science 2025-06-17 Ikeoluwa Abioye , Jiani Ge

Improving the captioning performance on low-resource languages by leveraging English caption datasets has received increasing research interest in recent years. Existing works mainly fall into two categories: translation-based and…

Computation and Language · Computer Science 2019-08-22 Yike Wu , Shiwan Zhao , Jia Chen , Ying Zhang , Xiaojie Yuan , Zhong Su

This paper proposes an efficient example sampling method for example-based word sense disambiguation systems. To construct a database of practical size, a considerable overhead for manual sense disambiguation (overhead for supervision) is…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Kentaro Inui , Takenobu Tokunaga , Hozumi Tanaka

This work presents an unsupervised approach for improving WordNet that builds upon recent advances in document and sense representation via distributional semantics. We apply our methods to construct Wordnets in French and Russian,…

Computation and Language · Computer Science 2017-05-02 Mikhail Khodak , Andrej Risteski , Christiane Fellbaum , Sanjeev Arora

We present a study of LLMs' performance in generating and rating example sentences for bilingual dictionaries across languages with varying resource levels: French (high-resource), Indonesian (mid-resource), and Tetun (low-resource), with…

Computation and Language · Computer Science 2024-11-22 Raphael Merx , Ekaterina Vylomova , Kemal Kurniawan

Subwords are the most widely used output units in end-to-end speech recognition. They combine the best of two worlds by modeling the majority of frequent words directly and at the same time allow open vocabulary speech recognition by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Egor Lakomkin , Jahn Heymann , Ilya Sklyar , Simon Wiesler