English
Related papers

Related papers: What Language Model Architecture and Pretraining O…

200 papers

Existing pre-trained transformer analysis works usually focus only on one or two model families at a time, overlooking the variability of the architecture and pre-training objectives. In our work, we utilize the oLMpics benchmark and…

Computation and Language · Computer Science 2022-10-03 Vladislav Lialin , Kevin Zhao , Namrata Shivagunde , Anna Rumshisky

Transformer-based models have dominated natural language processing and other areas in the last few years due to their superior (zero-shot) performance on benchmark datasets. However, these models are poorly understood due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Shaeke Salman , Md Montasir Bin Shams , Xiuwen Liu , Lingjiong Zhu

Instruction tuning has emerged as a powerful technique, significantly boosting zero-shot performance on unseen tasks. While recent work has explored cross-lingual generalization by applying instruction tuning to multilingual models,…

Computation and Language · Computer Science 2024-06-14 Janghoon Han , Changho Lee , Joongbo Shin , Stanley Jungkyu Choi , Honglak Lee , Kynghoon Bae

This paper demonstrates that multilingual pretraining and multilingual fine-tuning are both critical for facilitating cross-lingual transfer in zero-shot translation, where the neural machine translation (NMT) model is tested on source…

Computation and Language · Computer Science 2022-04-14 Guanhua Chen , Shuming Ma , Yun Chen , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

This study aims to guide language model selection by investigating: 1) the necessity of finetuning versus zero-shot usage, 2) the benefits of domain-adjacent versus generic pretrained models, 3) the value of further domain-specific…

Computation and Language · Computer Science 2025-09-25 Lovedeep Gondara , Jonathan Simkin , Graham Sayle , Shebnum Devji , Gregory Arbour , Raymond Ng

Many data sets (e.g., reviews, forums, news, etc.) exist parallelly in multiple languages. They all cover the same content, but the linguistic differences make it impossible to use traditional, bag-of-word-based topic models. Models have to…

Computation and Language · Computer Science 2021-02-05 Federico Bianchi , Silvia Terragni , Dirk Hovy , Debora Nozza , Elisabetta Fersini

Large language models trained primarily in a monolingual setting have demonstrated their ability to generalize to machine translation using zero- and few-shot examples with in-context learning. However, even though zero-shot translations…

Computation and Language · Computer Science 2023-11-07 Weiting Tan , Haoran Xu , Lingfeng Shen , Shuyue Stella Li , Kenton Murray , Philipp Koehn , Benjamin Van Durme , Yunmo Chen

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

Computation and Language · Computer Science 2020-10-27 Yan Zeng , Jian-Yun Nie

Large pre-trained language models have brought remarkable progress in NLP. Pre-training and Fine-tuning have given state-of-art performance across tasks in text processing. Data Augmentation techniques have also helped build state-of-art…

Computation and Language · Computer Science 2022-10-04 Kshitij Gupta

Biological intelligence systems of animals perceive the world by integrating information in different modalities and processing simultaneously for various tasks. In contrast, current machine learning research follows a task-specific…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xizhou Zhu , Jinguo Zhu , Hao Li , Xiaoshi Wu , Xiaogang Wang , Hongsheng Li , Xiaohua Wang , Jifeng Dai

We tackle the problem of zero-shot cross-lingual transfer in NLP tasks via the use of language adapters (LAs). Most of the earlier works have explored training with adapter of a single source (often English), and testing either using the…

Computation and Language · Computer Science 2023-10-26 Vipul Rathore , Rajdeep Dhingra , Parag Singla , Mausam

Through prompting, large-scale pre-trained models have become more expressive and powerful, gaining significant attention in recent years. Though these big models have zero-shot capabilities, in general, labeled data are still required to…

Machine Learning · Computer Science 2023-05-02 Korawat Tanwisuth , Shujian Zhang , Huangjie Zheng , Pengcheng He , Mingyuan Zhou

An important concern in training multilingual neural machine translation (NMT) is to translate between language pairs unseen during training, i.e zero-shot translation. Improving this ability kills two birds with one stone by providing an…

Computation and Language · Computer Science 2019-06-21 Ngoc-Quan Pham , Jan Niehues , Thanh-Le Ha , Alex Waibel

Voice Conversion research in recent times has increasingly focused on improving the zero-shot capabilities of existing methods. Despite remarkable advancements, current architectures still tend to struggle in zero-shot cross-lingual…

Sound · Computer Science 2025-05-26 Advait Joglekar , Divyanshu Singh , Rooshil Rohit Bhatia , S. Umesh

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil

This paper combines autoregressive and masked-diffusion training objectives without any architectural modifications, resulting in flexible language models that outperform single-objective models. Autoregressive modeling has been a popular…

Computation and Language · Computer Science 2026-03-30 David Samuel , Lucas Georges Gabriel Charpentier

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

Computation and Language · Computer Science 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

Zero-shot cross-lingual transfer is promising, however has been shown to be sub-optimal, with inferior transfer performance across low-resource languages. In this work, we envision languages as domains for improving zero-shot transfer by…

Computation and Language · Computer Science 2023-03-07 Shanu Kumar , Abbaraju Soujanya , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Transformers have gained popularity in the software engineering (SE) literature. These deep learning models are usually pre-trained through a self-supervised objective, meant to provide the model with basic knowledge about a language of…

Software Engineering · Computer Science 2023-02-09 Rosalia Tufano , Luca Pascarella , Gabriele Bavota

Zero-shot translation, translating between language pairs on which a Neural Machine Translation (NMT) system has never been trained, is an emergent property when training the system in multilingual settings. However, naive training for…

Computation and Language · Computer Science 2019-06-05 Jiatao Gu , Yong Wang , Kyunghyun Cho , Victor O. K. Li