English
Related papers

Related papers: Masking Orchestration: Multi-task Pretraining for …

200 papers

We train multi-task autoencoders on linguistic tasks and analyze the learned hidden sentence representations. The representations change significantly when translation and part-of-speech decoders are added. The more decoders a model…

Computation and Language · Computer Science 2018-01-19 Gino Brunner , Yuyi Wang , Roger Wattenhofer , Michael Weigelt

The current state-of-the-art in many natural language processing and automated knowledge base completion tasks is held by representation learning methods which learn distributed vector representations of symbols via gradient-based…

Neural and Evolutionary Computing · Computer Science 2017-12-29 Tim Rocktäschel

Language models have demonstrated remarkable performance in solving reasoning tasks; however, even the strongest models still occasionally make reasoning mistakes. Recently, there has been active research aimed at improving reasoning…

Computation and Language · Computer Science 2024-08-30 Tian Ye , Zicheng Xu , Yuanzhi Li , Zeyuan Allen-Zhu

Large language models (LMs) are currently trained to predict tokens given document prefixes, enabling them to directly perform long-form generation and prompting-style tasks which can be reduced to document completion. Existing pretraining…

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intelligent task-oriented dialogue systems. However, existing…

Computation and Language · Computer Science 2026-03-02 Yu Zhu , Kai Yang

Unsupervised pre-training approaches have achieved great success in many fields such as Computer Vision (CV), Natural Language Processing (NLP) and so on. However, compared to typical deep learning models, pre-training or even fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xuanchen Hou , Yinsi Zhou

Dialogue Act (DA) classification is a challenging problem in dialogue interpretation, which aims to attach semantic labels to utterances and characterize the speaker's intention. Currently, many existing approaches formulate the DA…

Computation and Language · Computer Science 2018-11-14 Yao Wan , Wenqiang Yan , Jianwei Gao , Zhou Zhao , Jian Wu , Philip S. Yu

Abstractive dialogue summarization has long been viewed as an important standalone task in natural language processing, but no previous work has explored the possibility of whether abstractive dialogue summarization can also be used as a…

Computation and Language · Computer Science 2022-12-27 Borui Wang , Chengcheng Feng , Arjun Nair , Madelyn Mao , Jai Desai , Asli Celikyilmaz , Haoran Li , Yashar Mehdad , Dragomir Radev

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

Recent works show that learning contextualized embeddings for words is beneficial for downstream tasks. BERT is one successful example of this approach. It learns embeddings by solving two tasks, which are masked language model (masked LM)…

Computation and Language · Computer Science 2020-11-10 Çağla Aksoy , Alper Ahmetoğlu , Tunga Güngör

Recent breakthroughs in reasoning models have markedly advanced the reasoning capabilities of large language models, particularly via training on tasks with verifiable rewards. Yet, a significant gap persists in their adaptation to real…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaao Yu , Shenwei Li , Mingjie Han , Yifei Yin , Wenzheng Song , Chenghao Jia , Man Lan

Prior works have demonstrated that implicit representations trained only for reconstruction tasks typically generate encodings that are not useful for semantic tasks. In this work, we propose a method that contextualises the encodings of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Theo W. Costain , Kejie Li , Victor A. Prisacariu

Deriving multimodal representations of audio and lexical inputs is a central problem in Natural Language Understanding (NLU). In this paper, we present Contrastive Aligned Audio-Language Multirate and Multimodal Representations (CALM), an…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-09 Vin Sachidananda , Shao-Yen Tseng , Erik Marchi , Sachin Kajarekar , Panayiotis Georgiou

The emergent cross-lingual transfer seen in multilingual pretrained models has sparked significant interest in studying their behavior. However, because these analyses have focused on fully trained multilingual models, little is known about…

Computation and Language · Computer Science 2022-10-25 Terra Blevins , Hila Gonen , Luke Zettlemoyer

We study the problem of multilingual masked language modeling, i.e. the training of a single model on concatenated text from multiple languages, and present a detailed study of several factors that influence why these models are so…

Computation and Language · Computer Science 2020-05-11 Shijie Wu , Alexis Conneau , Haoran Li , Luke Zettlemoyer , Veselin Stoyanov

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

Computation and Language · Computer Science 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Since a vast number of tables can be easily collected from web pages, spreadsheets, PDFs, and various other document types, a flurry of table pre-training frameworks have been proposed following the success of text and images, and they have…

Computation and Language · Computer Science 2022-05-02 Haoyu Dong , Zhoujun Cheng , Xinyi He , Mengyu Zhou , Anda Zhou , Fan Zhou , Ao Liu , Shi Han , Dongmei Zhang

As humans, we navigate a multimodal world, building a holistic understanding from all our senses. We introduce MERLOT Reserve, a model that represents videos jointly over time -- through a new training objective that learns from audio,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Rowan Zellers , Jiasen Lu , Ximing Lu , Youngjae Yu , Yanpeng Zhao , Mohammadreza Salehi , Aditya Kusupati , Jack Hessel , Ali Farhadi , Yejin Choi

Self-supervised pre-training techniques have achieved remarkable progress in Document AI. Most multimodal pre-trained models use a masked language modeling objective to learn bidirectional representations on the text modality, but they…

Computation and Language · Computer Science 2022-07-20 Yupan Huang , Tengchao Lv , Lei Cui , Yutong Lu , Furu Wei
‹ Prev 1 8 9 10 Next ›