English
Related papers

Related papers: Exploiting Multi-typed Treebanks for Parsing with …

200 papers

While general-purpose large language models (LLMs) demonstrate proficiency on multiple tasks within the domain of translation, approaches based on open LLMs are competitive only when specializing on a single task. In this paper, we propose…

The multi-modal nature of many vision problems calls for neural network architectures that can perform multiple tasks concurrently. Typically, such architectures have been handcrafted in the literature. However, given the size and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 David Bruggemann , Menelaos Kanakis , Stamatios Georgoulis , Luc Van Gool

While a source sentence can be translated in many ways, most machine translation (MT) models are trained with only a single reference. Previous work has shown that using synthetic paraphrases can improve MT. This paper investigates best…

Computation and Language · Computer Science 2025-02-27 Si Wu , John Wieting , David A. Smith

We develop models to classify desirable reasoning revisions in argumentative writing. We explore two approaches -- multi-task learning and transfer learning -- to take advantage of auxiliary sources of revision data for similar tasks.…

Computation and Language · Computer Science 2023-09-15 Tazin Afrin , Diane Litman

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source. We present two random…

Machine Learning · Computer Science 2018-05-01 Noam Segev , Maayan Harel , Shie Mannor , Koby Crammer , Ran El-Yaniv

As deep learning applications continue to become more diverse, an interesting question arises: Can general problem solving arise from jointly learning several such diverse tasks? To approach this question, deep multi-task learning is…

Machine Learning · Computer Science 2019-10-29 Elliot Meyerson , Risto Miikkulainen

Language models generate reasoning sequentially, preventing them from decoupling irrelevant exploration paths during search. We introduce Tree-Structured Language Modeling (TSLM), which uses special tokens to encode branching structure,…

Computation and Language · Computer Science 2026-02-02 Doyoung Kim , Jaehyeok Doo , Minjoon Seo

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed

This paper presents the phonological, morphological, and syntactic distinctions between formal and informal Persian, showing that these two variants have fundamental differences that cannot be attributed solely to pronunciation…

Computation and Language · Computer Science 2022-01-12 Roya Kabiri , Simin Karimi , Mihai Surdeanu

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

Machine Learning · Computer Science 2017-06-19 Sebastian Ruder

We introduce the Treebank of Learner English (TLE), the first publicly available syntactic treebank for English as a Second Language (ESL). The TLE provides manually annotated POS tags and Universal Dependency (UD) trees for 5,124 sentences…

Computation and Language · Computer Science 2016-06-09 Yevgeni Berzak , Jessica Kenney , Carolyn Spadine , Jing Xian Wang , Lucia Lam , Keiko Sophie Mori , Sebastian Garza , Boris Katz

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts of data from public…

Machine Learning · Statistics 2015-02-10 Bharath Ramsundar , Steven Kearnes , Patrick Riley , Dale Webster , David Konerding , Vijay Pande

Large language models have made significant progress in the past few years. However, they are either generic {\it or} field specific, splitting the community into different groups. In this paper, we unify these large language models into a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yuanhao Gong

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

Computation and Language · Computer Science 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Building a persona-based conversation agent is challenging owing to the lack of large amounts of speaker-specific conversation data for model training. This paper addresses the problem by proposing a multi-task learning approach to training…

Computation and Language · Computer Science 2017-10-23 Yi Luan , Chris Brockett , Bill Dolan , Jianfeng Gao , Michel Galley

Inferring predictive maps between multiple input and multiple output variables or tasks has innumerable applications in data science. Multi-task learning attempts to learn the maps to several output tasks simultaneously with information…

Machine Learning · Statistics 2017-10-06 Ming Yu , Addie M. Thompson , Karthikeyan Natesan Ramamurthy , Eunho Yang , Aurélie C. Lozano

We develop a framework for combining differentiable programming languages with neural networks. Using this framework we create end-to-end trainable systems that learn to write interpretable algorithms with perceptual components. We explore…

Machine Learning · Computer Science 2017-03-03 Alexander L. Gaunt , Marc Brockschmidt , Nate Kushman , Daniel Tarlow

Text discourse parsing weighs importantly in understanding information flow and argumentative structure in natural language, making it beneficial for downstream tasks. While previous work significantly improves the performance of RST…

Computation and Language · Computer Science 2021-10-12 Zhengyuan Liu , Ke Shi , Nancy F. Chen

Multi-task learning, as it is understood nowadays, consists of using one single model to carry out several similar tasks. From classifying hand-written characters of different alphabets to figuring out how to play several Atari games using…

Machine Learning · Computer Science 2019-03-25 Unai Garciarena , Alexander Mendiburu , Roberto Santana

This paper presents a unified model to perform language and speaker recognition simultaneously and altogether. The model is based on a multi-task recurrent neural network where the output of one task is fed as the input of the other,…

Sound · Computer Science 2017-05-24 Lantian Li , Zhiyuan Tang , Dong Wang , Andrew Abel , Yang Feng , Shiyue Zhang