English
Related papers

Related papers: Fast(er) Exact Decoding and Global Training for Tr…

200 papers

This work explores better adaptation methods to low-resource languages using an external language model (LM) under the framework of transfer learning. We first build a language-independent ASR system in a unified sequence-to-sequence (S2S)…

Computation and Language · Computer Science 2019-05-08 Hirofumi Inaguma , Jaejin Cho , Murali Karthick Baskar , Tatsuya Kawahara , Shinji Watanabe

In this work, we investigate the challenging problem of on-demand semantic communication over heterogeneous wireless networks. We propose a fidelity-adjustable semantic transmission framework (FAST) that empowers wireless devices to send…

Networking and Internet Architecture · Computer Science 2023-10-31 Peichun Li , Guoliang Cheng , Jiawen Kang , Rong Yu , Liping Qian , Yuan Wu , Dusit Niyato

The end-to-end architecture has made promising progress in speech translation (ST). However, the ST task is still challenging under low-resource conditions. Most ST models have shown unsatisfactory results, especially in the absence of word…

Computation and Language · Computer Science 2022-03-31 Yao-Fei Cheng , Hung-Shin Lee , Hsin-Min Wang

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Efficient fine-tuning of pre-trained Text-to-Image (T2I) models involves adjusting the model to suit a particular task or dataset while minimizing computational resources and limiting the number of trainable parameters. However, it often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Komal Kumar , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Ivan Laptev , Hisham Cholakkal

In this work we investigate the use of the Signature Transform in the context of Learning. Under this assumption, we advance a supervised framework that potentially provides state-of-the-art classification accuracy with the use of few…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 J. de Curtò , I. de Zarzà , Hong Yan , Carlos T. Calafate

Recently, Transformer has achieved the state-of-the-art performance on many machine translation tasks. However, without syntax knowledge explicitly considered in the encoder, incorrect context information that violates the syntax structure…

Computation and Language · Computer Science 2019-09-06 Chengyi Wang , Shuangzhi Wu , Shujie Liu

We present a deep neural architecture that parses sentences into three semantic dependency graph formalisms. By using efficient, nearly arc-factored inference and a bidirectional-LSTM composed with a multi-layer perceptron, our base system…

Computation and Language · Computer Science 2017-04-27 Hao Peng , Sam Thomson , Noah A. Smith

We present K{\o}psala, the Copenhagen-Uppsala system for the Enhanced Universal Dependencies Shared Task at IWPT 2020. Our system is a pipeline consisting of off-the-shelf models for everything but enhanced graph parsing, and for the…

Computation and Language · Computer Science 2020-06-03 Daniel Hershcovich , Miryam de Lhoneux , Artur Kulmizev , Elham Pejhan , Joakim Nivre

We propose a method for non-projective dependency parsing by incrementally predicting a set of edges. Since the edges do not have a pre-specified order, we propose a set-based learning method. Our method blends graph, transition, and…

Machine Learning · Computer Science 2019-10-25 Sean Welleck , Kyunghyun Cho

We present a novel cross-lingual transfer method for paradigm completion, the task of mapping a lemma to its inflected forms, using a neural encoder-decoder model, the state of the art for the monolingual task. We use labeled data from a…

Computation and Language · Computer Science 2017-04-04 Katharina Kann , Ryan Cotterell , Hinrich Schütze

Dependency parsing is a crucial step towards deep language understanding and, therefore, widely demanded by numerous Natural Language Processing applications. In particular, left-to-right and top-down transition-based algorithms that rely…

Computation and Language · Computer Science 2022-10-27 Daniel Fernández-González , Carlos Gómez-Rodríguez

Visual tracking has made significant improvements in the past few decades. Most existing state-of-the-art trackers 1) merely aim for performance in ideal conditions while overlooking the real-world conditions; 2) adopt the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ziang Cao , Ziyuan Huang , Liang Pan , Shiwei Zhang , Ziwei Liu , Changhong Fu

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far from success in the…

Computation and Language · Computer Science 2019-12-04 Baijun Ji , Zhirui Zhang , Xiangyu Duan , Min Zhang , Boxing Chen , Weihua Luo

Large-scale pre-trained models have achieved remarkable success in language and image tasks, leading an increasing number of studies to explore the application of pre-trained image models, such as CLIP, in the domain of few-shot action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Congqi Cao , Peiheng Han , Yueran zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning zhang

Dependency parsing is the task of inferring natural language structure, often approached by modeling word interactions via attention through biaffine scoring. This mechanism works like self-attention in Transformers, where scores are…

Computation and Language · Computer Science 2025-10-27 Paolo Gajo , Domenic Rosati , Hassan Sajjad , Alberto Barrón-Cedeño

Deep learning is being used extensively in a variety of software engineering tasks, e.g., program classification and defect prediction. Although the technique eliminates the required process of feature engineering, the construction of…

Software Engineering · Computer Science 2021-11-24 Zhehao Zhao , Bo Yang , Ge Li , Huai Liu , Zhi Jin

Vision-language retrieval is an important multi-modal learning topic, where the goal is to retrieve the most relevant visual candidate for a given text query. Recently, pre-trained models, e.g., CLIP, show great potential on retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Haojun Jiang , Jianke Zhang , Rui Huang , Chunjiang Ge , Zanlin Ni , Shiji Song , Gao Huang

Parsing accuracy using efficient greedy transition systems has improved dramatically in recent years thanks to neural networks. Despite striking results in dependency parsing, however, neural models have not surpassed state-of-the-art…

Computation and Language · Computer Science 2016-12-21 James Cross , Liang Huang

Efficient transfer learning methods such as adapter-based methods have shown great success in unimodal models and vision-language models. However, existing methods have two main challenges in fine-tuning multimodal models. Firstly, they are…

Machine Learning · Computer Science 2024-12-13 Zirun Guo , Xize Cheng , Yangyang Wu , Tao Jin