中文
相关论文

相关论文: Multi-layer Representation Fusion for Neural Machi…

200 篇论文

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

计算与语言 · 计算机科学 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Neural networks are rapidly gaining popularity in scientific research, but training the models is often very time-consuming. Particularly when the training data samples are large high-dimensional arrays, efficient training methodologies…

分布式、并行与集群计算 · 计算机科学 2025-10-30 Kewei Wang , Claire Songhyun Lee , Sunwoo Lee , Vishu Gupta , Jan Balewski , Alex Sim , Peter Nugent , Ankit Agrawal , Alok Choudhary , Kesheng Wu , Wei-keng Liao

Encoder layer fusion (EncoderFusion) is a technique to fuse all the encoder layers (instead of the uppermost layer) for sequence-to-sequence (Seq2Seq) models, which has proven effective on various NLP tasks. However, it is still not…

计算与语言 · 计算机科学 2021-03-19 Xuebo Liu , Longyue Wang , Derek F. Wong , Liang Ding , Lidia S. Chao , Zhaopeng Tu

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessments by clinicians. In this paper, we present a multimodal fusion-based deep learning model…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Heng Yim Nicole Oo , Min Hun Lee , Jeong Hoon Lim

Convolution neural network (CNN) has been widely used in Single Image Super Resolution (SISR) so that SISR has been a great success recently. As the network deepens, the learning ability of network becomes more and more powerful. However,…

计算机视觉与模式识别 · 计算机科学 2020-02-17 Jiawen Lyn

Training efficiency is one of the main problems for Neural Machine Translation (NMT). Deep networks need for very large data as well as many training iterations to achieve state-of-the-art performance. This results in very high computation…

计算与语言 · 计算机科学 2017-10-04 Dakun Zhang , Jungi Kim , Josep Crego , Jean Senellart

State-of-the-art results on neural machine translation often use attentional sequence-to-sequence models with some form of convolution or recursion. Vaswani et al. (2017) propose a new architecture that avoids recurrence and convolution…

人工智能 · 计算机科学 2017-11-08 Karim Ahmed , Nitish Shirish Keskar , Richard Socher

Despite the recent success of deep neural networks in natural language processing (NLP), their interpretability remains a challenge. We analyze the representations learned by neural machine translation models at various levels of…

计算与语言 · 计算机科学 2019-11-04 Yonatan Belinkov , Nadir Durrani , Fahim Dalvi , Hassan Sajjad , James Glass

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

计算与语言 · 计算机科学 2018-05-08 Sander Tars , Mark Fishel

Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal representations…

Despite significant advancements in Multimodal Large Language Models (MLLMs) for understanding complex human intentions through cross-modal interactions, capturing intricate image details remains challenging. Previous methods integrating…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Yue Cao , Yangzhou Liu , Zhe Chen , Guangchen Shi , Wenhai Wang , Danhuai Zhao , Tong Lu

Transformers excel in Natural Language Processing (NLP) due to their prowess in capturing long-term dependencies but suffer from exponential resource consumption with increasing sequence lengths. To address these challenges, we propose MCSD…

计算与语言 · 计算机科学 2024-07-12 Hua Yang , Duohai Li , Shiman Li

In a multilingual neural machine translation model that fully shares parameters across all languages, an artificial language token is usually used to guide translation into the desired target language. However, recent studies show that…

计算与语言 · 计算机科学 2022-09-07 Renren Jin , Deyi Xiong

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

人工智能 · 计算机科学 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

机器学习 · 计算机科学 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

计算与语言 · 计算机科学 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex…

机器学习 · 计算机科学 2021-11-04 Truong Son Hy , Risi Kondor

Neural machine translation (NMT) models are typically trained with fixed-size input and output vocabularies, which creates an important bottleneck on their accuracy and generalization capability. As a solution, various studies proposed…

计算与语言 · 计算机科学 2018-05-08 Duygu Ataman , Marcello Federico

Characterizing materials with electron micrographs is a crucial task in fields such as semiconductors and quantum materials. The complex hierarchical structure of micrographs often poses challenges for traditional classification methods. In…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Sakhinana Sagar Srinivas , Geethan Sannidhi , Venkataramana Runkana

Despite the rapid evolution of semantic segmentation for land cover classification in high-resolution remote sensing imagery, integrating multiple data modalities such as Digital Surface Model (DSM), RGB, and Near-infrared (NIR) remains a…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Xiaoliang Tan , Jiaqi Wang , Chanjuan He , Wenlin Zhou