English
Related papers

Related papers: Multimodal Machine Translation with Visual Scene G…

200 papers

This paper presents a novel approach to neural network pruning by integrating a graph-based observation space into an AutoML framework to address the limitations of existing methods. Traditional pruning approaches often depend on…

Machine Learning · Computer Science 2025-09-16 Dieter Balemans , Thomas Huybrechts , Jan Steckel , Siegfried Mercelis

This work addresses the challenge of using a deep learning model to prune graphs and the ability of this method to integrate explainability into spatio-temporal problems through a new approach. Instead of applying explainability to the…

Machine Learning · Computer Science 2025-10-14 Javier García-Sigüenza , Mirco Nanni , Faraón Llorens-Largo , José F. Vicent

Moving target selection in multimedia interactive systems faces unprecedented challenges as users increasingly interact across diverse and dynamic contexts-from live streaming in moving vehicles to VR gaming in varying environments.…

Multimedia · Computer Science 2025-08-20 Xiangxian Li , Yawen Zheng , Baiqiao Zhang , Yijia Ma , Xianhui Cao , Juan Liu , Yulong Bian , Jin Huang , Chenglei Yang

From a computer science viewpoint, a surgical domain model needs to be a conceptual one incorporating both behavior and data. It should therefore model actors, devices, tools, their complex interactions and data flow. To capture and model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Ege Özsoy , Evin Pınar Örnek , Ulrich Eck , Federico Tombari , Nassir Navab

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

Computation and Language · Computer Science 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Existing Scene Text Recognition (STR) methods typically use a language model to optimize the joint probability of the 1D character sequence predicted by a visual recognition (VR) model, which ignore the 2D spatial context of visual…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yue He , Chen Chen , Jing Zhang , Juhua Liu , Fengxiang He , Chaoyue Wang , Bo Du

Document translation poses a challenge for Neural Machine Translation (NMT) systems. Most document-level NMT systems rely on meticulously curated sentence-level parallel data, assuming flawless extraction of text from documents along with…

Computation and Language · Computer Science 2024-06-13 Benjamin Hsu , Xiaoyu Liu , Huayang Li , Yoshinari Fujinuma , Maria Nadejde , Xing Niu , Yair Kittenplon , Ron Litman , Raghavendra Pappagari

Most automatic matting methods try to separate the salient foreground from the background. However, the insufficient quantity and subjective bias of the current existing matting datasets make it difficult to fully explore the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Bo Xu , Jiake Xie , Han Huang , Ziwen Li , Cheng Lu , Yong Tang , Yandong Guo

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Surgical workflow recognition is vital for automating tasks, supporting decision-making, and training novice surgeons, ultimately improving patient safety and standardizing procedures. However, data corruption can lead to performance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Long Bai , Boyi Ma , Ruohan Wang , Guankun Wang , Beilei Cui , Zhongliang Jiang , Mobarakol Islam , Zhe Min , Jiewen Lai , Nassir Navab , Hongliang Ren

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

Computation and Language · Computer Science 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

Human matting refers to extracting human parts from natural images with high quality, including human detail information such as hair, glasses, hat, etc. This technology plays an essential role in image synthesis and visual effects in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Qing Song , Wenfeng Sun , Donghan Yang , Mengjie Hu , Chun Liu

The latest emerged 4D Panoptic Scene Graph (4D-PSG) provides an advanced-ever representation for comprehensively modeling the dynamic 4D visual real world. Unfortunately, current pioneering 4D-PSG research can primarily suffer from data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Shengqiong Wu , Hao Fei , Jingkang Yang , Xiangtai Li , Juncheng Li , Hanwang Zhang , Tat-seng Chua

Recent progress in vision-language models (VLMs) has led to impressive results in document understanding tasks, but their high computational demands remain a challenge. To mitigate the compute burdens, we propose a lightweight token pruning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Jaemin Son , Sujin Choi , Inyong Yun

Although neural machine translation has achieved promising results, it suffers from slow translation speed. The direct consequence is that a trade-off has to be made between translation quality and speed, thus its performance can not come…

Computation and Language · Computer Science 2018-09-11 Wen Zhang , Liang Huang , Yang Feng , Lei Shen , Qun Liu

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

Scene recognition is one of the basic problems in computer vision research with extensive applications in robotics. When available, depth images provide helpful geometric cues that complement the RGB texture information and help to identify…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Andrea Ferreri , Silvia Bucci , Tatiana Tommasi

Most of existing correspondence pruning methods only concentrate on gathering the context information as much as possible while neglecting effective ways to utilize such information. In order to tackle this dilemma, in this paper we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Junwen Guo , Guobao Xiao , Shiping Wang , Jun Yu

In recent years, multi-modal machine translation has attracted significant interest in both academia and industry due to its superior performance. It takes both textual and visual modalities as inputs, leveraging visual context to tackle…

Computation and Language · Computer Science 2024-05-24 Huangjun Shen , Liangying Shao , Wenbo Li , Zhibin Lan , Zhanyu Liu , Jinsong Su