English
Related papers

Related papers: GMN: Generative Multi-modal Network for Practical …

200 papers

Visual Information Extraction (VIE) task aims to extract key information from multifarious document images (e.g., invoices and purchase receipts). Most previous methods treat the VIE task simply as a sequence labeling problem or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Guozhi Tang , Lele Xie , Lianwen Jin , Jiapeng Wang , Jingdong Chen , Zhen Xu , Qianying Wang , Yaqiang Wu , Hui Li

Multimodal learning has shown great potentials in numerous scenes and attracts increasing interest recently. However, it often encounters the problem of missing modality data and thus suffers severe performance degradation in practice. To…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shicai Wei , Yang Luo , Chunbo Luo

Keyphrase extraction (KE) aims to summarize a set of phrases that accurately express a concept or a topic covered in a given document. Recently, Sequence-to-Sequence (Seq2Seq) based generative framework is widely used in KE task, and it has…

Computation and Language · Computer Science 2020-10-27 Haoyu Zhang , Dingkun Long , Guangwei Xu , Pengjun Xie , Fei Huang , Ji Wang

With the advancement of deep neural networks in computer vision, artificial intelligence (AI) is widely employed in real-world applications. However, AI still faces limitations in mimicking high-level human capabilities, such as novel…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keon-Hee Park , Hakyung Lee , Kyungwoo Song , Gyeong-Moon Park

Graph Neural Networks (GNNs) have become essential tools for learning on relational data, yet the performance of a single GNN is often limited by the heterogeneity present in real-world graphs. Recent advances in Mixture-of-Experts (MoE)…

Machine Learning · Computer Science 2025-10-22 Gangda Deng , Yuxin Yang , Ömer Faruk Akgül , Hanqing Zeng , Yinglong Xia , Rajgopal Kannan , Viktor Prasanna

The rise of Generative AI (GenAI) in recent years has catalyzed transformative advances in wireless communications and networks. Among the members of the GenAI family, Diffusion Models (DMs) have risen to prominence as a powerful option,…

Identifying fine-grained book genres is essential for enhancing user experience through efficient discovery, personalized recommendations, and improved reader engagement. At the same time, it provides publishers and marketers with valuable…

Information Retrieval · Computer Science 2025-10-21 Utsav Kumar Nareti , Soumi Chattopadhyay , Prolay Mallick , Suraj Kumar , Chandranath Adak , Ayush Vikas Daga , Adarsh Wase , Arjab Roy

Generalized Category Discovery (GCD) is an open-world problem that clusters unlabeled data by leveraging knowledge from partially labeled categories. A key challenge is that unlabeled data may contain both known and novel categories.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Haiyang Zheng , Nan Pu , Wenjing Li , Nicu Sebe , Zhun Zhong

The staggering amount of streaming time series coming from the real world calls for more efficient and effective online modeling solution. For time series modeling, most existing works make some unrealistic assumptions such as the input…

Machine Learning · Computer Science 2016-09-27 Zhifei Zhang , Yang Song , Wei Wang , Hairong Qi

The capability of the human to pay attention to both coarse and fine-grained regions has been applied to computer vision tasks. Motivated by that, we propose a collaborative learning framework in the complex domain for monaural noise…

Sound · Computer Science 2021-06-23 Andong Li , Chengshi Zheng , Lu Zhang , Xiaodong Li

Retrieval Augmented Generation (RAG) systems struggle with processing multimodal documents of varying structural complexity. This paper introduces a novel multi-strategy parsing approach using LLM-powered OCR to extract content from diverse…

Computation and Language · Computer Science 2024-12-23 Arnau Perez , Xavier Vizcaino

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

Dynamic Network Embedding (DNE) has recently attracted considerable attention due to the advantage of network embedding in various fields and the dynamic nature of many real-world networks. An input dynamic network to DNE is often assumed…

Social and Information Networks · Computer Science 2021-12-01 Chengbin Hou , Guoji Fu , Peng Yang , Zheng Hu , Shan He , Ke Tang

Recent studies indicate that the denoising process in deep generative diffusion models implicitly learns and memorizes semantic information from the data distribution. These findings suggest that capturing more complex data distributions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yi Tang , Peng Sun , Zhenglin Cheng , Tao Lin

Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for homophilic graphs…

Machine Learning · Computer Science 2024-06-06 Haoyu Han , Juanhui Li , Wei Huang , Xianfeng Tang , Hanqing Lu , Chen Luo , Hui Liu , Jiliang Tang

We introduce the framework of continuous--depth graph neural networks (GNNs). Graph neural ordinary differential equations (GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

This paper presents DWIE, the 'Deutsche Welle corpus for Information Extraction', a newly created multi-task dataset that combines four main Information Extraction (IE) annotation subtasks: (i) Named Entity Recognition (NER), (ii)…

Computation and Language · Computer Science 2021-03-10 Klim Zaporojets , Johannes Deleu , Chris Develder , Thomas Demeester

This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for multimedia social platform analysis. The core of MNER and MRE lies in incorporating evident visual…

Multimedia · Computer Science 2024-02-12 Shiyao Cui , Jiangxia Cao , Xin Cong , Jiawei Sheng , Quangang Li , Tingwen Liu , Jinqiao Shi

Current state-of-the-art large language models are effective in generating high-quality text and encapsulating a broad spectrum of world knowledge. These models, however, often hallucinate and lack locally relevant factual data.…

Software Engineering · Computer Science 2024-02-21 Anton Shapkin , Denis Litvinov , Yaroslav Zharov , Egor Bogomolov , Timur Galimzyanov , Timofey Bryksin

Deep neural networks (DNNs) experience significant performance degradation when processing noisy labels, primarily due to overfitting on mislabeled data. Current mainstream approaches attempt to mitigate this issue by passively filtering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Ningkang Peng , Jingyang Mao , Xiaoqian Peng , Peirong Ma , Xichen Yang , Weiguang Qu , Yanhui Gu