English
Related papers

Related papers: Topic Scene Graph Generation by Attention Distilla…

200 papers

Knowledge distillation methods have recently shown to be a promising direction to speedup the synthesis of large-scale diffusion models by requiring only a few inference steps. While several powerful distillation methods were recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Nikita Starodubcev , Artem Fedorov , Artem Babenko , Dmitry Baranchuk

Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in the training phase of retrieval-augmented models is…

Computation and Language · Computer Science 2024-02-20 Zizhong Li , Haopeng Zhang , Jiawei Zhang

Knowledge distillation is an attractive approach for learning compact deep neural networks, which learns a lightweight student model by distilling knowledge from a complex teacher model. Attention-based knowledge distillation is a specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Cuong Pham , Van-Anh Nguyen , Trung Le , Dinh Phung , Gustavo Carneiro , Thanh-Toan Do

The significant progress on Generative Adversarial Networks (GANs) has facilitated realistic single-object image generation based on language input. However, complex-scene generation (with various interactions among multiple objects) still…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tianyu Hua , Hongdong Zheng , Yalong Bai , Wei Zhang , Xiao-Ping Zhang , Tao Mei

Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Tao He , Tongtong Wu , Dongyang Zhang , Guiduo Duan , Ke Qin , Yuan-Fang Li

Captions help readers better understand visualizations. However, if the visualization is intended to communicate specific features, should the caption be statistical, and focus on specific values, or perceptual, and focus on general…

Human-Computer Interaction · Computer Science 2022-09-27 Hanxiu 'Hazel' Zhu , Shelly Shiying Cheng , Eugene Wu

Text summarization aims to compress a textual document to a short summary while keeping salient information. Extractive approaches are widely used in text summarization because of their fluency and efficiency. However, most of existing…

Computation and Language · Computer Science 2020-10-14 Peng Cui , Le Hu , Yuanchao Liu

While most image captioning aims to generate objective descriptions of images, the last few years have seen work on generating visually grounded image captions which have a specific style (e.g., incorporating positive or negative…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris , Len Hamey

Scene parsing, or semantic segmentation, consists in labeling each pixel in an image with the category of the object it belongs to. It is a challenging task that involves the simultaneous detection, segmentation and recognition of all the…

Computer Vision and Pattern Recognition · Computer Science 2015-06-09 Clément Farabet , Camille Couprie , Laurent Najman , Yann LeCun

State-of-the-art audio captioning methods typically use the encoder-decoder structure with pretrained audio neural networks (PANNs) as encoders for feature extraction. However, the convolution operation used in PANNs is limited in capturing…

Sound · Computer Science 2023-04-11 Feiyang Xiao , Jian Guan , Qiaoxi Zhu , Wenwu Wang

The internal workings of modern deep learning models stay often unclear to an external observer, although spatial attention mechanisms are involved. The idea of this work is to translate these spatial attentions into natural language to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Philipp Sadler

Video captioning aims to automatically generate natural language sentences that can describe the visual contents of a given video. Existing generative models like encoder-decoder frameworks cannot explicitly explore the object-level…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Yang Bai , Junyan Wang , Yang Long , Bingzhang Hu , Yang Song , Maurice Pagnucco , Yu Guan

Images tell powerful stories but cannot always be trusted. Matching images back to trusted sources (attribution) enables users to make a more informed judgment of the images they encounter online. We propose a robust image hashing algorithm…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Eric Nguyen , Tu Bui , Vishy Swaminathan , John Collomosse

Graph convolutional networks have made great progress in graph-based semi-supervised learning. Existing methods mainly assume that nodes connected by graph edges are prone to have similar attributes and labels, so that the features smoothed…

Machine Learning · Computer Science 2022-06-13 Yating Ren , Junzhong Ji , Lingfeng Niu , Minglong Lei

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

Diffusion models have revolted the field of text-to-image generation recently. The unique way of fusing text and image information contributes to their remarkable capability of generating highly text-related images. From another…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Changming Xiao , Qi Yang , Feng Zhou , Changshui Zhang

Image captioning models tend to describe images in an object-centric way, emphasising visible objects. But image descriptions can also abstract away from objects and describe the type of scene depicted. In this paper, we explore the…

Computation and Language · Computer Science 2022-11-11 Michele Cafagna , Kees van Deemter , Albert Gatt

Graph distillation has emerged as a solution for reducing large graph datasets to smaller, more manageable, and informative ones. Existing methods primarily target node classification, involve computationally intensive processes, and fail…

Machine Learning · Computer Science 2024-09-02 Arash Rasti-Meymandi , Ahmad Sajedi , Zhaopan Xu , Konstantinos N. Plataniotis

Visual attention not only improves the performance of image captioners, but also serves as a visual interpretation to qualitatively measure the caption rationality and model transparency. Specifically, we expect that a captioner can fix its…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yuanen Zhou , Meng Wang , Daqing Liu , Zhenzhen Hu , Hanwang Zhang

Generating realistic images of complex visual scenes becomes challenging when one wishes to control the structure of the generated images. Previous approaches showed that scenes with few entities can be controlled using scene graphs, but…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Roei Herzig , Amir Bar , Huijuan Xu , Gal Chechik , Trevor Darrell , Amir Globerson