English
Related papers

Related papers: Multiple Instance Captioning: Learning Representat…

200 papers

Existing image captioning systems are dedicated to generating narrative captions for images, which are spatially detached from the image in presentation. However, texts can also be used as decorations on the image to highlight the key…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yiqi Gao , Xinglin Hou , Yuanmeng Zhang , Tiezheng Ge , Yuning Jiang , Peng Wang

Image captioning implies automatically generating textual descriptions of images based only on the visual input. Although this has been an extensively addressed research topic in recent years, not many contributions have been made in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Eva Cetinic

Convolutional Neural Networks have become state of the art methods for image classification over the last couple of years. By now they perform better than human subjects on many of the image classification datasets. Most of these datasets…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Sebastian Stabinger , Antonio Rodriguez-Sanchez

Image-text multimodal representation learning aligns data across modalities and enables important medical applications, e.g., image classification, visual grounding, and cross-modal retrieval. In this work, we establish a connection between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Peiqi Wang , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

To address the challenging task of instance-aware human part parsing, a new bottom-up regime is proposed to learn category-level human semantic segmentation as well as multi-person pose estimation in a joint and end-to-end manner. It is a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Tianfei Zhou , Wenguan Wang , Si Liu , Yi Yang , Luc Van Gool

Image captioning is a significant field across computer vision and natural language processing. We propose and present AIC-AB NET, a novel Attribute-Information-Combined Attention-Based Network that combines spatial attention architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Guoyun Tu , Ying Liu , Vladimir Vlassov

Along with the prosperity of recurrent neural network in modelling sequential data and the power of attention mechanism in automatically identify salient information, image captioning, a.k.a., image description, has been remarkably advanced…

Computer Vision and Pattern Recognition · Computer Science 2016-12-16 Hao Liu , Yang Yang , Fumin Shen , Lixin Duan , Heng Tao Shen

Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Xin Jin , Le Wu , Geng Zhao , Xiaodong Li , Xiaokun Zhang , Shiming Ge , Dongqing Zou , Bin Zhou , Xinghui Zhou

The Abstraction and Reasoning Corpus (ARC) is designed to promote research on abstract reasoning, a fundamental aspect of human intelligence. Common approaches to ARC treat it as a language-oriented problem, addressed by large language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Keya Hu , Ali Cy , Linlu Qiu , Xiaoman Delores Ding , Runqian Wang , Yeyin Eva Zhu , Jacob Andreas , Kaiming He

Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily workload, obtaining…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Wentao Pan , Jiangpeng Yan , Hanbo Chen , Jiawei Yang , Zhe Xu , Xiu Li , Jianhua Yao

Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ho Hin Lee , Yucheng Tang , Qi Yang , Xin Yu , Shunxing Bao , Leon Y. Cai , Lucas W. Remedios , Bennett A. Landman , Yuankai Huo

Professional photo editing remains challenging, requiring extensive knowledge of imaging pipelines and significant expertise. While recent deep learning approaches, particularly style transfer methods, have attempted to automate this…

Image and Video Processing · Electrical Eng. & Systems 2025-12-11 Omar Elezabi , Marcos V. Conde , Zongwei Wu , Radu Timofte

Multi-sentence summarization is a well studied problem in NLP, while generating image descriptions for a single image is a well studied problem in Computer Vision. However, for applications such as image cluster labeling or web page…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nicholas Trieu , Sebastian Goodman , Pradyumna Narayana , Kazoo Sone , Radu Soricut

The scarcity of richly annotated medical images is limiting supervised deep learning based solutions to medical image analysis tasks, such as localizing discriminatory radiomic disease signatures. Therefore, it is desirable to leverage…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Saeid Asgari Taghanaki , Mohammad Havaei , Tess Berthier , Francis Dutil , Lisa Di Jorio , Ghassan Hamarneh , Yoshua Bengio

Domain shift is a problem commonly encountered when developing automated histopathology pipelines. The performance of machine learning models such as convolutional neural networks within automated histopathology pipelines is often…

Image and Video Processing · Electrical Eng. & Systems 2021-07-16 Andrew Moyes , Richard Gault , Kun Zhang , Ji Ming , Danny Crookes , Jing Wang

Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Shengchao Chen , Sufen Ren , Guanjun Wang , Mengxing Huang , Chenyang Xue

Learning visual representations with self-supervised learning has become popular in computer vision. The idea is to design auxiliary tasks where labels are free to obtain. Most of these tasks end up providing data to learn specific kinds of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Xiaolong Wang , Kaiming He , Abhinav Gupta

In digital pathology, both detection and classification of cells are important for automatic diagnostic and prognostic tasks. Classifying cells into subtypes, such as tumor cells, lymphocytes or stromal cells is particularly challenging.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Shahira Abousamra , David Belinsky , John Van Arnam , Felicia Allard , Eric Yee , Rajarsi Gupta , Tahsin Kurc , Dimitris Samaras , Joel Saltz , Chao Chen

In diagnostic reports, experts encode complex imaging data into clinically actionable information. They describe subtle pathological findings that are meaningful in their anatomical context. Reports follow relatively consistent structures,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Felicia Bader , Philipp Seeböck , Anastasia Bartashova , Ulrike Attenberger , Georg Langs

Recent advances in self-supervised contrastive learning yield good image-level representation, which favors classification tasks but usually neglects pixel-level detailed information, leading to unsatisfactory transfer performance to dense…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Feng Wang , Huiyu Wang , Chen Wei , Alan Yuille , Wei Shen