English
Related papers

Related papers: CLIP-SR: Collaborative Linguistic and Image Proces…

200 papers

In this paper, an efficient super-resolution (SR) method based on deep convolutional neural network (CNN) is proposed, namely Gradual Upsampling Network (GUN). Recent CNN based SR methods often preliminarily magnify the low resolution (LR)…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Yang Zhao , Guoqing Li , Wenjun Xie , Wei Jia , Hai Min , Xiaoping Liu

SemEval-2025 Task 1 focuses on ranking images based on their alignment with a given nominal compound that may carry idiomatic meaning in both English and Brazilian Portuguese. To address this challenge, this work uses generative large…

Computation and Language · Computer Science 2025-05-02 Thanet Markchom , Tong Wu , Liting Huang , Huizhi Liang

Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i.e., edit distance, as the main evaluation metric. Since it is not differentiable, we usually instead optimize the learning…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Junfu Pu , Wengang Zhou , Hezhen Hu , Houqiang Li

Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aiwen Jiang , Zhi Wei , Long Peng , Feiqiang Liu , Wenbo Li , Mingwen Wang

Semantic role labeling (SRL) aims at elaborating the meaning of a sentence by forming a predicate-argument structure. Recent researches depicted that the effective use of syntax can improve SRL performance. However, syntax is a complicated…

Computation and Language · Computer Science 2020-12-29 Kashif Munir , Hai Zhao , Zuchao Li

The recent phenomenal interest in convolutional neural networks (CNNs) must have made it inevitable for the super-resolution (SR) community to explore its potential. The response has been immense and in the last three years, since the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Khizar Hayat

Super-resolution (SR) has achieved great success due to the development of deep convolutional neural networks (CNNs). However, as the depth and width of the networks increase, CNN-based SR methods have been faced with the challenge of…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 Parichehr Behjati , Pau Rodriguez , Armin Mehri , Isabelle Hupont , Jordi Gonzalez , Carles Fernandez Tena

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

Recent years have witnessed great success of convolutional neural network (CNN) for various problems both in low and high level visions. Especially noteworthy is the residual network which was originally proposed to handle high-level vision…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Yudong Liang , Ze Yang , Kai Zhang , Yihui He , Jinjun Wang , Nanning Zheng

Despite significant progress toward super resolving more realistic images by deeper convolutional neural networks (CNNs), reconstructing fine and natural textures still remains a challenging problem. Recent works on single image super…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Mohammad Saeed Rad , Behzad Bozorgtabar , Claudiu Musat , Urs-Viktor Marti , Max Basler , Hazim Kemal Ekenel , Jean-Philippe Thiran

As Convolutional Neural Networks embed themselves into our everyday lives, the need for them to be interpretable increases. However, there is often a trade-off between methods that are efficient to compute but produce an explanation that is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Thomas Hartley , Kirill Sidorov , Christopher Willis , David Marshall

We propose a simple yet effective model for Single Image Super-Resolution (SISR), by combining the merits of Residual Learning and Convolutional Sparse Coding (RL-CSC). Our model is inspired by the Learned Iterative Shrinkage-Threshold…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Menglei Zhang , Zhou Liu , Lei Yu

Underwater image enhancement has become an attractive topic as a significant technology in marine engineering and aquatic robotics. However, the limited number of datasets and imperfect hand-crafted ground truth weaken its robustness to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Di Wang , Long Ma , Risheng Liu , Xin Fan

Contrastive language-image pre-training (CLIP) models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval, where the model is required to effectively process natural language input to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Hyunjae Kim , Seunghyun Yoon , Trung Bui , Handong Zhao , Quan Tran , Franck Dernoncourt , Jaewoo Kang

Significant progress has been achieved on the improvement and downstream usages of the Contrastive Language-Image Pre-training (CLIP) vision-language model, while less attention is paid to the interpretation of CLIP. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Chenyang Zhao , Kun Wang , Janet H. Hsiao , Antoni B. Chan

Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge…

Image and Video Processing · Electrical Eng. & Systems 2020-11-02 Francesco Salvetti , Vittorio Mazzia , Aleem Khaliq , Marcello Chiaberge

Ambiguity poses persistent challenges in natural language understanding for large language models (LLMs). To better understand how lexical ambiguity can be resolved through the visual domain, we develop an interpretable Visual Word Sense…

Computation and Language · Computer Science 2026-02-09 Shamik Bhattacharya , Daniel Perkins , Yaren Dogan , Vineeth Konjeti , Sudarshan Srinivasan , Edmon Begoli

Recent deep learning models have demonstrated strong capabilities for classifying text and non-text components in natural images. They extract a high-level feature computed globally from a whole image component (patch), where the cluttered…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Tong He , Weilin Huang , Yu Qiao , Jian Yao

Convolutional Neural Network (CNN)-based image super-resolution (SR) has exhibited impressive success on known degraded low-resolution (LR) images. However, this type of approach is hard to hold its performance in practical scenarios when…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yixuan Wu , Feng Li , Huihui Bai , Weisi Lin , Runmin Cong , Yao Zhao

Vision-language pre-training (VLP) on large-scale image-text pairs has recently witnessed rapid progress for learning cross-modal representations. Existing pre-training methods either directly concatenate image representation and text…

Computation and Language · Computer Science 2021-03-16 Chenliang Li , Ming Yan , Haiyang Xu , Fuli Luo , Wei Wang , Bin Bi , Songfang Huang