English
Related papers

Related papers: Adaptive Offline Quintuplet Loss for Image-Text Ma…

200 papers

Learning from feedback has been shown to enhance the alignment between text prompts and images in text-to-image diffusion models. However, due to the lack of focus in feedback content, especially regarding the object type and quantity,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Xuexiang Niu , Jinping Tang , Lei Wang , Ge Zhu

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Deep learning models suffer from catastrophic forgetting when trained in an incremental learning setting. In this work, we propose a novel approach to address the task incremental learning problem, which involves training a model on new…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Pravendra Singh , Pratik Mazumder , Piyush Rai , Vinay P. Namboodiri

The introduction of negative labels (NLs) has proven effective in enhancing Out-of-Distribution (OOD) detection. However, existing methods often lack an understanding of OOD images, making it difficult to construct an accurate negative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Wenjie Zhu , Yabin Zhang , Xin Jin , Wenjun Zeng , Lei Zhang

Effective image retrieval with text feedback stands to impact a range of real-world applications, such as e-commerce. Given a source image and text feedback that describes the desired modifications to that image, the goal is to retrieve the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Yuxin Tian , Shawn Newsam , Kofi Boakye

The contextual information is critical for various computer vision tasks, previous works commonly design plug-and-play modules and structural losses to effectively extract and aggregate the global context. These methods utilize fine-label…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jing Wang , Jiangyun Li , Wei Li , Lingfei Xuan , Tianxiang Zhang , Wenxuan Wang

Existing adversarial domain adaptation methods mainly consider the marginal distribution and these methods may lead to either under transfer or negative transfer. To address this problem, we present a self-adaptive re-weighted adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Shanshan Wang , Lei Zhang

Although deep learning-based segmentation models have achieved impressive performance on public benchmarks, generalizing well to unseen environments remains a major challenge. To improve the model's generalization ability to the new domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Yunlong Zhang , Yuxuan Sun , Sunyi Zheng , Zhongyi Shui , Chenglu Zhu , Lin Yang

Despite the great success of deep learning in stereo matching, recovering accurate disparity maps is still challenging. Currently, L1 and cross-entropy are the two most widely used losses for stereo network training. Compared with the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Peng Xu , Zhiyu Xiang , Chenyu Qiao , Jingyun Fu , Tianyu Pu

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu

Scene text detection has witnessed rapid development in recent years. However, there still exists two main challenges: 1) many methods suffer from false positives in their text representations; 2) the large scale variance of scene texts…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Yuxin Wang , Hongtao Xie , Zhengjun Zha , Mengting Xing , Zilong Fu , Yongdong Zhang

Neural network compression has recently received much attention due to the computational requirements of modern deep models. In this work, our objective is to transfer knowledge from a deep and accurate model to a smaller one. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Vasileios Belagiannis , Azade Farshad , Fabio Galasso

Text-to-image generation models represent the next step of evolution in image synthesis, offering a natural way to achieve flexible yet fine-grained control over the result. One emerging area of research is the fast adaptation of large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anton Voronov , Mikhail Khoroshikh , Artem Babenko , Max Ryabinin

Distributed representations of words which map each word to a continuous vector have proven useful in capturing important linguistic information not only in a single language but also across different languages. Current unsupervised…

Computation and Language · Computer Science 2019-04-23 Haozhou Wang , James Henderson , Paola Merlo

Decoding from the output distributions of large language models to produce high-quality text is a complex challenge in language modeling. Various approaches, such as beam search, sampling with temperature, $k-$sampling, nucleus…

Computation and Language · Computer Science 2024-10-22 Esteban Garces Arias , Julian Rodemann , Meimingwei Li , Christian Heumann , Matthias Aßenmacher

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Few-shot text classification aims to classify the text under the few-shot scenario. Most of the previous methods adopt optimization-based meta learning to obtain task distribution. However, due to the neglect of matching between the few…

Computation and Language · Computer Science 2023-07-31 Tianyi Lei , Honghui Hu , Qiaoyang Luo , Dezhong Peng , Xu Wang

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Detecting tampered text in document images is a challenging task due to data scarcity. To address this, previous work has attempted to generate tampered documents using rule-based methods. However, the resulting documents often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Mohamed Dhouib , Davide Buscaldi , Sonia Vanier , Aymen Shabou