English
Related papers

Related papers: Leveraging Vision-Language Pre-training for Human …

200 papers

Contrastive language-image pretraining has shown great success in learning visual-textual joint representation from web-scale data, demonstrating remarkable "zero-shot" generalization ability for various image tasks. However, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Bolin Ni , Houwen Peng , Minghao Chen , Songyang Zhang , Gaofeng Meng , Jianlong Fu , Shiming Xiang , Haibin Ling

Face recognition is a core task in computer vision designed to identify and authenticate individuals by analyzing facial patterns and features. This field intersects with artificial intelligence image processing and machine learning with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Nhan T. Luu

Vision-based human activity recognition (HAR) has made substantial progress in recognizing predefined gestures but lacks adaptability for emerging activities. This paper introduces a paradigm shift by harnessing generative modeling and…

Human-Computer Interaction · Computer Science 2023-12-13 Nikhil Kashyap , Manas Satish Bedmutha , Prerit Chaudhary , Brian Wood , Wanda Pratt , Janice Sabin , Andrea Hartzler , Nadir Weibel

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like remote sensing, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jinwoo Shin

Many high-level skills that are required for computer vision tasks, such as parsing questions, comparing and contrasting semantics, and writing descriptions, are also required in other domains such as natural language processing. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Sophia Gu , Christopher Clark , Aniruddha Kembhavi

Contrastive image-text models such as CLIP form the building blocks of many state-of-the-art systems. While they excel at recognizing common generic concepts, they still struggle on fine-grained entities which are rare, or even absent from…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Human activity recognition is one of the most important tasks in computer vision and has proved useful in different fields such as healthcare, sports training and security. There are a number of approaches that have been explored to solve…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Sheryl Mathew , Annapoorani Subramanian , Pooja , Balamurugan MS , Manoj Kumar Rajagopal

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Contrastive Language-Image Pretraining (CLIP) has shown impressive zero-shot performance on image classification. However, state-of-the-art methods often rely on fine-tuning techniques like prompt learning and adapter-based tuning to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ans Munir , Faisal Z. Qureshi , Muhammad Haris Khan , Mohsen Ali

A large amount of recent research has focused on tasks that combine language and vision, resulting in a proliferation of datasets and methods. One such task is action recognition, whose applications include image annotation, scene under-…

Computation and Language · Computer Science 2017-04-25 Spandana Gella , Frank Keller

Low-light conditions have an adverse impact on machine cognition, limiting the performance of computer vision systems in real life. Since low-light data is limited and difficult to annotate, we focus on image processing to enhance low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Igor Morawski , Kai He , Shusil Dangi , Winston H. Hsu

We propose a novel approach based on deep Convolutional Neural Networks (CNN) to recognize human actions in still images by predicting the future motion, and detecting the shape and location of the salient parts of the image. We make the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-15 Marjaneh Safaei , Hassan Foroosh

Existing computer vision research in artwork struggles with artwork's fine-grained attributes recognition and lack of curated annotated datasets due to their costly creation. To the best of our knowledge, we are one of the first methods to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Marcos V. Conde , Kerem Turgutlu

In this paper, we propose a novel single image action recognition algorithm which is based on the idea of semantic body part actions. Unlike existing bottom up methods, we argue that the human action is a combination of meaningful body part…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Zhichen Zhao , Huimin Ma , Shaodi You

We study the effectiveness of data-balancing for mitigating biases in contrastive language-image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior conclusions that CLIP models can inadvertently…

Machine Learning · Computer Science 2024-03-08 Ibrahim Alabdulmohsin , Xiao Wang , Andreas Steiner , Priya Goyal , Alexander D'Amour , Xiaohua Zhai

In this paper, we study the problem of image-text matching. Inferring the latent semantic alignment between objects or other salient stuff (e.g. snow, sky, lawn) and the corresponding words in sentences allows to capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Kuang-Huei Lee , Xi Chen , Gang Hua , Houdong Hu , Xiaodong He

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various neural architectures, spanning Transformer-based models like Vision Transformers (ViTs) to Convolutional Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Ehsan Abbasnejad , Hamed Damirchi , Ignacio M. Jara , Felipe Bravo-Marquez , Anton van den Hengel

Large-scale joint training of multimodal models, e.g., CLIP, have demonstrated great performance in many vision-language tasks. However, image-text pairs for pre-training are restricted to the intersection of images and texts, limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yanan Sun , Zihan Zhong , Qi Fan , Chi-Keung Tang , Yu-Wing Tai

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

Retailers have long been searching for ways to effectively understand their customers' behaviour in order to provide a smooth and pleasant shopping experience that attracts more customers everyday and maximises their revenue, consequently.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Mohammad Mahdi Kazemi Moghaddam , Ehsan Abbasnejad , Javen Shi