English
Related papers

Related papers: Visual Alignment Constraint for Continuous Sign La…

200 papers

In this paper, we investigate the research problem of unsupervised multi-view feature selection. Conventional solutions first simply combine multiple pre-constructed view-specific similarity structures into a collaborative similarity…

Information Retrieval · Computer Science 2019-04-26 Xiao Dong , Lei Zhu , Xuemeng Song , Jingjing Li , Zhiyong Cheng

Scene text recognition (STR) is a challenging task that requires large-scale annotated data for training. However, collecting and labeling real text images is expensive and time-consuming, which limits the availability of real data.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Mingkun Yang , Biao Yang , Minghui Liao , Yingying Zhu , Xiang Bai

Vision-Language-Action models (VLAs) promise to ground language instructions in robot control, yet in practice often fail to faithfully follow language. When presented with instructions that lack strong scene-specific supervision, VLAs…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Yu Fang , Yuchun Feng , Dong Jing , Jiaqi Liu , Yue Yang , Zhenyu Wei , Daniel Szafir , Mingyu Ding

Reinforcement learning (RL) has shown great effectiveness for fine-tuning large language models (LLMs) using tasks that are challenging yet easily verifiable, such as math reasoning or code generation. However, extending this success to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Xiyao Wang , Zhengyuan Yang , Chao Feng , Yongyuan Liang , Yuhang Zhou , Xiaoyu Liu , Ziyi Zang , Ming Li , Chung-Ching Lin , Kevin Lin , Linjie Li , Furong Huang , Lijuan Wang

Computer Vision (CV) has yet to fully achieve the zero-shot task generalization observed in Natural Language Processing (NLP), despite following many of the milestones established in NLP, such as large transformer models, extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yang Shen , Xiu-Shen Wei , Yifan Sun , Yuxin Song , Tao Yuan , Jian Jin , Heyang Xu , Yazhou Yao , Errui Ding

Logical anomalies are violations of predefined constraints on object quantity, spatial layout, and compositional relationships in industrial images. While prior work largely treats anomaly detection as a binary decision, such formulations…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Xufei Zhang , Xinjiao Zhou , Ziling Deng , Dongdong Geng , Jianxiong Wang

Forced alignment refers to a technology that time-aligns a given transcription with a corresponding speech. However, as the forced alignment technologies have developed using speech audio, they might fail in alignment when the input speech…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Minsu Kim , Chae Won Kim , Yong Man Ro

Vision language models (VLMs) like CLIP show stellar zero-shot capability on classification benchmarks. However, selecting the VLM with the highest performance on the unlabeled downstream task is non-trivial. Existing VLM selection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yuhe Ding , Bo Jiang , Aihua Zheng , Qin Xu , Jian Liang

Practical face recognition has been studied in the past decades, but still remains an open challenge. Current prevailing approaches have already achieved substantial breakthroughs in recognition accuracy. However, their performance usually…

Computer Vision and Pattern Recognition · Computer Science 2015-11-03 Yandong Wen , Weiyang Liu , Meng Yang , Zhifeng Li

Vision-Language Models (VLMs) achieve strong cross-modal performance, yet recent evidence suggests they over-rely on textual descriptions while under-utilizing visual evidence -- a phenomenon termed ``text shortcut learning.'' We propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lijie Zhou

Attribute labeling at large scale is typically incomplete and partial, posing significant challenges to model optimization. Existing attribute learning methods often treat the missing labels as negative or simply ignore them all during…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Kongming Liang , Xinran Wang , Rui Wang , Donghui Gao , Ling Jin , Weidong Liu , Xiatian Zhu , Zhanyu Ma , Jun Guo

Visual Language Navigation (VLN) is a fundamental task within the field of Embodied AI, focusing on the ability of agents to navigate complex environments based on natural language instructions. Despite the progress made by existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ruoyu Wang , Tong Yu , Junda Wu , Yao Liu , Julian McAuley , Lina Yao

Vision-Language Models (vLLMs) have emerged as powerful architectures for joint reasoning over visual and textual inputs, enabling breakthroughs in image captioning, cross modal retrieval, and multimodal dialogue. However, as these models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Andrew Kiruluta , Preethi Raju , Priscilla Burity

Vision Language Models (VLMs) offer the exciting possibility of processing text as rendered images, bypassing the need for tokenizing the text into long token sequences. Since VLM image encoders map fixed-size images to a fixed number of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Roy Xie , Dan Friedman , Donghan Yu , Bowen Pan , Christopher Fifty , Jang-Hyun Kim , Xianzhi Du , Zhe Gan , Vivek Rathod , Bhuwan Dhingra

Vision-language models (VLMs) can learn high-quality representations from a large-scale training dataset of image-text pairs. Prompt learning is a popular approach to fine-tuning VLM to adapt them to downstream tasks. Despite the satisfying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhifang Zhang , Yuwei Niu , Xin Liu , Beibei Li

Vision-language models (VLMs) pre-trained on web-scale data exhibit promising zero-shot generalization but often suffer from semantic misalignment due to domain gaps between pre-training and downstream tasks. Existing approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xiaojie Yin , Qilong Wang , Qinghua Hu

Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Beichen Zhang , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Cross-modal alignment is essential for vision-language pre-training (VLP) models to learn the correct corresponding information across different modalities. For this purpose, inspired by the success of masked language modeling (MLM) tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yatai Ji , Rongcheng Tu , Jie Jiang , Weijie Kong , Chengfei Cai , Wenzhe Zhao , Hongfa Wang , Yujiu Yang , Wei Liu

Vision language models (VLMs) demonstrate impressive capabilities in visual question answering and image captioning, acting as a crucial link between visual and language models. However, existing open-source VLMs heavily rely on pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Aristeidis Panos , Rahaf Aljundi , Daniel Olmeda Reino , Richard E Turner

Human perception of visual similarity is inherently adaptive and subjective, depending on the users' interests and focus. However, most image retrieval systems fail to reflect this flexibility, relying on a fixed, monolithic metric that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sohwi Lim , Lee Hyoseok , Jungjoon Park , Tae-Hyun Oh