English
Related papers

Related papers: PerSRV: Personalized Sticker Retrieval with Vision…

200 papers

Large language models are increasingly used as personal assistants, yet most lack a persistent user model, forcing users to repeatedly restate preferences across sessions. We propose Vector-Adapted Retrieval Scoring (VARS), a…

Computation and Language · Computer Science 2026-03-24 Yuren Hao , Shuhaib Mehri , ChengXiang Zhai , Dilek Hakkani-Tür

Scalable Vector Graphics (SVG) offer a powerful format for representing visual designs as interpretable code. Recent advances in vision-language models (VLMs) have enabled high-quality SVG generation by framing the problem as a code…

Zero-shot Composed Image Retrieval (ZS-CIR) enables image search using a reference image and a text prompt without requiring specialized text-image composition networks trained on large-scale paired data. However, current ZS-CIR approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Osman Tursun , Sinan Kalkan , Simon Denman , Clinton Fookes

Learned Sparse Retrieval (LSR) is a group of neural methods designed to encode queries and documents into sparse lexical vectors. These vectors can be efficiently indexed and retrieved using an inverted index. While LSR has shown promise in…

Information Retrieval · Computer Science 2024-02-13 Thong Nguyen , Mariya Hendriksen , Andrew Yates

Many scene text recognition approaches are based on purely visual information and ignore the semantic relation between scene and text. In this paper, we tackle this problem from natural language processing perspective to fill the gap…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Ahmed Sabir , Francesc Moreno-Noguer , Lluís Padró

A person is usually characterized by descriptors like age, gender, height, cloth type, pattern, color, etc. Such descriptors are known as attributes and/or soft-biometrics. They link the semantic gap between a person's description and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Parshwa Shah , Arpit Garg , Vandit Gajjar

Visual relationship detection aims to reason over relationships among salient objects in images, which has drawn increasing attention over the past few years. Inspired by human reasoning mechanisms, it is believed that external visual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Meng-Jiun Chiou , Roger Zimmermann , Jiashi Feng

Radar sensors provide reliable perception across adverse weather, lighting, and long-range conditions, yet existing machine learning approaches remain fragmented and task-specific, with each downstream task employing distinct architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Pushkal Mishra , Kshitiz Bansal , Dinesh Bharadia

Visual transfer learning for unseen categories presents an active research topic yet a challenging task, due to the inherent conflict between preserving category-specific representations and acquiring transferable knowledge. Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Xiao Shi , Yangjun Ou , Zhenzhong Chen

Image text retrieval is a task to search for the proper textual descriptions of the visual world and vice versa. One challenge of this task is the vulnerability to input image and text corruptions. Such corruptions are often unobserved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Sunwoo Kim , Kyuhong Shim , Luong Trung Nguyen , Byonghyo Shim

Vision-Language Models (VLMs) are powerful tools for processing and understanding text and images. We study the processing of visual tokens in the language model component of LLaVA, a prominent VLM. Our approach focuses on analyzing the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Clement Neo , Luke Ong , Philip Torr , Mor Geva , David Krueger , Fazl Barez

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

In the evolving landscape of multimodal language models, understanding the nuanced meanings conveyed through visual cues - such as satire, insult, or critique - remains a significant challenge. Existing evaluation benchmarks primarily focus…

Machine Learning · Computer Science 2025-02-25 Xiaofei Yin , Yijie Hong , Ya Guo , Yi Tu , Weiqiang Wang , Gongshen Liu , Huijia zhu

While existing large vision-language multimodal models focus on whole image understanding, there is a prominent gap in achieving region-specific comprehension. Current approaches that use textual coordinates or spatial encodings often fail…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Mu Cai , Haotian Liu , Dennis Park , Siva Karthik Mustikovela , Gregory P. Meyer , Yuning Chai , Yong Jae Lee

There is a growing interest in applying large language models (LLMs) in robotic tasks, due to their remarkable reasoning ability and extensive knowledge learned from vast training corpora. Grounding LLMs in the physical world remains an…

Robotics · Computer Science 2024-04-11 Wenqiang Lai , Yuan Gao , Tin Lun Lam

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Recent progress in large pre-trained vision language models (VLMs) has reached state-of-the-art performance on several object detection benchmarks and boasts strong zero-shot capabilities, but for optimal performance on specific targets…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Frank Ruis , Gertjan Burghouts , Hugo Kuijf

While vision-language models (VLMs) have exhibited multi-turn visual reasoning capabilities, their reasoning trajectories remain relatively shallow and are dominated by a text-centric paradigm, limiting their applicability to complex visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhiwei Ning , Wenwen Tong , Xiangli Kong , Shengnan Ma , Ziyi Shang , Jingcheng Ni , Tao Hu , Yong Xien Chng , Jixuan Ying , Zehuan Wu , Hanming Deng , Jie Yang , Yuanjie Zheng , Wei Liu , Lewei Lu

Recently, Referring Image Segmentation (RIS) frameworks that pair the Multimodal Large Language Model (MLLM) with the Segment Anything Model (SAM) have achieved impressive results. However, adapting MLLM to segmentation is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiaobo Yang , Xiaojin Gong

We propose a novel visual SLAM method that integrates text objects tightly by treating them as semantic features via fully exploring their geometric and semantic prior. The text object is modeled as a texture-rich planar patch whose…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Boying Li , Danping Zou , Yuan Huang , Xinghan Niu , Ling Pei , Wenxian Yu