English
Related papers

Related papers: Ensemble based discriminative models for Visual Di…

200 papers

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted results from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Bin Cao , Yisi Zhang , Hanyi Wang , Xingjian He , Jing Liu

In this work we predict vehicle speed and steering angle given camera image frames. Our key contribution is using an external pre-trained neural network for segmentation. We augment the raw images with their segmentation masks and mirror…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Antonia Lovjer , Minsu Yeom , Benedikt D. Schifferer , Iddo Drori

This paper presents NTIRE 2026, the 3rd Restore Any Image Model (RAIM) challenge on multi-exposure image fusion in dynamic scenes. We introduce a benchmark that targets a practical yet difficult HDR imaging setting, where exposure…

Vision-Language Models (VLMs) have demonstrated impressive performance on various visual tasks, yet they still require adaptation on downstream tasks to achieve optimal performance. Recently, various adaptation technologies have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chuanming Wang , Henming Mao , Huanhuan Zhang , Huiyuan Fu , Huadong Ma

Multimodal large language models (MLLMs) have emerged as powerful tools for visual question answering (VQA), enabling reasoning and contextual understanding across visual and textual modalities. Despite their advancements, the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Nikitha SR

Pretrained Vision-Language Models (VLMs) have achieved remarkable performance in image retrieval from text. However, their performance drops drastically when confronted with linguistically complex texts that they struggle to comprehend.…

Computation and Language · Computer Science 2023-05-08 Yunxin Li , Baotian Hu , Yuxin Ding , Lin Ma , Min Zhang

Convolutional neural networks (CNNs) deliver exceptional results for computer vision, including medical image analysis. With the growing number of available architectures, picking one over another is far from obvious. Existing art suggests…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Fábio Perez , Sandra Avila , Eduardo Valle

In this paper, we introduce the Multi-Modal Video Reasoning and Analyzing Competition (MMVRAC) workshop in conjunction with ICCV 2021. This competition is composed of four different tracks, namely, video question answering, skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Haoran Peng , He Huang , Li Xu , Tianjiao Li , Jun Liu , Hossein Rahmani , Qiuhong Ke , Zhicheng Guo , Cong Wu , Rongchang Li , Mang Ye , Jiahao Wang , Jiaxu Zhang , Yuanzhong Liu , Tao He , Fuwei Zhang , Xianbin Liu , Tao Lin

The visual dialog task attempts to train an agent to answer multi-turn questions given an image, which requires the deep understanding of interactions between the image and dialog history. Existing researches tend to employ the…

Computation and Language · Computer Science 2022-02-23 Tong Ye , Shijing Si , Jianzong Wang , Rui Wang , Ning Cheng , Jing Xiao

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

Computation and Language · Computer Science 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Evaluating Visual Dialogue, the task of answering a sequence of questions relating to a visual input, remains an open research challenge. The current evaluation scheme of the VisDial dataset computes the ranks of ground-truth answers in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Daniela Massiceti , Viveka Kulharia , Puneet K. Dokania , N. Siddharth , Philip H. S. Torr

The VALUE (Video-And-Language Understanding Evaluation) benchmark is newly introduced to evaluate and analyze multi-modal representation learning algorithms on three video-and-language tasks: Retrieval, QA, and Captioning. The main…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Minchul Shin , Jonghwan Mun , Kyoung-Woon On , Woo-Young Kang , Gunsoo Han , Eun-Sol Kim

In computer vision, an entity such as an image or video is often represented as a set of instance vectors, which can be SIFT, motion, or deep learning feature vectors extracted from different parts of that entity. Thus, it is essential to…

Computer Vision and Pattern Recognition · Computer Science 2016-04-28 Jianxin Wu , Bin-Bin Gao , Guoqing Liu

Multi-modal large language models (MLLMs), such as GPT-4o, excel at integrating text and visual data but face systematic challenges when interpreting ambiguous or incomplete visual stimuli. This study leverages statistical modeling to…

Machine Learning · Computer Science 2024-12-09 Ching-Yi Wang

Visual Document Retrieval (VDR) requires representations that capture both fine-grained visual details and global document structure to ensure retrieval efficacy while maintaining computational efficiency. Existing VDR models struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Fengbin Zhu , Zijing Cai , Yuzhe Wang , Pengyang Shao , Wenjie Wang , Fuli Feng , Richang Hong , Tat-Seng Chua

In this work we study binary classification problems where we assume that our training data is subject to uncertainty, i.e. the precise data points are not known. To tackle this issue in the field of robust machine learning the aim is to…

Machine Learning · Computer Science 2022-03-04 Jannis Kurtz

We introduce MUSE-VL, a Unified Vision-Language Model through Semantic discrete Encoding for multimodal understanding and generation. Recently, the research community has begun exploring unified models for visual generation and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Rongchang Xie , Chen Du , Ping Song , Chang Liu

This paper presents a novel Dialect Identification (DID) system developed for the Fifth Edition of the Multi-Genre Broadcast challenge, the task of Fine-grained Arabic Dialect Identification (MGB-5 ADI Challenge). The system improves upon…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-20 Xiaoxiao Miao , Ian McLoughlin

We introduce InterChart, a diagnostic benchmark that evaluates how well vision-language models (VLMs) reason across multiple related charts, a task central to real-world applications such as scientific reporting, financial analysis, and…

Computation and Language · Computer Science 2026-05-04 Anirudh Iyengar Kaniyar Narayana Iyengar , Srija Mukhopadhyay , Adnan Qidwai , Shubhankar Singh , Dan Roth , Vivek Gupta

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong