English
Related papers

Related papers: Pixel-Level Reasoning Segmentation via Multi-turn …

200 papers

Dialogue related Machine Reading Comprehension requires language models to effectively decouple and model multi-turn dialogue passages. As a dialogue development goes after the intentions of participants, its topic may not keep constant…

Computation and Language · Computer Science 2023-09-19 Xinbei Ma , Yi Xu , Hai Zhao , Zhuosheng Zhang

End-to-end text-image machine translation (TIMT), which directly translates textual content in images across languages, is crucial for real-world multilingual scene understanding. Despite advances in vision-language large models (VLLMs),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Gengluo Li , Chengquan Zhang , Yupu Liang , Huawen Shen , Yaping Zhang , Pengyuan Lyu , Weinong Wang , Xingyu Wan , Gangyan Zeng , Han Hu , Can Ma , Yu Zhou

While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, most LMMs default to verbalizing perceptual content into text, a strong limitation for tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 André G. Viveiros , Nuno Gonçalves , Matthias Lindemann , André Martins

Interactive segmentation methods rely on user inputs to iteratively update the selection mask. A click specifying the object of interest is arguably the most simple and intuitive interaction type, and thereby the most common choice for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Andrey Moskalenko , Vlad Shakhuro , Anna Vorontsova , Anton Konushin , Anton Antonov , Alexander Krapukhin , Denis Shepelev , Konstantin Soshin

Multimodal intent recognition poses significant challenges, requiring the incorporation of non-verbal modalities from real-world contexts to enhance the comprehension of human intentions. Existing benchmark datasets are limited in scale and…

Multimedia · Computer Science 2024-07-01 Hanlei Zhang , Xin Wang , Hua Xu , Qianrui Zhou , Kai Gao , Jianhua Su , jinyue Zhao , Wenrui Li , Yanting Chen

As CLIP's global alignment limits its ability to capture fine-grained details, recent efforts have focused on enhancing its region-text alignment. However, current remote sensing (RS)-specific CLIP variants still inherit this limited…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Zhenshi Li , Weikang Yu , Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Pedram Ghamisi , Xiao Xiang Zhu

Recent reinforcement-learning frameworks for visual perception policy usually incorporate intermediate reasoning chains expressed in natural language. Empirical observations indicate that such purely linguistic intermediate reasoning often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Wei Tang , Yanpeng Sun , Shan Zhang , Weihao Bo , Xiaofan Li , Piotr Koniusz , Wei Li , Na Zhao , Zechao Li

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Visual Question Answering (VQA) often requires coupling fine-grained perception with factual knowledge beyond the input image. Prior multimodal Retrieval-Augmented Generation (MM-RAG) systems improve factual grounding but lack an internal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jeonghwan Kim , Renjie Tao , Sanat Sharma , Jiaqi Wang , Kai Sun , Zhaojiang Lin , Seungwhan Moon , Lambert Mathias , Anuj Kumar , Heng Ji , Xin Luna Dong

Modern recommendation systems typically follow two complementary paradigms: collaborative filtering, which models long-term user preferences from historical interactions, and conversational recommendation systems (CRS), which interact with…

Information Retrieval · Computer Science 2025-06-24 Vinaik Chhetri , Yousaf Reza , Moghis Fereidouni , Srijata Maji , Umar Farooq , AB Siddique

Multimodal language models (MLLMs) are increasingly paired with vision tools (e.g., depth, flow, correspondence) to enhance visual reasoning. However, despite access to these tool-generated visual cues, MLLMs often fail to benefit from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Muhammad Kamran Janjua , Hugo Silva , Di Niu , Bahador Rashidi

Evaluating vision-language models (VLMs) in scientific domains like mathematics and physics poses unique challenges that go far beyond predicting final answers. These domains demand conceptual understanding, symbolic reasoning, and…

Artificial Intelligence · Computer Science 2025-12-08 Shima Imani , Seungwhan Moon , Adel Ahmadyan , Lu Zhang , Kirmani Ahmed , Babak Damavandi

Recent large language models (LLMs) achieve near-saturation accuracy on many established mathematical reasoning benchmarks, raising concerns about their ability to diagnose genuine reasoning competence. This saturation largely stems from…

Recent multimodal large language models (MLLMs) achieve strong performance on visual reasoning benchmarks, yet it remains unclear to what extent such performance reflects reasoning directly grounded in visual evidence. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Longteng Guo , Yifan Wang , Pengkang Huo , Tailai Chen , Yuze Wu , Jing Liu , Xinxin Zhu

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance accuracy in…

Computation and Language · Computer Science 2024-10-15 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

While Multimodal Large Language Models (MLLMs) have achieved impressive progress in vision-language understanding, they still struggle with complex multi-step reasoning, often producing logically inconsistent or partially correct solutions.…

Artificial Intelligence · Computer Science 2025-06-06 Lingxiao Du , Fanqing Meng , Zongkai Liu , Zhixiang Zhou , Ping Luo , Qiaosheng Zhang , Wenqi Shao

In the wake of Masked Image Modeling (MIM), a diverse range of plain, non-hierarchical Vision Transformer (ViT) models have been pre-trained with extensive datasets, offering new paradigms and significant potential for semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Yuanduo Hong , Jue Wang , Weichao Sun , Huihui Pan

Conversational AI has now reached billions of users, yet existing datasets capture only what people say, not what they think. We introduce ThoughtTrace, the first large-scale dataset that pairs real-world multi-turn human--AI conversations…

Computation and Language · Computer Science 2026-05-25 Chuanyang Jin , Binze Li , Haopeng Xie , Cathy Mengying Fang , Tianjian Li , Shayne Longpre , Hongxiang Gu , Maximillian Chen , Tianmin Shu