中文
相关论文

相关论文: Pixel-Level Reasoning Segmentation via Multi-turn …

200 篇论文

Large Language Models are rapidly emerging as web-native interfaces to social platforms. On the social web, users frequently have ambiguous and dynamic goals, making complex intent understanding-rather than single-turn execution-the…

人工智能 · 计算机科学 2026-01-27 Zenghua Liao , Jinzhi Liao , Xiang Zhao

Previous work on spoken language understanding (SLU) mainly focuses on single-intent settings, where each input utterance merely contains one user intent. This configuration significantly limits the surface form of user utterances and the…

计算与语言 · 计算机科学 2024-02-29 Hongshen Xu , Ruisheng Cao , Su Zhu , Sheng Jiang , Hanchong Zhang , Lu Chen , Kai Yu

Geospatial pixel reasoning aims to generate segmentation masks in remote sensing imagery directly from natural-language instructions. Most existing approaches follow a paradigm that fine-tunes multimodal large language models under…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Chengjie Jiang , Yunqi Zhou , Jiafeng Yan , Jing Li , Jiayang Li , Yue Zhou , Hongjie He , Jonathan Li

Visual understanding is inherently intention-driven - humans selectively focus on different regions of a scene based on their goals. Recent advances in large multimodal models (LMMs) enable flexible expression of such intentions through…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangquan Chen , Xufang Luo , Dongsheng Li

While LISA effectively bridges the gap between segmentation and large language models to enable reasoning segmentation, it poses certain limitations: unable to distinguish different instances of the target region, and constrained by the…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Senqiao Yang , Tianyuan Qu , Xin Lai , Zhuotao Tian , Bohao Peng , Shu Liu , Jiaya Jia

Medical image segmentation is crucial for clinical diagnosis, yet existing models are limited by their reliance on explicit human instructions and lack the active reasoning capabilities to understand complex clinical questions. While recent…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Yu Huang , Zelin Peng , Yichen Zhao , Piao Yang , Xiaokang Yang , Wei Shen

Referring expression segmentation (RES) aims at segmenting the entities' masks that match the descriptive language expression. While traditional RES methods primarily address object-level grounding, real-world scenarios demand a more…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Jing Liu , Wenxuan Wang , Yisi Zhang , Yepeng Tang , Xingjian He , Longteng Guo , Tongtian Yue , Xinlong Wang

Prompt-based medical image segmentation has rapidly emerged, yet existing methods rely on explicit prompts like bounding boxes and struggle to reason about the spatial relationships essential for clinical diagnosis. While general-domain…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Quoc-Huy Trinh , Minh-Van Nguyen , Jun Zeng , Debesh Jha , Ulas Bagci

CAPTCHA, originally designed to distinguish humans from robots, has evolved into a real-world benchmark for assessing the spatial reasoning capabilities of vision-language models. In this work, we first show that step-by-step reasoning is…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Python Song , Luke Tenyi Chang , Yun-Yun Tsai , Penghui Li , Junfeng Yang

Streaming recognition and segmentation of multi-party conversations with overlapping speech is crucial for the next generation of voice assistant applications. In this work we address its challenges discovered in the previous work on…

音频与语音处理 · 电气工程与系统科学 2022-05-12 Ilya Sklyar , Anna Piunova , Christian Osendorfer

Existing works on reasoning segmentation either connect hidden features from a language model directly to a mask decoder or represent positions in text, which limits interpretability and semantic detail. To solve this, we present CoPRS, a…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Zhenyu Lu , Liupeng Li , Jinpeng Wang , Yan Feng , Bin Chen , Ke Chen , Yaowei Wang

Many open-ended conversations (e.g., tutoring lessons or business meetings) revolve around pre-defined reference materials, like worksheets or meeting bullets. To provide a framework for studying such conversation structure, we introduce…

计算与语言 · 计算机科学 2024-11-13 Rose E. Wang , Pawan Wirawarn , Kenny Lam , Omar Khattab , Dorottya Demszky

Discourse segmentation, which segments texts into Elementary Discourse Units, is a fundamental step in discourse analysis. Previous discourse segmenters rely on complicated hand-crafted features and are not practical in actual use. In this…

计算与语言 · 计算机科学 2018-08-29 Yizhong Wang , Sujian Li , Jingfeng Yang

While interacting with chatbots, users may elicit multiple intents in a single dialogue utterance. Instead of training a dedicated multi-intent detection model, we propose DialogUSR, a dialogue utterance splitting and reformulation task…

计算与语言 · 计算机科学 2022-10-21 Haoran Meng , Zheng Xin , Tianyu Liu , Zizhen Wang , He Feng , Binghuai Lin , Xuemin Zhao , Yunbo Cao , Zhifang Sui

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Large Vision-Language Models (LVLMs) excel in multimodal reasoning and have shown impressive performance on various multimodal benchmarks. However, most of these benchmarks evaluate models primarily through multiple-choice or short-answer…

计算与语言 · 计算机科学 2026-02-26 Haofeng Wang , Yu Zhang

Large language models (LLMs) are essential tools that users employ across various scenarios, so evaluating their performance and guiding users in selecting the suitable service is important. Although many benchmarks exist, they mainly focus…

计算与语言 · 计算机科学 2024-09-23 Jiayin Wang , Fengran Mo , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

Dialogue Topic Segmentation (DTS) aims to divide dialogues into coherent segments. DTS plays a crucial role in various NLP downstream tasks, but suffers from chronic problems: data shortage, labeling ambiguity, and incremental complexity of…

计算与语言 · 计算机科学 2025-05-28 Seungmin Lee , Yongsang Yoo , Minhwa Jung , Min Song

Visual transformation reasoning (VTR) is a vital cognitive capability that empowers intelligent agents to understand dynamic scenes, model causal relationships, and predict future states, and thereby guiding actions and laying the…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Yuheng Ji , Yipu Wang , Yuyang Liu , Xiaoshuai Hao , Yue Liu , Yuting Zhao , Huaihai Lyu , Xiaolong Zheng

Large vision-language models have achieved remarkable progress in visual reasoning, yet most existing systems rely on single-step or text-only reasoning, limiting their ability to iteratively refine understanding across multiple visual…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Wenfang Sun , Hao Chen , Yingjun Du , Yefeng Zheng , Cees G. M. Snoek