中文
相关论文

相关论文: Reflexive Guidance: Improving OoDD in Vision-Langu…

200 篇论文

Multimodal Large Language Models (MLLMs) have recently received substantial interest, which shows their emerging potential as general-purpose models for various vision-language tasks. MLLMs involve significant external knowledge within…

多媒体 · 计算机科学 2024-10-21 Muhe Ding , Yang Ma , Pengda Qin , Jianlong Wu , Yuhong Li , Liqiang Nie

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

Text-guided image-to-image diffusion models excel in translating images based on textual prompts, allowing for precise and creative visual modifications. However, such a powerful technique can be misused for spreading misinformation,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Wenhao Wang , Yifan Sun , Zongxin Yang , Zhentao Tan , Zhengdong Hu , Yi Yang

Omnidirectional image super-resolution (ODISR) aims to upscale low-resolution (LR) omnidirectional images (ODIs) to high-resolution (HR), catering to the growing demand for detailed visual content across a $ 180^{\circ}\times360^{\circ}$…

图像与视频处理 · 电气工程与系统科学 2026-03-04 Xuhan Sheng , Runyi Li , Bin Chen , Weiqi Li , Xu Jiang , Jian Zhang

Large foundation models trained on large-scale vision-language data can boost Open-Vocabulary Object Detection (OVD) via synthetic training data, yet the hand-crafted pipelines often introduce bias and overfit to specific prompts. We…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Yang Zhou , Shiyu Zhao , Yuxiao Chen , Zhenting Wang , Can Jin , Dimitris N. Metaxas

Video Large Language Models (VLLMs) unlock world-knowledge-aware video understanding through pretraining on internet-scale data and have already shown promise on tasks such as movie analysis and video question answering. However, deploying…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Haichao Zhang , Yao Lu , Lichen Wang , Yunzhe Li , Daiwei Chen , Yunpeng Xu , Yun Fu

We study the process through which reasoning models trained with reinforcement learning on verifiable rewards (RLVR) can learn to solve new problems. We find that RLVR drives performance in two main ways: (1) by compressing pass@$k$ into…

机器学习 · 计算机科学 2025-06-23 Vaskar Nath , Elaine Lau , Anisha Gunjal , Manasi Sharma , Nikhil Baharte , Sean Hendryx

Editing complex visual content from ambiguous or partially specified instructions remains a core challenge in vision-language modeling. Existing models can contextualize content but often fail to infer the underlying intent within a…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Umar Khalid , Kashif Munir , Hasan Iqbal , Azib Farooq , Jing Hua , Nazanin Rahnavard , Chen Chen , Victor Zhu , Zhengping Ji

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

In autonomous driving, vision-centric 3D object detection recognizes and localizes 3D objects from RGB images. However, due to high annotation costs and diverse outdoor scenes, training data often fails to cover all possible test scenarios,…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Hongbin Lin , Yiming Yang , Chaoda Zheng , Yifan Zhang , Shuaicheng Niu , Zilu Guo , Yafeng Li , Gui Gui , Shuguang Cui , Zhen Li

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their…

计算与语言 · 计算机科学 2024-04-17 Bo Liu , Liming Zhan , Zexin Lu , Yujie Feng , Lei Xue , Xiao-Ming Wu

The fast development of Large Language Models (LLMs) offers growing opportunities to further improve sequential recommendation systems. Yet for some practitioners, integrating LLMs to their existing base recommendation systems raises…

信息检索 · 计算机科学 2025-04-17 Nanshan Jia , Chenfei Yuan , Yuhang Wu , Zeyu Zheng

Autoregression in large language models (LLMs) has shown impressive scalability by unifying all language tasks into the next token prediction paradigm. Recently, there is a growing interest in extending this success to vision foundation…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Shenghao Xie , Wenqiang Zu , Mingyang Zhao , Duo Su , Shilong Liu , Ruohua Shi , Guoqi Li , Shanghang Zhang , Lei Ma

Enabling robotic assistants to navigate complex environments and locate objects described in free-form language is a critical capability for real-world deployment. While foundation models, particularly Vision-Language Models (VLMs), offer…

机器人学 · 计算机科学 2026-04-16 Naoki Yokoyama , Sehoon Ha

In recent years, the upstream of Large Language Models (LLM) has also encouraged the computer vision community to work on substantial multimodal datasets and train models on a scale in a self-/semi-supervised manner, resulting in Vision…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Keno Moenck , Duc Trung Thieu , Julian Koch , Thorsten Schüppstuhl

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

机器人学 · 计算机科学 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

The reusability of state-of-the-art Pre-trained Language Models (PLMs) is often limited by their generalization problem, where their performance drastically decreases when evaluated on examples that differ from the training dataset, known…

计算与语言 · 计算机科学 2023-08-09 Somayeh Ghanbarzadeh , Hamid Palangi , Yan Huang , Radames Cruz Moreno , Hamed Khanpour

Out-of-distribution (OOD) detection represents a critical challenge in remote sensing applications, where reliable identification of novel or anomalous patterns is essential for autonomous monitoring, disaster response, and environmental…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu