中文
相关论文

相关论文: AIDE: Agentically Improve Visual Language Model wi…

200 篇论文

Automatic medical image segmentation plays a critical role in scientific research and medical care. Existing high-performance deep learning methods typically rely on large training datasets with high-quality manual annotations, which are…

图像与视频处理 · 电气工程与系统科学 2021-11-17 Shanshan Wang , Cheng Li , Rongpin Wang , Zaiyi Liu , Meiyun Wang , Hongna Tan , Yaping Wu , Xinfeng Liu , Hui Sun , Rui Yang , Xin Liu , Jie Chen , Huihui Zhou , Ismail Ben Ayed , Hairong Zheng

Vision language models (VLMs) have seen growing adoption in recent years, but many still struggle with basic spatial reasoning errors. We hypothesize that this is due to VLMs adopting pre-trained vision backbones, specifically vision…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Ian Covert , Tony Sun , James Zou , Tatsunori Hashimoto

Implicit Attribute Value Extraction (AVE) is essential for accurately representing products in e-commerce, as it infers latent attributes from multimodal data. Despite advances in multimodal large language models (MLLMs), implicit AVE…

计算与语言 · 计算机科学 2026-01-19 Wei-Chieh Huang , Cornelia Caragea

Software issue resolution aims to address real-world issues in software repositories (e.g., bug fixing and efficiency optimization) based on natural language descriptions provided by users, representing a key aspect of software maintenance.…

软件工程 · 计算机科学 2025-12-30 Zhonghao Jiang , David Lo , Zhongxin Liu

The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Xingcheng Zhou , Mingyu Liu , Ekim Yurtsever , Bare Luka Zagar , Walter Zimmer , Hu Cao , Alois C. Knoll

Autonomous Vehicles (AVs) are poised to revolutionize emergency services by enabling faster, safer, and more efficient responses. This transformation is driven by advances in Artificial Intelligence (AI), particularly Reinforcement Learning…

人工智能 · 计算机科学 2026-02-23 Yousef Emami , Radha Reddy , Azadeh Pourkabirian , Miguel Gutierrez Gaitan

The subjective evaluation of early stage engineering designs, such as conceptual sketches, traditionally relies on human experts. However, expert evaluations are time-consuming, expensive, and sometimes inconsistent. Recent advances in…

人工智能 · 计算机科学 2025-04-02 Kristen M. Edwards , Farnaz Tehranchi , Scarlett R. Miller , Faez Ahmed

Large Language Models (LLMs) have achieved impressive results in knowledge-based Visual Question Answering (VQA). However existing methods still have challenges: the inability to use external tools autonomously, and the inability to work in…

计算与语言 · 计算机科学 2025-08-08 Zhongjian Hu , Peng Yang , Bing Li , Zhenqi Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities in challenging, knowledge-intensive reasoning tasks. However, extending LLMs to perceive and reason over a new modality (e.g., vision), often requires costly development…

计算与语言 · 计算机科学 2025-11-25 James Y. Huang , Sheng Zhang , Qianchu Liu , Guanghui Qin , Tinghui Zhu , Tristan Naumann , Muhao Chen , Hoifung Poon

Visual document retrieval requires understanding heterogeneous and multi-modal content to satisfy implicit information needs. Recent advances use screenshot-based document encoding with fine-grained late interaction to encode holistic…

信息检索 · 计算机科学 2026-05-12 Wanqing Cui , Wei Huang , Yazhi Guo , Yibo Hu , Meiguang Jin , Junfeng Ma , Keping Bi

Large Language Models (LLMs) have demonstrated considerable potential in improving coding education by providing support for code writing, explanation, and debugging. However, existing LLM-based approaches generally fail to assess students'…

多智能体系统 · 计算机科学 2025-07-21 Jianing Zhao , Peng Gao , Jiannong Cao , Zhiyuan Wen , Chen Chen , Jianing Yin , Ruosong Yang , Bo Yuan

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

The remarkable advances in AI and Large Language Models (LLMs) have enabled machines to write code, accelerating the growth of software systems. However, the bottleneck in software development is not writing code but understanding it;…

软件工程 · 计算机科学 2025-07-08 Adam Tornhill , Markus Borg , Nadim Hagatulah , Emma Söderberg

Despite being pretrained on multilingual corpora, large language models (LLMs) exhibit suboptimal performance on low-resource languages. Recent approaches have leveraged multilingual encoders alongside LLMs by introducing trainable…

计算与语言 · 计算机科学 2025-02-18 Zhiwen Ruan , Yixia Li , He Zhu , Longyue Wang , Weihua Luo , Kaifu Zhang , Yun Chen , Guanhua Chen

Edge intelligence delivers low-latency inference, yet most edge analytics remain hard-coded and must be redeployed as conditions change. When data patterns shift or new questions arise, engineers often need to write new scripts and push…

分布式、并行与集群计算 · 计算机科学 2026-04-14 Chinmaya Kumar Dehury , Siddharth Singh Kushwaha , Qiyang Zhang , Alaa Saleh , Praveen Kumar Donta

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

人工智能 · 计算机科学 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

The field of natural language processing (NLP) has made significant strides in recent years, particularly in the development of large-scale vision-language models (VLMs). These models aim to bridge the gap between text and visual…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Sheng Shen , Zhewei Yao , Chunyuan Li , Trevor Darrell , Kurt Keutzer , Yuxiong He

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

Automated vehicles lack natural communication channels with other road users, making external Human-Machine Interfaces (eHMIs) essential for conveying intent and maintaining trust in shared environments. However, most eHMI studies rely on…

人机交互 · 计算机科学 2026-04-22 Ding Xia , Xinyue Gui , Mark Colley , Fan Gao , Zhongyi Zhou , Dongyuan Li , Renhe Jiang , Takeo Igarashi

Training models to act as agents that can effectively navigate and perform actions in a complex environment, such as a web browser, has typically been challenging due to lack of training data. Large language models (LLMs) have recently…