中文
相关论文

相关论文: AIDE: Agentically Improve Visual Language Model wi…

200 篇论文

With software maintenance accounting for 50% of the cost of developing software, enhancing code quality and reliability has become more critical than ever. In response to this challenge, this doctoral research proposal aims to explore…

软件工程 · 计算机科学 2024-06-25 Fernando Vallecillos Ruiz

Instruction-following agents must ground language into their observation and action spaces. Learning to ground language is challenging, typically requiring domain-specific engineering or large quantities of human interaction data. To…

人工智能 · 计算机科学 2023-06-16 Theodore Sumers , Kenneth Marino , Arun Ahuja , Rob Fergus , Ishita Dasgupta

While visual language model architectures and training infrastructures advance rapidly, data curation remains under-explored where quantity and quality become a bottleneck. Existing work either crawls extra Internet data with a loose…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Yunhao Fang , Ligeng Zhu , Yao Lu , Yan Wang , Pavlo Molchanov , Jan Kautz , Jang Hyun Cho , Marco Pavone , Song Han , Hongxu Yin

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

Recent advances in visual-language machine learning models have demonstrated exceptional ability to use natural language and understand visual scenes by training on large, unstructured datasets. However, this training paradigm cannot…

计算与语言 · 计算机科学 2025-08-01 Anthony C Davis , Burhan Sadiq , Tianmin Shu , Chien-Ming Huang

Vision-Language Models (VLMs) based on Mixture-of-Experts (MoE) architectures have emerged as a pivotal paradigm in multimodal understanding, offering a powerful framework for integrating visual and linguistic information. However, the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Xiaoda Yang , JunYu Lu , Hongshun Qiu , Sijing Li , Hao Li , Shengpeng Ji , Xudong Tang , Jiayang Xu , Jiaqi Duan , Ziyue Jiang , Cong Lin , Sihang Cai , Zejian Xie , Zhuoyang Song , Songxin Zhang

Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities…

计算与语言 · 计算机科学 2025-03-28 Yue Li , Meng Tian , Zhenyu Lin , Jiangtong Zhu , Dechang Zhu , Haiqiang Liu , Zining Wang , Yueyi Zhang , Zhiwei Xiong , Xinhai Zhao

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

Vision-language models (VLMs) are capable of recognizing unseen actions. However, existing VLMs lack intrinsic understanding of procedural action concepts. Hence, they overfit to fixed labels and are not invariant to unseen action synonyms.…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Reza Ghoddoosian , Nakul Agarwal , Isht Dwivedi , Behzad Darisuh

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Multimodal large language models (MLLMs) have revolutionized the landscape of AI, demonstrating impressive capabilities in tackling complex vision and audio-language tasks. However, a critical challenge remains: these models often suffer…

机器学习 · 计算机科学 2026-05-05 Itai Allouche , Joseph Keshet

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

The application of Large Language Models (LLMs) for Automated Algorithm Discovery (AAD), particularly for optimisation heuristics, is an emerging field of research. This emergence necessitates robust, standardised benchmarking practices to…

软件工程 · 计算机科学 2025-04-30 Niki van Stein , Anna V. Kononova , Haoran Yin , Thomas Bäck

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

计算与语言 · 计算机科学 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia

Edge Intelligence (EI) has been instrumental in delivering real-time, localized services by leveraging the computational capabilities of edge networks. The integration of Large Language Models (LLMs) empowers EI to evolve into the next…

分布式、并行与集群计算 · 计算机科学 2025-03-07 Handi Chen , Weipeng Deng , Shuo Yang , Jinfeng Xu , Zhihan Jiang , Edith C. H. Ngai , Jiangchuan Liu , Xue Liu

Self-evolving agentic artificial intelligence (AI) offers a new paradigm for future wireless systems by enabling autonomous agents to continually adapt and improve without human intervention. Unlike static AI models, self-evolving agents…

人工智能 · 计算机科学 2025-10-08 Changyuan Zhao , Ruichen Zhang , Jiacheng Wang , Dusit Niyato , Geng Sun , Xianbin Wang , Shiwen Mao , Abbas Jamalipour

Large Language Models (LLMs) have demonstrated remarkable proficiency in human interactions, yet their application within the medical field remains insufficiently explored. Previous works mainly focus on the performance of medical knowledge…

计算与语言 · 计算机科学 2024-07-23 Yusheng Liao , Yutong Meng , Yuhao Wang , Hongcheng Liu , Yanfeng Wang , Yu Wang

Long-term agent memory is increasingly multimodal, yet existing evaluations rarely test whether agents preserve the visual evidence needed for later reasoning. In prior work, many visually grounded questions can be answered using only…

The impressive achievements of generative models in creating high-quality videos have raised concerns about digital integrity and privacy vulnerabilities. Recent works of AI-generated content detection have been widely studied in the image…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Qingyuan Liu , Yun-Yun Tsai , Ruijian Zha , Victoria Li , Pengyuan Shi , Chengzhi Mao , Junfeng Yang