中文
相关论文

相关论文: See it. Say it. Sorted: Agentic System for Composi…

200 篇论文

Code has emerged as a precise and executable medium for reasoning and action in the agent era. Yet, progress has largely focused on language-centric tasks such as program synthesis and debugging, leaving visual-centric coding underexplored.…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Kevin Qinghong Lin , Yuhao Zheng , Hangyu Ran , Dantong Zhu , Dongxing Mao , Linjie Li , Philip Torr , Alex Jinpeng Wang

Large language model (LLM) agents are increasingly capable of orchestrating complex tasks in low-code environments. However, these agents often exhibit hallucinations and logical inconsistencies because their inherent reasoning mechanisms…

人工智能 · 计算机科学 2025-10-09 Jiexi Xu , Jiaqi Liu , Lanruo Wang , Su Liu

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Hand-drawn sketches are a natural and efficient medium for capturing and conveying ideas. Despite significant advancements in controllable natural image generation, translating freehand sketches into structured, machine-readable diagrams…

人工智能 · 计算机科学 2025-08-05 Cheng Tan , Qi Chen , Jingxuan Wei , Gaowei Wu , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Large Language Models (LLMs) and Vision-Language Models (VLMs) increasingly generate indoor scenes through intermediate structures such as layouts and scene graphs, yet evaluation still relies on LLM or VLM judges that score rendered views,…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Kathakoli Sengupta , Kai Ao , Paola Cascante-Bonilla

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models (VLMs). These agents make visual decisions at scale, deciding what to click, recommend, or buy. Yet,…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Manuel Cherep , Pranav M R , Pattie Maes , Nikhil Singh

We present Thinking with Generated Images, a novel paradigm that fundamentally transforms how large multimodal models (LMMs) engage with visual reasoning by enabling them to natively think across text and vision modalities through…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Ethan Chern , Zhulin Hu , Steffi Chern , Siqi Kou , Jiadi Su , Yan Ma , Zhijie Deng , Pengfei Liu

Recent work has empirically shown that Vision-Language Models (VLMs) struggle to fully understand the compositional properties of the human language, usually modeling an image caption as a "bag of words". As a result, they perform poorly on…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Fiorenzo Parascandolo , Nicholas Moratelli , Enver Sangineto , Lorenzo Baraldi , Rita Cucchiara

Current image generation and editing methods primarily process textual prompts as direct inputs without reasoning about visual composition and explicit operations. We present Generation Chain-of-Thought (GoT), a novel paradigm that enables…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Rongyao Fang , Chengqi Duan , Kun Wang , Linjiang Huang , Hao Li , Shilin Yan , Hao Tian , Xingyu Zeng , Rui Zhao , Jifeng Dai , Xihui Liu , Hongsheng Li

Zero-shot classification is a promising paradigm to solve an applicable problem when the training classes and test classes are disjoint. Achieving this usually needs experts to externalize their domain knowledge by manually specifying a…

人机交互 · 计算机科学 2021-08-17 Shichao Jia , Zeyu Li , Nuo Chen , Jiawan Zhang

A fundamental characteristic common to both human vision and natural language is their compositional nature. Yet, despite the performance gains contributed by large vision and language pretraining, recent investigations find that most-if…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Chenhao Zheng , Jieyu Zhang , Aniruddha Kembhavi , Ranjay Krishna

We propose an intuitive LLM prompting framework (AgentKit) for multifunctional agents. AgentKit offers a unified framework for explicitly constructing a complex "thought process" from simple natural language prompts. The basic building…

Many recent prompting strategies for large language models (LLMs) query the model multiple times sequentially -- first to produce intermediate results and then the final answer. However, using these methods, both decoder and model are…

计算与语言 · 计算机科学 2023-11-10 Luca Beurer-Kellner , Mark Niklas Müller , Marc Fischer , Martin Vechev

Generative AI, particularly Large Language Models, increasingly integrates graph-based representations to enhance reasoning, retrieval, and structured decision-making. Despite rapid advances, there remains limited clarity regarding when,…

人工智能 · 计算机科学 2026-04-21 Hamed Jelodar , Samita Bai , Mohammad Meymani , Parisa Hamedi , Roozbeh Razavi-Far , Ali Ghorbani

In this paper, we study the graphic layout generation problem of producing high-quality visual-textual presentation designs for given images. We note that image compositions, which contain not only global semantics but also spatial…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Min Zhou , Chenchen Xu , Ye Ma , Tiezheng Ge , Yuning Jiang , Weiwei Xu

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

人工智能 · 计算机科学 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

人机交互 · 计算机科学 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Graphic design is crucial for conveying ideas and messages. Designers usually organize their work into objects, backgrounds, and vectorized text layers to simplify editing. However, this workflow demands considerable expertise. With the…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Jingye Chen , Zhaowen Wang , Nanxuan Zhao , Li Zhang , Difan Liu , Jimei Yang , Qifeng Chen

Designing a computational imaging system -- selecting operators, setting parameters, validating consistency -- requires weeks of specialist effort per modality, creating an expertise bottleneck that excludes the broader scientific community…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Chengshuai Yang

Vision-language models (VLMs) often struggle with compositional reasoning due to insufficient high-quality image-text data. To tackle this challenge, we propose a novel block-based diffusion approach that automatically generates…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Zexi Jia , Chuanwei Huang , Hongyan Fei , Yeshuang Zhu , Zhiqiang Yuan , Ying Deng , Jiapei Zhang , Jinchao Zhang , Jie Zhou