English
Related papers

Related papers: Designing Any Imaging System from Natural Language…

200 papers

LLMs have been widely used in planning, either as planners to generate action sequences end-to-end, or as formalizers to represent the planning domain and problem in a formal language that can derive plans deterministically. However, both…

Computation and Language · Computer Science 2026-04-17 Cassie Huang , Stuti Mohan , Ziyi Yang , Stefanie Tellex , Li Zhang

Recent advances in language model (LM) agents and function calling have enabled autonomous, feedback-driven systems to solve problems across various digital domains. To better understand the unique limitations of LM agents, we introduce…

Artificial Intelligence · Computer Science 2025-03-12 Dhruv Gautam , Spandan Garg , Jinu Jang , Neel Sundaresan , Roshanak Zilouchian Moghaddam

Topology optimization can generate efficient structures, but designers often must manually translate qualitative intent, such as desired visual style, product experience, or manufacturability into solver settings that are not directly tied…

Artificial Intelligence · Computer Science 2026-05-22 Isabella A. Stewart , Hongrui Chen , Faez Ahmed

Topology optimization is a widely used design method that produces optimized material distributions for prescribed objectives and constraints through well-established numerical algorithms. Throughout the workflow, engineers make a series of…

Multiagent Systems · Computer Science 2026-05-25 Hyunjee Park , Hayoung Chung

Despite the significant strides made by generative AI in just a few short years, its future progress is constrained by the challenge of building modular and robust systems. This capability has been a cornerstone of past technological…

The architectural blueprint of today's leading text-to-image models contains a fundamental flaw: an inability to handle logical composition. This survey investigates this breakdown across three core primitives-negation, counting, and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Mayank Vatsa , Aparna Bharati , Richa Singh

AI governance programmes increasingly rely on natural language prompts to constrain and direct AI agent behaviour. These prompts function as executable specifications: they define the agent's mandate, scope, and quality criteria. Despite…

Software Engineering · Computer Science 2026-04-24 Christo Zietsman

We present a framework for generating physically realizable assembly instructions from natural language descriptions. Unlike unconstrained text-to-3D approaches, our method operates within a discrete parts vocabulary, enforcing geometric…

Artificial Intelligence · Computer Science 2025-12-19 David Noever

Personalized image generative models are highly proficient at synthesizing images from text or a single image, yet they lack explicit control for composing objects from specific parts of multiple source images without user specified masks…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shivam Singh , Yiming Chen , Agneet Chatterjee , Amit Raj , James Hays , Yezhou Yang , Chitta Baral

Despite significant advancements in text-to-image models for generating high-quality images, these methods still struggle to ensure the controllability of text prompts over images in the context of complex text prompts, especially when it…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Zhenyu Wang , Enze Xie , Aoxue Li , Zhongdao Wang , Xihui Liu , Zhenguo Li

Amodal completion, the task of inferring invisible object parts, faces significant challenges in maintaining semantic consistency and structural integrity. Prior progressive approaches are inherently limited by inference instability and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Hongxing Fan , Shuyu Zhao , Jiayang Ao , Lu Sheng

Automatically generating formal ontologies from unstructured natural language remains a central challenge in knowledge engineering. While large language models (LLMs) show promise, it remains unclear which architectural design choices drive…

Artificial Intelligence · Computer Science 2026-04-28 Abid Talukder , Maruf Ahmed Mridul , Oshani Seneviratne

The purpose of our paper is to develop a unified multi-agent architecture that automates end-to-end machine learning (ML) pipeline generation from datasets and natural-language (NL) goals, improving efficiency, robustness and…

Artificial Intelligence · Computer Science 2026-05-01 Adela Bara , Gabriela Dobrita , Simona-Vasilica Oprea

Safety- and security-critical systems have to be thoroughly tested against their specifications. The state of practice is to have _natural language_ specifications, from which test cases are derived manually - a process that is slow,…

Software Engineering · Computer Science 2025-11-25 Kuangxiangzi Liu , Dhiman Chakraborty , Alexander Liggesmeyer , Andreas Zeller

Toward recursive self-improvement, we investigate LLM agents autonomously designing foundation models beyond standard Transformers. We introduce a dual-framework approach: AIRA-Compose for high-level architecture search, and AIRA-Design for…

Artificial Intelligence · Computer Science 2026-05-18 Alberto Pepe , Chien-Yu Lin , Despoina Magka , Bilge Acun , Yannan Nellie Wu , Anton Protopopov , Carole-Jean Wu , Yoram Bachrach

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often…

Multiagent Systems · Computer Science 2025-09-25 Dawei Xiang , Wenyan Xu , Kexin Chu , Tianqi Ding , Zixu Shen , Yiming Zeng , Jianchang Su , Wei Zhang

Autoformalization, which translates natural language mathematics into machine-verifiable formal statements, is critical for using formal mathematical reasoning to solve math problems stated in natural language. While Large Language Models…

Computation and Language · Computer Science 2026-02-11 Guoxin Chen , Jing Wu , Xinjie Chen , Wayne Xin Zhao , Ruihua Song , Chengxi Li , Kai Fan , Dayiheng Liu , Minpeng Liao

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Numerous real-world decision-making problems can be formulated and solved using Mixed-Integer Linear Programming (MILP) models. However, the transformation of these problems into MILP models heavily relies on expertise in operations…

Optimization and Control · Mathematics 2023-11-28 Qingyang Li , Lele Zhang , Vicky Mak-Hau

Agent-based models (ABMs) are ubiquitous in research and industry. Currently, simulating ABMs involves at least some imperative (step-by-step) computer instructions. An alternative approach is declarative programming, in which a set of…

Multiagent Systems · Computer Science 2015-04-01 David Bruce Borenstein