English
Related papers

Related papers: Evaluation Agent: Efficient and Promptable Evaluat…

200 papers

We introduce PhysicalAgent, an agentic framework for robotic manipulation that integrates iterative reasoning, diffusion-based video generation, and closed-loop execution. Given a textual instruction, our method generates short video…

Visual content creation tasks demand a nuanced understanding of design conventions and creative workflows-capabilities challenging for general models, while workflow-based agents lack specialized knowledge for autonomous creative planning.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Jinxiang Lai , Zexin Lu , Jiajun He , Rongwei Quan , Wenzhe Zhao , Qinyu Yang , Qi Chen , Qin Lin , Chuyue Li , Tao Gao , Yuhao Shan , Shuai Shao , Song Guo , Qinglin Lu

Video generation has achieved remarkable progress, with generated videos increasingly resembling real ones. However, the rapid advance in generation has outpaced the development of adequate evaluation metrics. Currently, the assessment of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Nabyl Quignon , Baptiste Chopin , Yaohui Wang , Antitza Dantcheva

Hundreds of benchmarks dedicated to evaluating large models have been presented over the past few years. However, most of them remain closed-ended and are prone to overfitting due to the potential data contamination. Moreover, the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Zijian Chen , Yuze Sun , Yuan Tian , Wenjun Zhang , Guangtao Zhai

Retrieval-augmented generation (RAG) systems improve large language model outputs by incorporating external knowledge, enabling more informed and context-aware responses. However, the effectiveness and trustworthiness of these systems…

Computation and Language · Computer Science 2025-08-27 Ilias Driouich , Hongliu Cao , Eoin Thomas

The notable gap between user-provided and model-preferred prompts poses a significant challenge for generating high-quality images with text-to-image models, compelling the need for prompt engineering. Current studies on prompt engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shiyu Wu , Mingzhen Sun , Weining Wang , Yequan Wang , Jing Liu

While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations remains limited. Most…

Artificial Intelligence · Computer Science 2025-05-29 Haonian Ji , Shi Qiu , Siyang Xin , Siwei Han , Zhaorun Chen , Dake Zhang , Hongyi Wang , Huaxiu Yao

We introduce an autonomous multiagent framework for mechanistic interpretability that automates both explaining and finding internal features in large language models. The system runs two coupled loops: (1) explanation refinement, where an…

Computation and Language · Computer Science 2026-05-05 Arnau Marin-Llobet , Javier Ferrando

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Generative AI has made remarkable strides to revolutionize fields such as image and video generation. These advancements are driven by innovative algorithms, architecture, and data. However, the rapid proliferation of generative models has…

Artificial Intelligence · Computer Science 2024-11-12 Dongfu Jiang , Max Ku , Tianle Li , Yuansheng Ni , Shizhuo Sun , Rongqi Fan , Wenhu Chen

With the growing popularity of generative AI for images, video, and music, we witnessed models rapidly improve in quality and performance. However, not much attention is paid towards enabling AI's ability to "be creative". In this study, we…

Multiagent Systems · Computer Science 2025-09-10 Naomi Imasato , Kazuki Miyazawa , Takayuki Nagai , Takato Horii

Video generation has achieved remarkable progress with the introduction of diffusion models, which have significantly improved the quality of generated videos. However, recent research has primarily focused on scaling up model training,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Chenyang Si , Weichen Fan , Zhengyao Lv , Ziqi Huang , Yu Qiao , Ziwei Liu

Realistic fine-grained multi-agent simulation of real-world complex systems is crucial for many downstream tasks such as reinforcement learning. Recent work has used generative models (GANs in particular) for providing high-fidelity…

Machine Learning · Computer Science 2022-02-25 Changyu Chen , Avinandan Bose , Shih-Fen Cheng , Arunesh Sinha

With the advent of generative AI and large language models, embodied conversational agents are becoming synonymous with online interactions. These agents possess vast amounts of knowledge but suffer from exhibiting limited emotional…

Human-Computer Interaction · Computer Science 2026-02-27 Abhishek Kulkarni , Alexander Barquero , Pavitra Lahari , Aryaan Shaikh , Sarah Brown

Large Language Model (LLM)-based recommendation systems have demonstrated remarkable capabilities in understanding user preferences and generating personalized suggestions. However, existing approaches face critical challenges in…

Information Retrieval · Computer Science 2026-04-24 Sushant Mehta

Understanding how helpful a visualization is from experimental results is difficult because the observed performance is confounded with aspects of the study design, such as how useful the information that is visualized is for the task. We…

Human-Computer Interaction · Computer Science 2023-08-21 Yifan Wu , Ziyang Guo , Michails Mamakos , Jason Hartline , Jessica Hullman

Building and deploying machine learning solutions in healthcare remains expensive and labor-intensive due to fragmented preprocessing workflows, model compatibility issues, and stringent data privacy constraints. In this work, we introduce…

Artificial Intelligence · Computer Science 2025-07-25 Soorya Ram Shimgekar , Shayan Vassef , Abhay Goyal , Navin Kumar , Koustuv Saha

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

Generative Agents, owing to their precise modeling and simulation capabilities of human behavior, have become a pivotal tool in the field of Artificial Intelligence in Education (AIEd) for uncovering complex cognitive processes of learners.…

Artificial Intelligence · Computer Science 2026-05-11 Wei Zhang , Yihang Cheng , Zhirong Ye , Kezhen Huang

When agents interact with a complex environment, they must form and maintain beliefs about the relevant aspects of that environment. We propose a way to efficiently train expressive generative models in complex environments. We show that a…

Machine Learning · Computer Science 2019-06-25 Karol Gregor , Danilo Jimenez Rezende , Frederic Besse , Yan Wu , Hamza Merzic , Aaron van den Oord