English
Related papers

Related papers: Evaluation Agent: Efficient and Promptable Evaluat…

200 papers

Estimating causal effects from observational data (at either an individual -- or a population -- level) is critical for making many types of decisions. One approach to address this task is to learn decomposed representations of the…

Machine Learning · Computer Science 2021-11-15 Negar Hassanpour , Russell Greiner

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

The application of advanced generative artificial intelligence in education is often constrained by the lack of real-time adaptability, personalization, and reliability of the content. To address these challenges, we propose ExpertAgent -…

Artificial Intelligence · Computer Science 2025-10-10 Binrong Zhu , Guiran Liu , Nina Jiang

Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely…

Artificial Intelligence · Computer Science 2025-12-30 Mengkang Hu , Bowei Xia , Yuran Wu , Ailing Yu , Yude Zou , Qiguang Chen , Shijian Wang , Jiarui Jin , Kexin Li , Wenxiang Jiao , Yuan Lu , Ping Luo

We introduce the concept of "Design Agents" for engineering applications, particularly focusing on the automotive design process, while emphasizing that our approach can be readily extended to other engineering and design domains. Our…

Artificial Intelligence · Computer Science 2025-12-04 Mohamed Elrefaie , Janet Qian , Raina Wu , Qian Chen , Angela Dai , Faez Ahmed

This paper presents a novel generative model, Collaborative Competitive Agents (CCA), which leverages the capabilities of multiple Large Language Models (LLMs) based agents to execute complex tasks. Drawing inspiration from Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Tiankai Hang , Shuyang Gu , Dong Chen , Xin Geng , Baining Guo

Agent applications are increasingly adopted to automate workflows across diverse tasks. However, due to the heterogeneous domains they operate in, it is challenging to create a scalable evaluation framework. Prior works each employ their…

Artificial Intelligence · Computer Science 2026-03-17 Penny Chong , Harshavardhan Abichandani , Jiyuan Shen , Atin Ghosh , Min Pyae Moe , Yifan Mai , Daniel Dahlmeier

Recent progress in generative models has stimulated significant innovations in many fields, such as image generation and chatbots. Despite their success, these models often produce sketchy and misleading solutions for complex multi-agent…

Artificial Intelligence · Computer Science 2024-10-04 Zeyang Liu , Xinrui Yang , Shiguang Sun , Long Qian , Lipeng Wan , Xingyu Chen , Xuguang Lan

Across domains, metrics and measurements are fundamental to identifying challenges, informing decisions, and resolving conflicts. Despite the abundance of data available in this information age, not only can it be challenging for a single…

Software Engineering · Computer Science 2024-10-02 Ti-Chung Cheng , Carmen Badea , Christian Bird , Thomas Zimmermann , Robert DeLine , Nicole Forsgren , Denae Ford

Adapting production-level computer vision tools to bespoke scientific datasets is a critical "last mile" bottleneck. Current solutions are impractical: fine-tuning requires large annotated datasets scientists often lack, while manual code…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuefei , Wang , Kai A. Horstmann , Ethan Lin , Jonathan Chen , Alexander R. Farhang , Sophia Stiles , Atharva Sehgal , Jonathan Light , David Van Valen , Yisong Yue , Jennifer J. Sun

Preparing high-quality instructional materials remains a labor-intensive process that often requires extensive coordination among teaching faculty, instructional designers, and teaching assistants. In this work, we present Instructional…

Artificial Intelligence · Computer Science 2026-02-03 Huaiyuan Yao , Wanpeng Xu , Justin Turnau , Nadia Kellam , Hua Wei

Long video understanding (LVU) is challenging because answering real-world queries often depends on sparse, temporally dispersed cues buried in hours of mostly redundant and irrelevant content. While agentic pipelines improve video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Ziyang Wang , Honglu Zhou , Shijie Wang , Junnan Li , Caiming Xiong , Silvio Savarese , Mohit Bansal , Michael S. Ryoo , Juan Carlos Niebles

Large language models (LLMs) are increasingly deployed as customer-facing agents, yet evaluating their reliability remains challenging due to stochastic, multi-turn interactions. Current evaluation protocols rely on linear Monte Carlo…

Artificial Intelligence · Computer Science 2026-04-24 Itay Nakash , George Kour , Ateret Anaby-Tavor

Recently, the growing capabilities of deep generative models have underscored their potential in enhancing image classification accuracy. However, existing methods often demand the generation of a disproportionately large number of images…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Tao Huang , Jiaqi Liu , Shan You , Chang Xu

Generating natural language explanations for recommendations has become increasingly important in recommender systems. Traditional approaches typically treat user reviews as ground truth for explanations and focus on improving review…

Information Retrieval · Computer Science 2025-02-18 Jingsen Zhang , Zihang Tian , Xueyang Feng , Xu Chen

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models (VLMs). These agents make visual decisions at scale, deciding what to click, recommend, or buy. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Manuel Cherep , Pranav M R , Pattie Maes , Nikhil Singh

The dense, temporal nature of video presents a profound challenge for automated analysis. Despite the use of powerful Vision-Language Models, prevailing methods for video understanding are limited by the inherent disconnect between…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Keliang Li , Yansong Li , Hongze Shen , Mengdi Liu , Hong Chang , Shiguang Shan

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

Creators struggle to edit long-form, narrative-rich videos not because of UI complexity, but due to the cognitive demands of searching, storyboarding, and sequencing hours of footage. Existing transcript- or embedding-based methods fall…

Artificial Intelligence · Computer Science 2025-09-30 Zihan Ding , Xinyi Wang , Junlong Chen , Per Ola Kristensson , Junxiao Shen