English
Related papers

Related papers: EVE: A Generator-Verifier System for Generative Po…

200 papers

In robot manipulation, Reinforcement Learning (RL) often suffers from low sample efficiency and uncertain convergence, especially in large observation and action spaces. Foundation Models (FMs) offer an alternative, demonstrating promise in…

Robotics · Computer Science 2025-04-18 Runyu Ma , Jelle Luijkx , Zlatan Ajanovic , Jens Kober

Generative models have achieved state-of-the-art performance for the zero-shot learning problem, but they require re-training the classifier every time a new object category is encountered. The traditional semantic embedding approaches,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Ayyappa Kumar Pambala , Titir Dutta , Soma Biswas

Recent works have shown that Large Language Models (LLMs) could empower traditional neuro-symbolic models via programming capabilities to translate language into module descriptions, thus achieving strong visual reasoning results while…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Zhenfang Chen , Rui Sun , Wenjun Liu , Yining Hong , Chuang Gan

Language models (LMs) can solve tasks such as answering questions about tables or images by writing programs. However, using primitive functions often leads to verbose and error-prone programs, and higher-level functions require expert…

Artificial Intelligence · Computer Science 2024-01-24 Zhiruo Wang , Daniel Fried , Graham Neubig

Scaling test-time compute via parallel sampling can substantially improve LLM reasoning, but is often limited by Best-of-N selection quality. Generative selection methods, such as GenSelect, address this bottleneck, yet strong selection…

Imitation learning from human demonstrations has achieved significant success in robotic control, yet most visuomotor policies still condition on single-step observations or short-context histories, making them struggle with non-Markovian…

Robotics · Computer Science 2026-03-06 Yuheng Lei , Zhixuan Liang , Hongyuan Zhang , Ping Luo

We present a study on leveraging multilingual pre-trained generative language models for zero-shot cross-lingual event argument extraction (EAE). By formulating EAE as a language generation task, our method effectively encodes event…

Computation and Language · Computer Science 2022-03-17 Kuan-Hao Huang , I-Hung Hsu , Premkumar Natarajan , Kai-Wei Chang , Nanyun Peng

With the rapid development of embodied artificial intelligence, significant progress has been made in vision-language-action (VLA) models for general robot decision-making. However, the majority of existing VLAs fail to account for the…

Robotics · Computer Science 2025-02-17 Hongyin Zhang , Pengxiang Ding , Shangke Lyu , Ying Peng , Donglin Wang

As Vision Language Models (VLMs) become increasingly accessible to farmers and agricultural experts, there is a growing need to evaluate their potential in specialized tasks. We present AgEval, a comprehensive benchmark for assessing VLMs'…

Generative models, particularly diffusion models, have achieved remarkable success in density estimation for multimodal data, drawing significant interest from the reinforcement learning (RL) community, especially in policy modeling in…

Machine Learning · Computer Science 2024-12-03 Jinouwen Zhang , Rongkun Xue , Yazhe Niu , Yun Chen , Jing Yang , Hongsheng Li , Yu Liu

Deploying autonomous edge robotics in dynamic military environments is constrained by both scarce domain-specific training data and the computational limits of edge hardware. This paper introduces a hierarchical, zero-shot framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jesse Barkley , Abraham George , Amir Barati Farimani

Context: Software Vulnerability Assessment (SVA) plays a vital role in evaluating and ranking vulnerabilities in software systems to ensure their security and reliability. Objective: Although Large Language Models (LLMs) have recently shown…

Software Engineering · Computer Science 2025-11-24 Zhijie Chen , Xiang Chen , Ziming Li , Jiacheng Xue , Chaoyang Gao

We propose a Vision-Language Simulation Model (VLSM) that unifies visual and textual understanding to synthesize executable FlexScript from layout sketches and natural-language prompts, enabling cross-modal reasoning for industrial…

Artificial Intelligence · Computer Science 2026-01-14 YuChe Hsu , AnJui Wang , TsaiChing Ni , YuanFu Yang

Scaling test-time compute has emerged as a key strategy for enhancing the reasoning capabilities of large language models (LLMs), particularly in tasks like mathematical problem-solving. A traditional approach, Self-Consistency (SC),…

Computation and Language · Computer Science 2025-10-21 Nishad Singhi , Hritik Bansal , Arian Hosseini , Aditya Grover , Kai-Wei Chang , Marcus Rohrbach , Anna Rohrbach

As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While…

Software Engineering · Computer Science 2026-04-28 Yifan Zhang , Jianmin Ye , Jiahao Yang , Xi Wang

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

Robotics · Computer Science 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

Deep generative models have been successfully applied to Zero-Shot Learning (ZSL) recently. However, the underlying drawbacks of GANs and VAEs (e.g., the hardness of training with ZSL-oriented regularizers and the limited generation…

Machine Learning · Computer Science 2020-07-10 Yuming Shen , Jie Qin , Lei Huang

We present STORM (Search-Guided Generative World Models), a novel framework for spatio-temporal reasoning in robotic manipulation that unifies diffusion-based action generation, conditional video prediction, and search-based planning.…

Robotics · Computer Science 2025-12-23 Wenjun Lin , Jensen Zhang , Kaitong Cai , Keze Wang

Generating high-quality Scalable Vector Graphics (SVGs) from text remains a significant challenge. Existing LLM-based models that generate SVG code as a flat token sequence struggle with poor structural understanding and error accumulation,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Ximing Xing , Juncheng Hu , Ziteng Xue , Jing Zhang , Buyu Li , Sheng Wang , Dong Xu , Qian Yu