English
Related papers

Related papers: EVE: A Generator-Verifier System for Generative Po…

200 papers

Evolutionary model merging provides a powerful framework for the automated, training-free composition of LLMs through parameter-space search. However, existing methods predominantly rely on stochastic, hand-crafted operators that overlook…

Neural and Evolutionary Computing · Computer Science 2026-05-29 Tao Jiang , Xinmeng Yu , Chenhao Yi , Yiling Wu , Yan Li , Ran Cheng , Dongmei Jiang , Jianguo Zhang

Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-level semantic focus…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Ruowen Zhao , Bangguo Li , Zuyan Liu , Yinan Liang , Junliang Ye , Fangfu Liu , Diankun Wu , Zhengyi Wang , Xumin Yu , Yongming Rao , Han Hu , Jun Zhu

Multimodal vision language models (VLMs) have made significant progress with the support of continuously increasing model sizes and data volumes. Running VLMs on edge devices has become a challenge for their widespread application. There…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Miao Rang , Zhenni Bi , Chuanjian Liu , Yehui Tang , Kai Han , Yunhe Wang

Retrieval-Augmented Generation (RAG) systems typically face constraints because of their inherent mechanism: a simple top-k semantic search [1]. The approach often leads to the incorporation of irrelevant or redundant information in the…

Computation and Language · Computer Science 2025-09-03 Andreas Ottem

Reinforcement Learning methods are capable of solving complex problems, but resulting policies might perform poorly in environments that are even slightly different. In robotics especially, training and deployment conditions often vary and…

Machine Learning · Computer Science 2018-09-17 Isac Arnekvist , Danica Kragic , Johannes A. Stork

Exploration is essential for general-purpose robotic learning, especially in open-ended environments where dense rewards, explicit goals, or task-specific supervision are scarce. Vision-language models (VLMs), with their semantic reasoning…

Robotics · Computer Science 2025-09-12 Seungjae Lee , Daniel Ekpo , Haowen Liu , Furong Huang , Abhinav Shrivastava , Jia-Bin Huang

Autonomous driving necessitates the ability to reason about future interactions between traffic agents and to make informed evaluations for planning. This paper introduces the \textit{Gen-Drive} framework, which shifts from the traditional…

Robotics · Computer Science 2024-10-10 Zhiyu Huang , Xinshuo Weng , Maximilian Igl , Yuxiao Chen , Yulong Cao , Boris Ivanovic , Marco Pavone , Chen Lv

The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for…

Human-Computer Interaction · Computer Science 2024-02-06 Luca Podo , Muhammad Ishmal , Marco Angelini

Pre-trained Vision-Language Models (VLMs) have been exploited in various Computer Vision tasks (e.g., few-shot recognition) via model adaptation, such as prompt tuning and adapters. However, existing adaptation methods are designed by human…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kun Ding , Ying Wang , Shiming Xiang

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a…

Artificial Intelligence · Computer Science 2026-03-26 Bingqing Wei , Zhongyu Xia , Dingai Liu , Xiaoyu Zhou , Zhiwei Lin , Yongtao Wang

Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the…

Machine Learning · Computer Science 2025-02-25 Lunjun Zhang , Arian Hosseini , Hritik Bansal , Mehran Kazemi , Aviral Kumar , Rishabh Agarwal

Fact verification (FV) is a challenging task which aims to verify a claim using multiple evidential sentences from trustworthy corpora, e.g., Wikipedia. Most existing approaches follow a three-step pipeline framework, including document…

Computation and Language · Computer Science 2022-04-25 Jiangui Chen , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

Due to the textual and repetitive nature of many Requirements Engineering (RE) artefacts, Large Language Models (LLMs) have proven useful to automate their generation and processing. In this paper, we discuss a possible approach for…

Software Engineering · Computer Science 2026-04-27 Anna Arnaudo , Riccardo Coppola , Maurizio Morisio , Flavio Giobergia , Andrea Bioddo , Angelo Bongiorno , Luca Dadone

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and evolution remain largely underexplored. Existing evaluations…

Recent advances in zero-shot learning (ZSL) have demonstrated the potential of generative models. Typically, generative ZSL synthesizes visual features conditioned on semantic prototypes to model the data distribution of unseen classes,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenjin Hou , Xiaoxiao Sun , Hehe Fan

Vision-language models (VLMs) have demonstrated strong applicability in edge industrial applications, yet their deployment remains severely constrained by requirements for deterministic low latency and stable execution under resource…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Mengling Deng , Yuanpeng Chen , Sheng Yang , Wei Tao , Wenhai Zhang , Hui Song , Linyuanhao Qin , Kai Zhao , Xiaojun Ye , Shanhui Mo , Jingli Fan , Shuang Zhang , Bei Liu , Tiankun Zhao , Xiangjing An

Reinforcement Learning (RL) agents often struggle to generalize knowledge to new tasks, even those structurally similar to ones they have mastered. Although recent approaches have attempted to mitigate this issue via zero-shot transfer,…

Artificial Intelligence · Computer Science 2026-04-13 Ajsal Shereef Palattuparambil , Thommen George Karimpanal , Santu Rana

Generating simulations to train intelligent agents in game-playing and robotics from natural language input, from user input or task documentation, remains an open-ended challenge. Existing approaches focus on parts of this challenge, such…

Artificial Intelligence · Computer Science 2024-11-12 Fan-Yun Sun , S. I. Harini , Angela Yi , Yihan Zhou , Alex Zook , Jonathan Tremblay , Logan Cross , Jiajun Wu , Nick Haber

In this paper, we propose a novel generative model that utilizes a conditional Energy-Based Model (EBM) for enhancing Variational Autoencoder (VAE), termed Energy-Calibrated VAE (EC-VAE). Specifically, VAEs often suffer from blurry…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yihong Luo , Siya Qiu , Xingjian Tao , Yujun Cai , Jing Tang