English
Related papers

Related papers: PYTHALAB-MERA: Validation-Grounded Memory, Retriev…

200 papers

Recent advancements in artificial intelligence have sparked interest in industrial agents capable of supporting analysts in regulated sectors, such as finance and healthcare, within tabular data workflows. A key capability for such systems…

Artificial Intelligence · Computer Science 2026-05-26 Árpád Pándy , Róbert Lakatos , András Hajdu

The advent of large pre-trained language models in the domain of Code Synthesis has shown remarkable performance on various benchmarks, treating the problem of Code Generation in a fashion similar to Natural Language Generation, trained…

Machine Learning · Computer Science 2023-10-23 Philip John Gorinski , Matthieu Zimmer , Gerasimos Lampouras , Derrick Goh Xin Deik , Ignacio Iacobacci

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

Information Retrieval · Computer Science 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

Current techniques for post-training Large Language Models (LLMs) rely either on costly human supervision or on external verifiers to boost performance on tasks such as mathematical reasoning and code generation. However, as LLMs improve…

Computation and Language · Computer Science 2026-01-21 Mukesh Ghimire , Aosong Feng , Liwen You , Youzhi Luo , Fang Liu , Xuan Zhu

Reinforcement learning with verifiable rewards (RLVR) is a practical, scalable way to improve large language models on math, code, and other structured tasks. However, we argue that many headline RLVR gains are not yet well validated…

Autonomous-driving research has recently embraced deep Reinforcement Learning (RL) as a promising framework for data-driven decision making, yet a clear picture of how these algorithms are currently employed, benchmarked and evaluated is…

Robotics · Computer Science 2025-09-11 Elahe Delavari , Feeza Khan Khanzada , Jaerock Kwon

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of NLP tasks, but they remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. Recent efforts to…

Large Language Models (LLMs) must continuously learn and update knowledge to remain effective in dynamic real-world environments. While Low-Rank Adaptation (LoRA) is widely used for such memory updates, existing studies mainly rely on…

Computation and Language · Computer Science 2026-05-29 Ziwen Xu , Haiwen Hong , Linsong Yu , Benglei Cui , Longtao Huang , Hui Xue , Ningyu Zhang

Programming is a core skill in computer science and software engineering (SE), yet identifying and resolving code errors remains challenging for both novice and experienced developers. While Large Language Models (LLMs) have shown…

Software Engineering · Computer Science 2026-03-27 Md Faizul Ibne Amin , Yutaka Watanobe , Md. Mostafizer Rahman , Daniel M. Muepu , Md. Shahajada Mia

Code generation with large language models often relies on multi-stage human-in-the-loop refinement, which is effective but very costly - particularly in domains such as frontend web development where the solution quality depends on…

Artificial Intelligence · Computer Science 2026-04-08 Hannah Sansford , Derek H. C. Law , Wei Liu , Abhishek Tripathi , Niresh Agarwal , Gerrit J. J. van den Burg

In CAS adaptation, a challenge is to define the dynamic architecture of the system and changes in its behavior. Implementation-wise, this is projected into an adaptation mechanism, typically realized as an Adaptation Manager (AM). With the…

Artificial Intelligence · Computer Science 2026-02-24 Michal Töpfer , František Plášil , Tomáš Bureš , Petr Hnětynka

This paper presents a model-free reinforcement learning (RL) algorithm to synthesize a control policy that maximizes the satisfaction probability of linear temporal logic (LTL) specifications. Due to the consideration of environment and…

Formal Languages and Automata Theory · Computer Science 2022-01-04 Mingyu Cai , Shaoping Xiao , Baoluo Li , Zhiliang Li , Zhen Kan

Software testing plays a critical role in ensuring that systems behave as intended. However, existing automated testing approaches struggle to match the capabilities of human engineers due to key limitations such as test locality, lack of…

Software Engineering · Computer Science 2025-06-16 Kangping Xu , Yifan Luo , Yang Yuan , Andrew Chi-Chih Yao

We introduce a tool for rigorous and automated verification of large language model (LLM)- based policies in memoryless sequential decision-making tasks. Given a Markov decision process (MDP) representing the sequential decision-making…

Artificial Intelligence · Computer Science 2025-10-09 Dennis Gross , Helge Spieker , Arnaud Gotlieb

Reinforcement learning (RL) has demonstrated its capability in solving various tasks but is notorious for its low sample efficiency. In this paper, we propose RLingua, a framework that can leverage the internal knowledge of large language…

Robotics · Computer Science 2024-03-20 Liangliang Chen , Yutian Lei , Shiyu Jin , Ying Zhang , Liangjun Zhang

Many applications of large language models (LLMs) require deductive reasoning, yet models frequently produce incorrect or redundant inference steps. We frame natural language inference as a search problem where the final answer is the valid…

Artificial Intelligence · Computer Science 2026-05-26 Andreas Opedal , Francesco Ignazio Re , Abulhair Saparov , Mrinmaya Sachan , Bernhard Schölkopf , Ryan Cotterell

Program synthesis or code generation aims to generate a program that satisfies a problem specification. Recent approaches using large-scale pretrained language models (LMs) have shown promising results, yet they have some critical…

Machine Learning · Computer Science 2022-11-04 Hung Le , Yue Wang , Akhilesh Deepak Gotmare , Silvio Savarese , Steven C. H. Hoi

Modern enterprise retrieval systems must handle short, underspecified queries such as ``foreign transaction fee refund'' and ``recent check status''. In these cases, semantic nuance and metadata matter but per-query large language model…

Information Retrieval · Computer Science 2026-01-06 Satya Swaroop Gudipudi , Sahil Girhepuje , Ponnurangam Kumaraguru , Kristine Ma

Recent studies have explored integrating Large Language Models (LLMs) with search engines to leverage both the LLMs' internal pre-trained knowledge and external information. Specially, reinforcement learning (RL) has emerged as a promising…

Artificial Intelligence · Computer Science 2025-12-30 Lang Mei , Zhihan Yang , Xiaohan Yu , Huanyao Zhang , Chong Chen

Reinforcement Fine-Tuning (RFT) with verifiable rewards has advanced large language models but remains underexplored for Vision-Language (VL) models. The Vision-Language Reward Model (VL-RM) is key to aligning VL models by providing…

Computation and Language · Computer Science 2025-06-18 Jipeng Zhang , Kehao Miao , Renjie Pi , Zhaowei Wang , Runtao Liu , Rui Pan , Tong Zhang