English
Related papers

Related papers: QUBE: Enhancing Automatic Heuristic Design via Qua…

200 papers

This paper investigates the problem of efficient constrained global optimization of hybrid models that are a composition of a known white-box function and an expensive multi-output black-box function subject to noisy observations, which…

Machine Learning · Statistics 2023-07-31 Congwen Lu , Joel A. Paulson

Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token…

Computation and Language · Computer Science 2025-12-10 Roman Vashurin , Maiya Goloburda , Albina Ilina , Aleksandr Rubashevskii , Preslav Nakov , Artem Shelmanov , Maxim Panov

Quality-Diversity (QD) algorithms are a new type of Evolutionary Algorithms (EAs), aiming to find a set of high-performing, yet diverse solutions. They have found many successful applications in reinforcement learning and robotics, helping…

Neural and Evolutionary Computing · Computer Science 2024-05-07 Chao Qian , Ke Xue , Ren-Jian Wang

Neural machine translation systems estimate probabilities of target sentences given source sentences, yet these estimates may not align with human preferences. This work introduces QE-fusion, a method that synthesizes translations using a…

Computation and Language · Computer Science 2024-06-07 Giorgos Vernikos , Andrei Popescu-Belis

Facilitated by the recent advances of Machine Learning (ML), the automated design of optimization heuristics is currently shaking up evolutionary computation (EC). Where the design of hand-picked guidelines for choosing a most suitable…

Neural and Evolutionary Computing · Computer Science 2022-12-08 Quentin Renau , Johann Dreo , Carola Doerr , Benjamin Doerr

Designing effective quantum circuits remains a central challenge in quantum computing, as circuit structure strongly influences expressivity, trainability, and hardware feasibility. Current approaches, whether using manually designed…

Neural and Evolutionary Computing · Computer Science 2026-02-04 Devroop Kar , Daniel Krutz , Travis Desell

Heuristics are commonly used to tackle various search and optimization problems. Design heuristics usually require tedious manual crafting with domain knowledge. Recent works have incorporated Large Language Models (LLMs) into automatic…

Artificial Intelligence · Computer Science 2025-02-05 Shunyu Yao , Fei Liu , Xi Lin , Zhichao Lu , Zhenkun Wang , Qingfu Zhang

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Uncertainty Quantification (UQ) is a promising approach to improve model reliability, yet quantifying the uncertainty of Large Language Models (LLMs) is non-trivial. In this work, we establish a connection between the uncertainty of LLMs…

Computation and Language · Computer Science 2025-10-16 Mingda Li , Xinyu Li , Weinan Zhang , Longxuan Ma

Quality Estimation (QE) is the task of predicting the quality of Machine Translation (MT) system output, without using any gold-standard translation references. State-of-the-art QE models are supervised: they require human-labeled quality…

Computation and Language · Computer Science 2023-07-14 Tu Anh Dinh , Jan Niehues

Generative video models demonstrate impressive text-to-video capabilities, spurring widespread adoption in many real-world applications. However, like large language models (LLMs), video generation models tend to hallucinate, producing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zhiting Mei , Ola Shorinwa , Anirudha Majumdar

Evolutionary search via the quality-diversity (QD) paradigm can discover highly performing solutions in different behavioural niches, showing considerable potential in complex real-world scenarios such as evolutionary robotics. Yet most QD…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Roberto Gallotta , Antonios Liapis , Georgios N. Yannakakis

Uncertainty quantification (UQ) is the process of systematically determining and characterizing the degree of confidence in computational model predictions. In the context of systems biology, especially with dynamic models, UQ is crucial…

Machine Learning · Statistics 2024-10-29 Alberto Portela , Julio R. Banga , Marcos Matabuena

Large Language Models (LLMs) have emerged as powerful operators for evolutionary search, yet the design of efficient search scaffolds remains ad hoc. While promising, current LLM-in-the-loop systems lack a systematic approach to managing…

High-dimensional portfolio optimization faces significant computational challenges under complex constraints, with traditional optimization methods struggling to balance convergence speed and global exploration capability. To address this,…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Mingyang Yu , Jiaqi Zhang , Haorui Yang , Adam Slowik , Jun Zhang , Jing Xu

Reliable uncertainty quantification (UQ) is essential for deploying large language models (LLMs) in safety-critical scenarios, as it enables them to abstain from responding when uncertain, thereby avoiding hallucinations, i.e., plausible…

Computation and Language · Computer Science 2026-02-09 Xingtao Zhao , Hao Peng , Dingli Su , Xianghua Zeng , Chunyang Liu , Jinzhi Liao , Philip S. Yu

Consistency-based methods have emerged as an effective approach to uncertainty quantification (UQ) in large language models. These methods typically rely on several generations obtained via multinomial sampling, measuring their agreement…

Translation Quality Evaluation (TQE) is an essential step of the modern translation production process. TQE is critical in assessing both machine translation (MT) and human translation (HT) quality without reference translations. The…

Computation and Language · Computer Science 2024-06-24 Serge Gladkoff , Lifeng Han , Gleb Erofeev , Irina Sorokina , Goran Nenadic

Scientific Artificial Intelligence (AI) applications require models that deliver trustworthy uncertainty estimates while respecting domain constraints. Existing uncertainty quantification methods lack mechanisms to incorporate symbolic…

Machine Learning · Computer Science 2026-01-21 Shahnawaz Alam , Mohammed Mudassir Uddin , Mohammed Kaif Pasha

Benchmarking in continuous black-box optimisation is hindered by the limited structural diversity of existing test suites such as BBOB. We explore whether large language models embedded in an evolutionary loop can be used to design…

Artificial Intelligence · Computer Science 2026-01-28 Urban Skvorc , Niki van Stein , Moritz Seiler , Britta Grimme , Thomas Bäck , Heike Trautmann