English
Related papers

Related papers: QUBE: Enhancing Automatic Heuristic Design via Qua…

200 papers

Automatically resolving software issues is crucial for software development in practice, impacting the software quality and user experience. The process of resolving real-world issues encompasses tasks such as question-answering (QA), fault…

Software Engineering · Computer Science 2024-11-28 Ruida Hu , Chao Peng , Jingyi Ren , Bo Jiang , Xiangxin Meng , Qinyun Wu , Pengfei Gao , Xinchen Wang , Cuiyun Gao

With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Manon Flageat , Bryan Lim , Antoine Cully

Large Language Models (LLMs) have become increasingly pervasive, finding applications across many industries and disciplines. Ensuring the trustworthiness of LLM outputs is paramount, where Uncertainty Estimation (UE) plays a key role. In…

Computation and Language · Computer Science 2025-11-06 Kevin Wang , Subre Abdoul Moktar , Jia Li , Kangshuo Li , Feng Chen

Requirements engineering (RE) is critical to software success, yet automating it remains challenging because multiple, often conflicting quality attributes must be balanced while preserving stakeholder intent. Existing Large-Language-Model…

Software Engineering · Computer Science 2026-03-13 Haowei Cheng , Milhan Kim , Foutse Khomh , Teeradaj Racharak , Nobukazu Yoshioka , Naoyasu Ubayashi , Hironori Washizaki

LLM benchmarks are increasingly dynamic: instead of containing a fixed set of questions, they define templates and parameters that can generate an effectively unlimited number of question variants. This flexibility is valuable, but it makes…

Computation and Language · Computer Science 2026-04-21 Taylor Lundy , Narun K. Raman , Kevin Leyton-Brown

Large Language Models (LLMs) are increasingly assisting users in the real world, yet their reliability remains a concern. Uncertainty quantification (UQ) has been heralded as a tool to enhance human-LLM collaboration by enabling users to…

Computation and Language · Computer Science 2025-06-10 Siddartha Devic , Tejas Srinivasan , Jesse Thomason , Willie Neiswanger , Vatsal Sharan

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and…

Machine Learning · Computer Science 2025-06-04 Shubhendu Trivedi , Brian D. Nord

Reward models are central to aligning large language models (LLMs) with human preferences. Yet most approaches rely on pointwise reward estimates that overlook the epistemic uncertainty in reward models arising from limited human feedback.…

Machine Learning · Computer Science 2026-03-02 Daniel Yang , Samuel Stante , Florian Redhardt , Lena Libon , Parnian Kassraie , Ido Hakimi , Barna Pásztor , Andreas Krause

Neural Networks have become one of the most successful universal machine learning algorithms. They play a key role in enabling machine vision and speech recognition for example. Their computational complexity is enormous and comes along…

Hardware Architecture · Computer Science 2019-11-19 Michaela Blott , Lisa Halder , Miriam Leeser , Linda Doyle

Large language models (LLMs) are increasingly deployed on edge devices under strict computation and quantization constraints, yet their security implications remain unclear. We study query-based knowledge extraction from quantized…

Cryptography and Security · Computer Science 2026-03-26 Ao Ding , Hongzong Li , Zi Liang , Zhanpeng Shi , Shuxin Zhuang , Shiqin Tang , Rong Feng , Ping Lu

This review is designed to introduce mathematicians and computational scientists to quantum computing (QC) through the lens of uncertainty quantification (UQ) by presenting a mathematically rigorous and accessible narrative for…

Quantum Physics · Physics 2026-03-30 Ryan Bennink , Olena Burkovska , Konstantin Pieper , Jorge Ramirez , Elaine Wong

In creative design, where aesthetics play a crucial role in determining the quality of outcomes, there are often multiple worthwhile possibilities, rather than a single ``best'' design. This challenge is compounded in the use of…

Neural and Evolutionary Computing · Computer Science 2023-05-09 Jon McCormack , Camilo Cruz Gambardella , Stephen James Krol

Large language models (LLMs) demonstrate advanced reasoning abilities, enabling robots to understand natural language instructions and generate high-level plans with appropriate grounding. However, LLM hallucinations present a significant…

Robotics · Computer Science 2025-10-10 Shiyuan Yin , Chenjia Bai , Zihao Zhang , Junwei Jin , Xinxin Zhang , Chi Zhang , Xuelong Li

Uncertainty Quantification (UQ) is crucial for ensuring the reliability of machine learning models deployed in real-world autonomous systems. However, existing approaches typically quantify task-level output prediction uncertainty without…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Luke Chen , Junyao Wang , Trier Mortlock , Pramod Khargonekar , Mohammad Abdullah Al Faruque

As large language models (LLMs) are increasingly deployed in high-stakes applications, robust uncertainty estimation is essential for ensuring the safe and trustworthy deployment of LLMs. We present the most comprehensive study to date of…

Computation and Language · Computer Science 2025-06-02 Linwei Tao , Yi-Fan Yeh , Minjing Dong , Tao Huang , Philip Torr , Chang Xu

Quantum embedding is a fundamental prerequisite for applying quantum machine learning techniques to classical data, and has substantial impacts on performance outcomes. In this study, we present Neural Quantum Embedding (NQE), a method that…

Quantum Physics · Physics 2024-08-12 Tak Hur , Israel F. Araujo , Daniel K. Park

Heuristic algorithms have shown a good ability to solve a variety of optimization problems. Stockpile blending problem as an important component of the mine scheduling problem is an optimization problem with continuous search space…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Yue Xie , Aneta Neumann , Frank Neumann

Quantum annealing offers a promising paradigm for solving NP-hard combinatorial optimization problems, but its practical application is severely hindered by two challenges: the complex, manual process of translating problem descriptions…

Machine Learning · Computer Science 2025-09-03 Huixiang Zhang , Mahzabeen Emu , Salimur Choudhury

Quality Estimation (QE) models have the potential to change how we evaluate and maybe even train machine translation models. However, these models still lack the robustness to achieve general adoption. We show that State-of-the-art QE…

Computation and Language · Computer Science 2022-03-17 Muhammed Yusuf Kocyigit , Jiho Lee , Derry Wijaya

Previous studies in quantum information have recognized that specific types of noise can encode information in certain applications. However, the role of noise in Quantum Hypothesis Testing (QHT), traditionally assumed to undermine…

Quantum Physics · Physics 2024-08-06 Qing Li , Lingna Wang , Min Jiang , Ze Wu , Haidong Yuan , Xinhua Peng