English
Related papers

Related papers: Effective Harness Engineering for Algorithm Discov…

200 papers

Coding agents accumulate extensive context during long-running tasks, yet fixed context windows force practitioners to choose between truncation and task failure. While numerous memory condensation strategies have been proposed, from simple…

Machine Learning · Computer Science 2026-05-20 Renuka Chintalapati , Sid Raskar , Anurag Acharya , Jared Willard , Patrick Emami , Sameera Horawalavithana

We propose a novel model for learned query optimization which provides query hints leading to better execution plans. The model addresses the three key challenges in learned hint-based query optimization: reliable hint recommendation…

Databases · Computer Science 2024-12-06 Sergey Zinchenko , Sergey Iazov

Evolutionary agentic systems intensify the trade-off between computational efficiency and reasoning capability by repeatedly invoking large language models (LLMs) during inference. This setting raises a central question: how can an agent…

Computation and Language · Computer Science 2026-04-27 Pretam Ray , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Deep supervised hashing is essential for efficient storage and search in large-scale image retrieval. Traditional deep supervised hashing models generate single-length hash codes, but this creates a trade-off between efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Liyang He , Yuren Zhang , Rui Li , Zhenya Huang , Runze Wu , Enhong Chen

Finding a maximum-weight matching is a classical and well-studied problem in computer science, solvable in cubic time in general graphs. We consider the specialization called assignment problem where the input is a bipartite graph, and…

Data Structures and Algorithms · Computer Science 2024-10-15 Romaric Duvignau , Noël Gillet , Ralf Klasing

Sparse attention improves LLM inference efficiency by selecting a subset of key-value entries, but at the cost of potential accuracy degradation. In particular, omitting critical KV entries can induce substantial errors in model outputs.…

Machine Learning · Computer Science 2026-05-12 Mohsen Dehghankar , Abolfazl Asudeh

Among the most important properties of algorithms investigated in computer science are soundness, completeness, and complexity. These properties, however, are rarely analyzed for the vast collection of recently proposed methods for planning…

Artificial Intelligence · Computer Science 2026-01-23 Michael Katz , Harsha Kokel , Kavitha Srinivas , Shirin Sohrabi

We look at the long-standing problem of segmenting unlabeled speech into word-like segments and clustering these into a lexicon. Several previous methods use a scoring model coupled with dynamic programming to find an optimal segmentation.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Simon Malan , Benjamin van Niekerk , Herman Kamper

We introduce a learning-based framework to optimize tensor programs for deep learning workloads. Efficient implementations of tensor operators, such as matrix multiplication and high dimensional convolution, are key enablers of effective…

Machine Learning · Computer Science 2019-01-10 Tianqi Chen , Lianmin Zheng , Eddie Yan , Ziheng Jiang , Thierry Moreau , Luis Ceze , Carlos Guestrin , Arvind Krishnamurthy

In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addresses both single-device and distributed pipeline and tensor…

Hardware Architecture · Computer Science 2024-04-24 Muhammad Adnan , Amar Phanishayee , Janardhan Kulkarni , Prashant J. Nair , Divya Mahajan

Complex-Valued Neural Networks (CVNNs) have significant advantages in handling tasks that involve complex numbers. However, existing CVNNs are unable to quantify predictive uncertainty. We propose, for the first time, dropout-based Bayesian…

Hardware Architecture · Computer Science 2026-04-23 Zehuan Zhang , Mark Chen , He Li , Wayne Luk

Verifiers can improve language model capabilities by scoring and ranking responses from generated candidates. Currently, high-quality verifiers are either unscalable (e.g., humans) or limited in utility (e.g., tools like Lean). While LM…

Ensembling is commonly used in machine learning on tabular data to boost predictive performance and robustness, but larger ensembles often lead to increased hardware demand. We introduce HAPEns, a post-hoc ensembling method that explicitly…

Machine Learning · Computer Science 2026-03-12 Jannis Maier , Lennart Purucker

In the last decades, the capacity to generate large amounts of data in science and engineering applications has been growing steadily. Meanwhile, machine learning has progressed to become a suitable tool to process and utilise the available…

Machine Learning · Computer Science 2024-09-04 Alex Hernandez-Garcia , Nikita Saxena , Moksh Jain , Cheng-Hao Liu , Yoshua Bengio

Entity matching, a core data integration problem, is the task of deciding whether two data tuples refer to the same real-world entity. Recent advances in deep learning methods, using pre-trained language models, were proposed for resolving…

Databases · Computer Science 2023-11-28 Bar Genossar , Avigdor Gal , Roee Shraga

Reasoning is critical for large language models (LLMs) to excel in a wide range of tasks. While methods like Chain-of-Thought (CoT) reasoning and enhance LLM performance by decomposing problems into intermediate steps, they also incur…

Computation and Language · Computer Science 2025-06-03 Tingxu Han , Zhenting Wang , Chunrong Fang , Shiyu Zhao , Shiqing Ma , Zhenyu Chen

In this paper, we propose a simple and efficient method for value model training on long-context reasoning traces. Compared to existing process reward models (PRMs), our method does not require a fine-grained notion of "step," which is…

Machine Learning · Computer Science 2025-10-01 Kaiwen Wang , Jin Peng Zhou , Jonathan Chang , Zhaolin Gao , Nathan Kallus , Kianté Brantley , Wen Sun

Ensemble learning has been widely used in machine learning to improve model robustness, accuracy, and generalization, but has not yet been applied to code generation tasks with large language models (LLMs). We propose an ensemble approach…

Software Engineering · Computer Science 2025-07-22 Tarek Mahmud , Bin Duan , Corina Pasareanu , Guowei Yang

Designing the next generation colliders and detectors involves solving optimization problems in high-dimensional spaces where the optimal solutions may nest in regions that even a team of expert humans would not explore. Resorting to…

High Energy Physics - Experiment · Physics 2025-01-09 Pietro Vischia

Automated algorithm design is entering a new phase: Large Language Models can now generate full optimisation (meta)heuristics, explore vast design spaces and adapt through iterative feedback. Yet this rapid progress is largely…

Artificial Intelligence · Computer Science 2025-11-21 Niki van Stein , Anna V. Kononova , Thomas Bäck