English
Related papers

Related papers: Effective Harness Engineering for Algorithm Discov…

200 papers

The rapid advancement of large language models (LLMs) has significantly improved code completion tasks, yet the trade-off between accuracy and computational cost remains a critical challenge. While using larger models and incorporating…

Software Engineering · Computer Science 2025-02-17 Boyuan Chen , Mingzhi Zhu , Brendan Dolan-Gavitt , Muhammad Shafique , Siddharth Garg

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies largely focus on…

Software Engineering · Computer Science 2025-11-04 Zhuowen Yin , Cuifeng Gao , Chunsong Fan , Wenzhang Yang , Yinxing Xue , Lijun Zhang

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Embedding representation learning via neural networks is at the core foundation of modern similarity based search. While much effort has been put in developing algorithms for learning binary hamming code representations for search…

Machine Learning · Computer Science 2018-06-13 Yeonwoo Jeong , Hyun Oh Song

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

Cryptography and Security · Computer Science 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Large Language Models (LLMs) and other large foundation models have achieved noteworthy success, but their size exacerbates existing resource consumption and latency challenges. In particular, the large-scale deployment of these models is…

Machine Learning · Computer Science 2023-08-30 Banghua Zhu , Ying Sheng , Lianmin Zheng , Clark Barrett , Michael I. Jordan , Jiantao Jiao

Retrieval-augmented code generation often conditions the decoder on large retrieved code snippets. This ties online inference cost to repository size and introduces noise from long contexts. We present Hierarchical Embedding Fusion (HEF), a…

Computation and Language · Computer Science 2026-03-10 Nikita Sorokin , Ivan Sedykh , Valentin Malykh

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

Entity Resolution (ER) is a critical task for data integration, yet state-of-the-art supervised deep learning models remain impractical for many real-world applications due to their need for massive, expensive-to-obtain labeled datasets.…

Databases · Computer Science 2026-01-29 Dimitrios Karapiperis , Leonidas Akritidis , Panayiotis Bozanis , Vassilios Verykios

Create an idea, prototype it, evaluate if users like it, then learn. It is the circle of business. If AI can operate in all parts of the circle, it will enable rapid iteration and learning speeds for businesses. Experiment platforms that…

Software Engineering · Computer Science 2026-04-28 Jeffrey Wong , Antoine Creux

Supervised cross-modal hashing has gained increasing research interest on large-scale retrieval task owning to its satisfactory performance and efficiency. However, it still has some challenging issues to be further studied: 1) most of them…

Machine Learning · Computer Science 2019-05-07 Tao Yao , Xiangwei Kong , Lianshan Yan , Wenjing Tang , Qi Tian

One of the most striking findings in modern research on large language models (LLMs) is that scaling up compute during training leads to better results. However, less attention has been given to the benefits of scaling compute during…

Computation and Language · Computer Science 2024-11-21 Sean Welleck , Amanda Bertsch , Matthew Finlayson , Hailey Schoelkopf , Alex Xie , Graham Neubig , Ilia Kulikov , Zaid Harchaoui

Harnesses are now central to coding-agent performance, mediating how models interact with tools and execution environments. Yet harness engineering remains a manual craft, because automating it faces a heterogeneous action space across…

Computation and Language · Computer Science 2026-05-19 Jiahang Lin , Shichun Liu , Chengjun Pan , Lizhi Lin , Shihan Dou , Zhiheng Xi , Xuanjing Huang , Hang Yan , Zhenhua Han , Tao Gui , Yu-Gang Jiang

While large language models (LLMs) demonstrate emerging reasoning capabilities, current inference-time expansion methods incur prohibitive computational costs by exhaustive sampling. Through analyzing decoding trajectories, we observe that…

Artificial Intelligence · Computer Science 2026-02-03 Ziheng Li , Hengyi Cai , Xiaochi Wei , Yuchen Li , Shuaiqiang Wang , Zhi-Hong Deng , Dawei Yin

With the explosive growth of users and items, Recommender Systems are facing unprecedented challenges in terms of retrieval efficiency and storage overhead. Learning to Hash techniques have emerged as a promising solution to these issues by…

Information Retrieval · Computer Science 2025-10-24 Fangyuan Luo , Yankai Chen , Jun Wu , Tong Li , Philip S. Yu , Xue Liu

Large language model (LLM) agents have demonstrated strong capabilities across diverse domains, yet automated agent design remains a significant challenge. Current automated agent design approaches are often constrained by limited search…

Computation and Language · Computer Science 2025-11-21 Yu Li , Lehui Li , Zhihao Wu , Qingmin Liao , Jianye Hao , Kun Shao , Fengli Xu , Yong Li

How data is represented and operationalized is critical for building computational solutions that are both effective and efficient. A common approach is to represent data objects as binary vectors, denoted \textit{hash codes}, which require…

Information Retrieval · Computer Science 2021-09-07 Casper Hansen

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang

Agent harness evolution improves frozen language-model agents by modifying the executable structures around them. We study this paradigm as a form of sample-efficient fast adaptation: instead of updating model weights, an agent can acquire…

Artificial Intelligence · Computer Science 2026-05-26 Lirong Che , Yuzhe yang , Peiwen lin , Chuang wang , Xueqian wang , Jian su

Algorithms are the engine for reproducible problem-solving. We present a framework automating algorithm discovery by conceptualizing them as sequences of operations, represented as tokens. These computational tokens are chained using a…

Artificial Intelligence · Computer Science 2025-07-14 Theo Bourdais , Abeynaya Gnanasekaran , Houman Owhadi , Tuhin Sahai