English
Related papers

Related papers: DynaSchedBench: Calibrated Dynamic Scheduling Benc…

200 papers

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

Static benchmarks for harmful content detection face limitations in scalability and diversity, and may also be affected by contamination from web-scale pre-training corpora. To address these issues, we propose a framework for synthesizing…

Computation and Language · Computer Science 2026-04-21 Huije Lee , Jisu Shin , Hoyun Song , Changgeon Ko , Jong C. Park

We introduce SpreadsheetBench, a challenging spreadsheet manipulation benchmark exclusively derived from real-world scenarios, designed to immerse current large language models (LLMs) in the actual workflow of spreadsheet users. Unlike…

Computation and Language · Computer Science 2024-10-18 Zeyao Ma , Bohan Zhang , Jing Zhang , Jifan Yu , Xiaokang Zhang , Xiaohan Zhang , Sijia Luo , Xi Wang , Jie Tang

Dynamic optimization problems involving discrete decisions have several applications, yet lead to challenging optimization problems that must be addressed efficiently. Combining discrete variables with potentially nonlinear constraints…

Optimization and Control · Mathematics 2024-09-17 Zedong Peng , Albert Lee , David E. Bernal Neira

We present a hybrid optimization framework for a class of problems, formalized as a generalization of the Continuous Energy-Con\-strained Scheduling Problem (CECSP), introduced by Nattaf et al. (2014). This class is obtained from challenges…

Optimization and Control · Mathematics 2024-03-06 Roel Brouwer , Marjan van den Akker , Han Hoogeveen

Many scientific applications consist of large and computationally-intensive loops. Dynamic loop self-scheduling (DLS) techniques are used to parallelize and to balance the load during the execution of such applications. Load imbalance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-05 Ali Mohammed , Florina M. Ciorba

Flexible job shop scheduling has been noticed as an effective manufacturing system to cope with rapid development in today's competitive environment. Flexible job shop scheduling problem (FJSSP) is known as a NP-hard problem in the field of…

Optimization and Control · Mathematics 2012-07-11 Sayedmohammadreza Vaghefinezhad , Kuan Yew Wong

Generating SQLs from user queries is a long-standing challenge, where the accuracy of initial schema linking significantly impacts subsequent SQL generation performance. However, current schema linking models still struggle with missing…

Computation and Language · Computer Science 2026-04-23 Zheng Yuan , Hao Chen , Zijin Hong , Qinggang Zhang , Feiran Huang , Qing Li , Xiao Huang

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

The rapid evolution of neural architectures - from multilayer perceptrons to large-scale Transformer-based models - has enabled language models (LLMs) to exhibit emergent agentic behaviours when equipped with memory, planning, and external…

Artificial Intelligence · Computer Science 2025-09-22 Andrejs Sorstkins , Josh Bailey , Dr Alistair Baron

Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou , Shoujin Wang , Weizhi Zhang , Xu Cai , Sunghun Kim

Modern clinical practice relies on evidence-based guidelines implemented as compact scoring systems composed of a small number of interpretable decision rules. While machine-learning models achieve strong performance, many fail to translate…

Machine Learning · Computer Science 2026-05-25 Silas Ruhrberg Estévez , Christopher Chiu , Mihaela van der Schaar

Test-time scaling improves the inference performance of Large Language Models (LLMs) but also incurs substantial computational costs. Although recent studies have reduced token consumption through dynamic self-consistency, they remain…

Computation and Language · Computer Science 2026-01-22 Shiyu Ji , Yixuan Wang , Yijun Liu , Qingfu Zhu , Wanxiang Che

Existing benchmarks for tool-augmented language models (TaLMs) lack fine-grained control over task difficulty and remain vulnerable to data contamination. We present FuncBenchGen, a unified, contamination-free framework that evaluates TaLMs…

Computation and Language · Computer Science 2026-02-10 Seiji Maekawa , Jackson Hassell , Pouya Pezeshkpour , Tom Mitchell , Estevam Hruschka

Enhancing LLMs with the ability to actively search external knowledge is crucial for complex and real-world tasks. Current approaches either rely on prompting to elicit the model's innate agent capabilities, or suffer from performance…

Computation and Language · Computer Science 2026-03-20 Chenyang Gu , Yewen Pu , Bruce Yang , Xiaofan Li , Huan Gao

Inference-time steering is widely regarded as a lightweight and parameter-free mechanism for controlling large language model (LLM) behavior, and prior work has often suggested that simple activation-level interventions can reliably induce…

Artificial Intelligence · Computer Science 2026-03-20 Zikang Ding , Qiying Hu , Yi Zhang , Hongji Li , Junchi Yao , Hongbo Liu , Lijie Hu

LLM benchmarks are increasingly dynamic: instead of containing a fixed set of questions, they define templates and parameters that can generate an effectively unlimited number of question variants. This flexibility is valuable, but it makes…

Computation and Language · Computer Science 2026-04-21 Taylor Lundy , Narun K. Raman , Kevin Leyton-Brown

Generating plans of action, and reasoning about change have long been considered a core competence of intelligent agents. It is thus no surprise that evaluating the planning and reasoning capabilities of large language models (LLMs) has…

Computation and Language · Computer Science 2023-11-28 Karthik Valmeekam , Matthew Marquez , Alberto Olmo , Sarath Sreedharan , Subbarao Kambhampati

Most existing spatial reasoning benchmarks focus on static or globally observable environments, failing to capture the challenges of long-horizon reasoning and memory utilization under partial observability and dynamic changes. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Pukun Zhao , Longxiang Wang , Miaowei Wang , Chen Chen , Fanqing Zhou , Haojian Huang

Autonomous coding agents can produce strong tabular baselines quickly on Kaggle-style tasks. Practical value depends on end-to-end correctness and reliability under time limits. This paper introduces TML-Bench, a tabular benchmark for data…

Machine Learning · Computer Science 2026-03-09 Mykola Pinchuk