中文
相关论文

相关论文: TIP-Search: Time-Predictable Inference Scheduling …

200 篇论文

The Logical Execution Time (LET) programming model has recently received considerable attention, particularly because of its timing and dataflow determinism. In LET, task computation appears always to take the same amount of time (called…

系统与控制 · 电气工程与系统科学 2024-03-11 Sen Wang , Dong Li , Ashrarul H. Sifat , Shao-Yu Huang , Xuanliang Deng , Changhee Jung , Ryan Williams , Haibo Zeng

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

机器学习 · 计算机科学 2025-01-03 Rui Luo , Zhixin Zhou

Accurately estimating workload runtime is a longstanding goal in computer systems, and plays a key role in efficient resource provisioning, latency minimization, and various other system management tasks. Runtime prediction is particularly…

机器学习 · 计算机科学 2025-03-11 Tianshu Huang , Arjun Ramesh , Emily Ruppel , Nuno Pereira , Anthony Rowe , Carlee Joe-Wong

Multivariate time series forecasting plays a pivotal role in numerous real-world applications, including financial analysis, energy management, and traffic planning. While Transformer-based architectures have gained popularity for this…

机器学习 · 计算机科学 2026-05-01 Pourya Zamanvaziri , Amirhossein Sadr , Aida Pakniyat , Dara Rahmati

Intermittent demand forecasting is a ubiquitous and challenging problem in production systems and supply chain management. In recent years, there has been a growing focus on developing forecasting approaches for intermittent demand from…

应用统计 · 统计学 2022-09-01 Li Li , Yanfei Kang , Fotios Petropoulos , Feng Li

Robust planning in interactive scenarios requires predicting the uncertain future to make risk-aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under-estimated by finite-sampling approximations of…

机器学习 · 计算机科学 2023-01-13 Haruki Nishimura , Jean Mercat , Blake Wulfe , Rowan McAllister , Adrien Gaidon

Real-world time series data that commonly reflect sequential human behavior are often uniquely irregularly sampled and sparse, with highly nonuniform sampling over time and entities. Yet, commonly-used pretraining and augmentation methods…

机器学习 · 计算机科学 2023-08-29 Nicasia Beebe-Wang , Sayna Ebrahimi , Jinsung Yoon , Sercan O. Arik , Tomas Pfister

We formulate and study a fundamental search and detection problem, Schedule Optimization, motivated by a variety of real-world applications, ranging from monitoring content changes on the web, social networks, and user activities to…

数据结构与算法 · 计算机科学 2015-09-11 Ahmad Mahmoody , Evgenios M. Kornaropoulos , Eli Upfal

To schedule LLM inference, the \textit{shortest job first} (SJF) principle is favorable by prioritizing requests with short output lengths to avoid head-of-line (HOL) blocking. Existing methods usually predict a single output length for…

While recent advancements in inference-time learning have improved LLM reasoning on Text-to-SQL tasks, current solutions still struggle to perform well on the most challenging tasks in the Bird-Bench (BIRD) benchmark. This is due to…

计算与语言 · 计算机科学 2026-05-11 James Petullo , Nianwen Xue

Long-context models are essential for many applications but face inefficiencies in loading large KV caches during decoding. Prior methods enforce fixed token budgets for sparse attention, assuming a set number of tokens can approximate full…

机器学习 · 计算机科学 2025-02-19 Kan Zhu , Tian Tang , Qinyu Xu , Yile Gu , Zhichen Zeng , Rohan Kadekodi , Liangyu Zhao , Ang Li , Arvind Krishnamurthy , Baris Kasikci

Task planning with temporally extended goals (TEGs) is a critical challenge in AI and robotics, enabling agents to achieve complex sequences of objectives over time rather than addressing isolated, immediate tasks. Linear Temporal Logic on…

人工智能 · 计算机科学 2026-01-21 Yuliia Suprun , Khen Elimelech , Lydia E. Kavraki , Moshe Y. Vardi

To support reliable and low-latency communication, Time-Sensitive Networking introduced protocols and interfaces for resource allocation in Ethernet. However, the implementation of these allocation algorithms has not yet been covered by the…

网络与互联网体系结构 · 计算机科学 2025-08-27 Lisa Maile , Kai-Steffen Hielscher , Reinhard German

Large language models excel at reasoning but lack key aspects of introspection, including anticipating their own success and the computation required to achieve it. Humans use real-time introspection to decide how much effort to invest,…

机器学习 · 计算机科学 2025-12-24 Rohin Manvi , Joey Hong , Tim Seyde , Maxime Labonne , Mathias Lechner , Sergey Levine

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

计算与语言 · 计算机科学 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

In matching markets such as kidney exchanges and freight exchanges, delayed matching has been shown to improve overall market efficiency. The benefits of delay are highly sensitive to participants' sojourn times and departure behavior, and…

机器学习 · 计算机科学 2026-02-27 Ruiqi Zhou , Donghao Zhu , Houcai Shen

Spatio-temporal forecasting is an open research field whose interest is growing exponentially. In this work we focus on creating a complex deep neural framework for spatio-temporal traffic forecasting with comparatively very good…

机器学习 · 计算机科学 2020-10-22 Rodrigo de Medrano , José L. Aznarte

Incremental processing is widely-adopted in many applications, ranging from incremental view maintenance, stream computing, to recently emerging progressive data warehouse and intermittent query processing. Despite many algorithms developed…

Financial market forecasting is inherently uncertain, yet most deep learning approaches rely on point predictions that provide only single-value estimates without quantifying uncertainty. Such predictions are insufficient for risk-aware…

Time series forecasting plays a central role in many real-world applications and has been extensively studied. Most existing approaches rely on deterministic models. However, real-world environments exhibit inherently uncertain and complex…

机器学习 · 计算机科学 2026-05-25 Minju Kim , Youngbum Hur