English
Related papers

Related papers: TRACE: Trajectory-Aware Comprehensive Evaluation f…

200 papers

A critical bottleneck in automating AI research is the execution of complex machine learning engineering (MLE) tasks. MLE differs from general software engineering due to computationally expensive evaluation (e.g., model training) and…

Artificial Intelligence · Computer Science 2026-05-21 Jiefeng Chen , Bhavana Dalvi Mishra , Jaehyun Nam , Rui Meng , Tomas Pfister , Jinsung Yoon

Trajectory representation learning (TRL) maps trajectories to vectors that can then be used for various downstream tasks, including trajectory similarity computation, trajectory classification, and travel-time estimation. However, existing…

Machine Learning · Computer Science 2024-12-02 Silin Zhou , Shuo Shang , Lisi Chen , Christian S. Jensen , Panos Kalnis

Generalizing deep reinforcement learning agents to unseen environments remains a significant challenge. One promising solution is Unsupervised Environment Design (UED), a co-evolutionary framework in which a teacher adaptively generates…

Machine Learning · Computer Science 2026-03-17 Geonwoo Cho , Jaegyun Im , Jihwan Lee , Hojun Yi , Sejin Kim , Sundong Kim

Equipping Large Language Model (LLM) agents with domain-specific skills is critical for tackling complex tasks. Yet, manual authoring creates a severe scalability bottleneck. Conversely, automated skill generation often yields fragile or…

Artificial Intelligence · Computer Science 2026-04-28 Jingwei Ni , Yihao Liu , Xinpeng Liu , Yutao Sun , Mengyu Zhou , Pengyu Cheng , Dexin Wang , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Large Reasoning Models (LRMs) increasingly rely on reasoning traces with complex internal structures. However, existing work lacks a unified answer to three fundamental questions: (1) what defines high-quality reasoning, (2) how to reliably…

Computation and Language · Computer Science 2026-02-10 Haoran Zhang , Yafu Li , Zhi Wang , Zhilin Wang , Shunkai Zhang , Xiaoye Qu , Yu Cheng

The field of Language Reasoning Models (LRMs) has been very active over the past few years with advances in training and inference techniques enabling LRMs to reason longer, and more accurately. However, a growing body of studies show that…

Computation and Language · Computer Science 2026-04-24 Yannis Belkhiter , Seshu Tirupathi , Giulio Zizzo , John D. Kelleher

This paper presents TRACE, a tool to analyze the quality of 2D embeddings generated through dimensionality reduction techniques. Dimensionality reduction methods often prioritize preserving either local neighborhoods or global distances,…

While Large Language Models (LLMs) have substantially improved the functional correctness of code translation, the critical dimension of \textit{execution efficiency} remains overlooked. We present \textbf{\textsc{trace}}, the first…

Software Engineering · Computer Science 2026-04-15 Zhihao Gong , Zeyu Sun , Dong Huang , Qingyuan Liang , Jie M. Zhang , Dan Hao

While Large Language Models (LLMs) have substantially improved the functional correctness of code translation, the critical dimension of \textit{execution efficiency} remains overlooked. We present \textbf{\textsc{trace}}, the first…

Software Engineering · Computer Science 2026-03-20 Zhihao Gong , Zeyu Sun , Dong Huang , Qingyuan Liang , Jie M. Zhang , Dan Hao

Evaluating AI agents that solve real-world tasks through function-call sequences remains an open challenge. Existing agentic benchmarks often reduce evaluation to a binary judgment of the final state, overlooking critical aspects such as…

Artificial Intelligence · Computer Science 2025-09-26 Panagiotis Michelakis , Yiannis Hadjiyiannis , Dimitrios Stamoulis

As Reinforcement Learning (RL) agents are increasingly deployed in real-world applications, ensuring their behavior is transparent and trustworthy is paramount. A key component of trust is explainability, yet much of the work in Explainable…

Machine Learning · Computer Science 2025-12-09 Clifford F , Devika Jay , Abhishek Sarkar , Satheesh K Perepu , Santhosh G S , Kaushik Dey , Balaraman Ravindran

For users navigating travel e-commerce websites, the process of researching products and making a purchase often results in intricate browsing patterns that span numerous sessions over an extended period of time. The resulting clickstream…

Information Retrieval · Computer Science 2024-09-23 William Black , Alexander Manlove , Jack Pennington , Andrea Marchini , Ercument Ilhan , Vilda Markeviciute

Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal prediction provides finite-sample, distribution-free coverage guarantees, its practical…

Machine Learning · Statistics 2026-05-11 Zhenhan Fang , Aixin Tan , Jian Huang

Retrieval-Augmented Generation (RAG) shows promise for enterprise knowledge work, yet it often underperforms in high-stakes decision settings that require deep synthesis, strict traceability, and recovery from underspecified prompts.…

Information Retrieval · Computer Science 2026-01-27 Xincheng You , Qi Sun , Neha Bora , Huayi Li , Shubham Goel , Kang Li , Sean Culatana

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

Computation and Language · Computer Science 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

Despite their success and widespread adoption, the opaque nature of deep neural networks (DNNs) continues to hinder trust, especially in critical applications. Current interpretability solutions often yield inconsistent or oversimplified…

Machine Learning · Computer Science 2024-10-10 Alec F. Diallo , Vaishak Belle , Paul Patras

Failure attribution, i.e., identifying the responsible agent and decisive step of a failure, is particularly challenging in LLM-based multi-agent systems (MAS) due to their natural-language reasoning, nondeterministic outputs, and intricate…

Multiagent Systems · Computer Science 2026-04-27 Mengzhuo Chen , Junjie Wang , Fangwen Mu , Yawen Wang , Zhe Liu , Huanxiang Feng , Qing Wang

Traditional conversational travel recommender systems primarily optimize for user relevance and convenience, often reinforcing popular, overcrowded destinations and carbon-intensive travel choices. To address this, we present TRACE (Tourism…

Information Retrieval · Computer Science 2026-04-17 Ashmi Banerjee , Adithi Satish , Wolfgang Wörndl , Yashar Deldjoo

Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and…

As an embodiment of intelligence evolution toward interconnected architectures, Deep Research Agents (DRAs) systematically exhibit the capabilities in task decomposition, cross-source retrieval, multi-stage reasoning, information…

Artificial Intelligence · Computer Science 2026-01-30 Yang Yao , Yixu Wang , Yuxuan Zhang , Yi Lu , Tianle Gu , Lingyu Li , Dingyi Zhao , Keming Wu , Haozhe Wang , Ping Nie , Yan Teng , Yingchun Wang