English
Related papers

Related papers: Beyond Pass or Fail: Multi-Dimensional Benchmarkin…

200 papers

Progress on graph foundation models is hindered by benchmark practices that conflate the contributions of node features and graph structure, making it hard to tell whether a model actually learns from connectivity, or whether it even needs…

Machine Learning · Computer Science 2026-05-08 Richard von Moos , Mathieu Alain , Bastian Rieck

Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many different fields to collect similar scales of natural images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chenyang Lei , Liyi Chen , Jun Cen , Xiao Chen , Zhen Lei , Felix Heide , Qifeng Chen , Zhaoxiang Zhang

The rapid advancement of multimodal large language models has enabled agents to operate mobile devices by directly interacting with graphical user interfaces, opening new possibilities for mobile automation. However, real-world mobile tasks…

Artificial Intelligence · Computer Science 2025-10-17 Yuanyi Song , Heyuan Huang , Qiqiang Lin , Yin Zhao , Xiangmou Qu , Jun Wang , Xingyu Lou , Weiwen Liu , Zhuosheng Zhang , Jun Wang , Yong Yu , Weinan Zhang , Zhaoxiang Wang

Foundation Models (FMs) such as Large Language Models (LLMs) are reshaping the software industry by enabling FMware, systems that integrate these FMs as core components. In this KDD 2025 tutorial, we present a comprehensive exploration of…

Reinforcement fine-tuning (RFT) has become a core paradigm for post-training large language models, yet its training process remains highly fragile. Existing efforts mainly improve reliability at the system level or address specific issues…

Software Engineering · Computer Science 2026-05-07 Lingzhe Zhang , Tong Jia , Yunpeng Zhai , Liancheng Fang , Kening Zheng , Hongyi Liu , Xiaosong Huang , Philip S. Yu , Ying Li

Function calling is a core capability of large language models, essential for AI agents. Existing benchmarks such as the Berkeley Function Calling Leaderboard (BFCL), tau^2-Bench (arXiv:2506.07982), and ACEBench (arXiv:2501.12851) evaluate…

Artificial Intelligence · Computer Science 2025-09-24 Nikolai Skripko

With the development of multimodal reasoning models, Computer Use Agents (CUAs), akin to Jarvis from \textit{"Iron Man"}, are becoming a reality. GUI grounding is a core component for CUAs to execute actual actions, similar to mechanical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Miaosen Zhang , Ziqiang Xu , Jialiang Zhu , Qi Dai , Kai Qiu , Yifan Yang , Chong Luo , Tianyi Chen , Justin Wagle , Tim Franklin , Baining Guo

Machine fault diagnosis (FD) is a critical task for predictive maintenance, enabling early fault detection and preventing unexpected failures. Despite its importance, existing FD models are operation-specific with limited generalization…

Machine Learning · Computer Science 2025-11-06 Emadeldeen Eldele , Mohamed Ragab , Xu Qing , Edward , Zhenghua Chen , Min Wu , Xiaoli Li , Jay Lee

To support future intelligent multifunctional sixth-generation (6G) wireless communication networks, Synesthesia of Machines (SoM) is proposed as a novel paradigm for artificial intelligence (AI)-native intelligent multi-modal…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiang Cheng , Boxun Liu , Xuanyu Liu , Ensong Liu , Ziwei Huang

AI research agents accelerate ML research by automating hypothesis generation, experimentation, and empirical refinement. Existing agent strategies range from greedy hill-climbing to tree search and evolutionary optimization, yet which…

As industrial products become abundant and sophisticated, visual industrial defect detection receives much attention, including two-dimensional and three-dimensional visual feature modeling. Traditional methods use statistical analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianle Yang , Luyao Chang , Jiadong Yan , Juntao Li , Zhi Wang , Ke Zhang

The deployment of Large Language Models (LLMs) and Large Multimodal Models (LMMs) on mobile devices has gained significant attention due to the benefits of enhanced privacy, stability, and personalization. However, the hardware constraints…

As a seemingly self-explanatory task, problem-solving has been a significant component of science and engineering. However, a general yet concrete formulation of problem-solving itself is missing. With the recent development of AI-based…

Artificial Intelligence · Computer Science 2025-05-08 Qi Liu , Xinhao Zheng , Renqiu Xia , Xingzhi Qi , Qinxiang Cao , Junchi Yan

Exploratory GUI testing is essential for software quality but suffers from high manual costs. While Multi-modal Large Language Model (MLLM) agents excel in navigation, they fail to autonomously discover defects due to two core challenges:…

Artificial Intelligence · Computer Science 2026-01-09 Yifei Gao , Jiang Wu , Xiaoyi Chen , Yifan Yang , Zhe Cui , Tianyi Ma , Jiaming Zhang , Jitao Sang

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

Multiple works have emerged to push the boundaries of multi-modal large language models (MLLMs) towards pixel-level understanding. The current trend is to train MLLMs with pixel-level grounding supervision in terms of masks on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mennatullah Siam

Foundation models (FMs) such as large language models (LLMs) have significantly impacted many fields, including software engineering (SE). The interaction between SE and FMs has led to the integration of FMs into SE practices (FM4SE) and…

Software Engineering · Computer Science 2025-12-15 Hao Li , Cor-Paul Bezemer , Ahmed E. Hassan

Recent studies demonstrate that tool-calling capability enables large language models (LLMs) to interact with external environments for long-horizon financial tasks. While existing benchmarks have begun evaluating financial tool calling,…

Language models excel at following instructions but often struggle with the collaborative aspects of conversation that humans naturally employ. This limitation in grounding -- the process by which conversation participants establish mutual…

Computation and Language · Computer Science 2025-06-03 Omar Shaikh , Hussein Mozannar , Gagan Bansal , Adam Fourney , Eric Horvitz

Pre-trained language models have shown impressive performance on a variety of tasks and domains. Previous research on financial language models usually employs a generic training scheme to train standard model architectures, without…

Computation and Language · Computer Science 2022-11-02 Raj Sanjay Shah , Kunal Chawla , Dheeraj Eidnani , Agam Shah , Wendi Du , Sudheer Chava , Natraj Raman , Charese Smiley , Jiaao Chen , Diyi Yang
‹ Prev 1 8 9 10 Next ›