English
Related papers

Related papers: SkillRet: A Large-Scale Benchmark for Skill Retrie…

200 papers

The increasing reliance on online recruitment platforms coupled with the adoption of AI technologies has highlighted the critical need for efficient resume classification methods. However, challenges such as small datasets, lack of…

Computation and Language · Computer Science 2024-07-16 Ahmed Heakl , Youssef Mohamed , Noran Mohamed , Aly Elsharkawy , Ahmed Zaky

Thousands of diverse benchmarks have been developed to measure the quality of large language models (LLMs). Yet prior work has demonstrated that LLM performance is often sufficiently explained by a small set of latent factors, or abilities.…

Computation and Language · Computer Science 2026-04-03 Michael Krumdick , Adam Wiemerslage , Seth Ebner , Charles Lovering , Chris Tanner

The evaluation of large language models (LLMs) via benchmarks is widespread, yet inconsistencies between different leaderboards and poor separability among top models raise concerns about their ability to accurately reflect authentic model…

Computation and Language · Computer Science 2026-01-19 Hongli Zhou , Hui Huang , Ziqing Zhao , Lvyuan Han , Huicheng Wang , Kehai Chen , Muyun Yang , Wei Bao , Jian Dong , Bing Xu , Conghui Zhu , Hailong Cao , Tiejun Zhao

Recent work has explored training Large Language Model (LLM) search agents with reinforcement learning (RL) for open-domain question answering (QA). However, most evaluations focus solely on final answer accuracy, overlooking how these…

Artificial Intelligence · Computer Science 2025-09-29 Jiaqi Shao , Yuxiang Lin , Munish Prasad Lohani , Yufeng Miao , Bing Luo

Large language model (LLM) agents increasingly rely on reusable skills: capability packages that combine instructions, control flow, constraints, and tool calls. In current agent systems, however, skills are still represented by text-heavy…

Computation and Language · Computer Science 2026-05-05 Qiliang Liang , Hansi Wang , Zhong Liang , Yang Liu

Large Language Models (LLMs) have evolved from simple chatbots into sophisticated agents capable of automating complex real-world tasks, where browsing and reasoning over live web content is key to assessing retrieval and cognitive skills.…

Artificial Intelligence · Computer Science 2025-12-19 Yumeng Wang , Tianyu Fan , Lingrui Xu , Chao Huang

The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters. However, the closed-source nature of state-of-the-art…

Large Language Model (LLM)-based agents have demonstrated remarkable capabilities in complex reasoning and multi-turn interactions but struggle to continuously improve and adapt when deployed in new environments. One promising approach is…

Artificial Intelligence · Computer Science 2026-03-11 Jiongxiao Wang , Qiaojing Yan , Yawei Wang , Yijun Tian , Soumya Smruti Mishra , Zhichao Xu , Megha Gandhi , Panpan Xu , Lin Lee Cheong

AI-powered recruitment tools are increasingly adopted in personnel selection, yet they struggle to capture the requisition (req)-specific personal competencies (PCs) that distinguish successful candidates beyond job categories. We propose a…

Computation and Language · Computer Science 2026-04-02 Wanxin Li , Denver McNeney , Nivedita Prabhu , Charlene Zhang , Renee Barr , Matthew Kitching , Khanh Dao Duc , Anthony S. Boyce

Retrieval-augmented LLM agents increasingly rely on curated skill banks: collections of reusable textual principles that guide decision making on complex tasks. Existing approaches typically expand these banks in an append-only fashion,…

Computation and Language · Computer Science 2026-05-29 Wentao Hu , Zhendong Chu , Yiming Zhang , Junda Wu , Ming Jin , Xiangyu Zhao , Yilei Shao , Yanfeng Wang , Qingsong Wen

Current AI agents can flexibly invoke tools and execute complex tasks, yet their long-term advancement is hindered by the lack of systematic accumulation and transfer of skills. Without a unified mechanism for skill consolidation, agents…

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Large language model (LLM) agents have demonstrated remarkable capabilities in software engineering and cybersecurity tasks, including code generation, vulnerability discovery, and automated testing. One critical but underexplored…

Software Engineering · Computer Science 2025-10-17 Bin Liu , Yanjie Zhao , Guoai Xu , Haoyu Wang

Accurate skill extraction from job descriptions is crucial in the hiring process but remains challenging. Named Entity Recognition (NER) is a common approach used to address this issue. With the demonstrated success of large language models…

Computation and Language · Computer Science 2024-10-17 Amirhossein Herandi , Yitao Li , Zhanlin Liu , Ximin Hu , Xiao Cai

We investigate the potential of large language models (LLMs) to serve as efficient simulators for agentic search tasks in reinforcement learning (RL), thereby reducing dependence on costly interactions with external search engines. To this…

Real-world tool-using agents operate over long-horizon workflows with recurring structure and diverse demands, where effective behavior requires not only invoking atomic tools but also abstracting, and reusing higher-level tool…

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

Agentic large language models often rely on skills, reusable natural language procedures that guide planning, action, and tool use. In practice, skills are typically improved through prompt engineering or by aligning the task LLM itself,…

From professional research to everyday planning, many tasks are bottlenecked by wide-scale information seeking, which is more repetitive than cognitively complex. With the rapid development of Large Language Models (LLMs), automated search…

Computation and Language · Computer Science 2025-08-29 Ryan Wong , Jiawei Wang , Junjie Zhao , Li Chen , Yan Gao , Long Zhang , Xuan Zhou , Zuo Wang , Kai Xiang , Ge Zhang , Wenhao Huang , Yang Wang , Ke Wang

The transition from monolithic large language models (LLMs) to modular, skill-equipped agents represents a fundamental architectural shift in artificial intelligence deployment. While general-purpose models demonstrate remarkable breadth in…

Artificial Intelligence · Computer Science 2026-03-18 Shuzhen Bi , Mengsong Wu , Hao Hao , Keqian Li , Wentao Liu , Siyu Song , Hongbo Zhao , Aimin Zhou