English
Related papers

Related papers: Structural Entropy Guided Agent for Detecting and …

200 papers

Large language models (LLMs) have demonstrated remarkable reasoning capability in solving mathematical problems. However, existing approaches primarily focus on improving the quality of correct training data, e.g., distilling high-quality…

Machine Learning · Computer Science 2025-06-02 Zhuoshi Pan , Yu Li , Honglin Lin , Qizhi Pei , Zinan Tang , Wei Wu , Chenlin Ming , H. Vicky Zhao , Conghui He , Lijun Wu

Large Language Models (LLMs) have not only exhibited exceptional performance across various tasks, but also demonstrated sparks of intelligence. Recent studies have focused on assessing their capabilities on human exams and revealed their…

Computation and Language · Computer Science 2023-10-19 Zheyuan Zhang , Jifan Yu , Juanzi Li , Lei Hou

Evaluating large language models (LLMs) has become increasingly challenging as model capabilities advance rapidly. While recent models often achieve higher scores on standard benchmarks, these improvements do not consistently reflect…

Computation and Language · Computer Science 2025-08-21 Haiquan Hu , Jiazhi Jiang , Shiyou Xu , Ruhan Zeng , Tian Wang

Entropy-based deep reasoning has emerged as a promising direction for improving the reasoning capabilities of Large Language Models (LLMs), but existing methods often either increase response length indiscriminately or shorten responses at…

Computation and Language · Computer Science 2026-05-20 Shuyu Wei , Jian Sun , Delai Qiu , Yining Wang , Shengping Liu , Jiaen Liang , Ying Fu , Wei Huang , Jitao Sang

Training long-context language models to capture long-range dependencies requires specialized data construction. Current approaches, such as generic text concatenation or heuristic-based variants, frequently fail to guarantee genuine…

Computation and Language · Computer Science 2025-10-06 Junlong Jia , Ziyang Chen , Xing Wu , Chaochen Gao , Zijia Lin , Debing Zhang , Songlin Hu , Binghui Guo

Recent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique. Contemporary approaches leverage either sequential reasoning…

Computation and Language · Computer Science 2025-07-10 Zenan Xu , Zexuan Qiu , Guanhua Huang , Kun Li , Siheng Li , Chenchen Zhang , Kejiao Li , Qi Yi , Yuhao Jiang , Bo Zhou , Fengzong Lian , Zhanhui Kang

In long structured document retrieval, existing methods typically fine-tune pre-trained language models (PLMs) using contrastive learning on datasets lacking explicit structural information. This practice suffers from two critical issues:…

Information Retrieval · Computer Science 2025-09-03 Xinhao Huang , Zhibo Ren , Yipeng Yu , Ying Zhou , Zulong Chen , Zeyi Wen

This paper addresses fine-tuning Large Language Models (LLMs) for function calling tasks when real user interaction data is unavailable. In digital content creation tools, where users express their needs through natural language queries…

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

In recent years, multi-view multi-label learning (MVML) has attracted extensive attention due to its close alignment to real-world scenarios. Information-theoretic methods have gained prominence for learning nonlinear correlations. However,…

Machine Learning · Computer Science 2026-03-04 Cheng Peng , Yonghao Li , Wanfu Gao , Jie Wen , Weiping Ding

A Large Language Model (LLM) is considered consistent if semantically equivalent prompts produce semantically equivalent responses. Despite recent advancements showcasing the impressive capabilities of LLMs in conversational systems, we…

Computation and Language · Computer Science 2024-03-04 Vamshi Krishna Bonagiri , Sreeram Vennam , Manas Gaur , Ponnurangam Kumaraguru

Large language models (LLMs) have been widely integrated into information retrieval to advance traditional techniques. However, effectively enabling LLMs to seek accurate knowledge in complex tasks remains a challenge due to the complexity…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Lingyong Yan , Dawei Yin , Suzan Verberne , Maarten de Rijke , Zhaochun Ren

Recent neural network-driven semantic role labeling (SRL) systems have shown impressive improvements in F1 scores. These improvements are due to expressive input representations, which, at least at the surface, are orthogonal to…

Computation and Language · Computer Science 2020-05-06 Tao Li , Parth Anand Jawale , Martha Palmer , Vivek Srikumar

Large Language Models (LLMs) can be seen as compressed knowledge bases, but it remains unclear what knowledge they truly contain and how far their knowledge boundary extends. Existing benchmarks are mostly static and provide limited support…

Machine Learning · Computer Science 2026-05-27 Yuheng Yang , Siqi Zhu , Tao Feng , Ge Liu , Jiaxuan You

Recommender systems are indispensable in the realm of online applications, and sequential recommendation has enjoyed considerable prevalence due to its capacity to encapsulate the dynamic shifts in user interests. However, previous…

Information Retrieval · Computer Science 2024-04-16 Junzhe Jiang , Shang Qu , Mingyue Cheng , Qi Liu , Zhiding Liu , Hao Zhang , Rujiao Zhang , Kai Zhang , Rui Li , Jiatong Li , Min Gao

Syntactic language models (SLMs) enhance Transformers by incorporating syntactic biases through the modeling of linearized syntactic parse trees alongside surface sentences. This paper focuses on compositional SLMs that are based on…

Computation and Language · Computer Science 2025-07-01 Yida Zhao , Hao Xve , Xiang Hu , Kewei Tu

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Recent advances in large language models (LLMs) have opened new opportunities for academic literature retrieval. However, existing systems often rely on rigid pipelines and exhibit limited reasoning capabilities. We introduce SPAR, a…

Information Retrieval · Computer Science 2025-07-22 Xiaofeng Shi , Yuduo Li , Qian Kou , Longbin Yu , Jinxin Xie , Hua Zhou

The LLM community often reports benchmark results as if they are synonymous with general model capabilities. However, benchmarks can have problems that distort performance, like test set contamination and annotator error. How can we know…

Artificial Intelligence · Computer Science 2026-02-18 Ryan Othniel Kearns

Data curation tasks that prepare data for analytics are critical for turning data into actionable insights. However, due to the diverse requirements of applications in different domains, generic off-the-shelf tools are typically…

Databases · Computer Science 2024-04-25 Zui Chen , Lei Cao , Sam Madden , Tim Kraska , Zeyuan Shang , Ju Fan , Nan Tang , Zihui Gu , Chunwei Liu , Michael Cafarella