English
Related papers

Related papers: Query-level Early Exit for Additive Learning-to-Ra…

200 papers

This paper presents a novel framework for goal-oriented semantic communications leveraging recursive early exit models. The proposed approach is built on two key components. First, we introduce an innovative early exit strategy that…

Machine Learning · Computer Science 2024-12-30 Jary Pomponi , Mattia Merluzzi , Alessio Devoto , Mateus Pontes Mota , Paolo Di Lorenzo , Simone Scardapane

Existing research on large language models (LLMs) shows that they can solve information extraction tasks through multi-step planning. However, their extraction behavior on complex sentences and tasks is unstable, emerging issues such as…

Computation and Language · Computer Science 2024-08-30 Zepeng Ding , Ruiyang Ke , Wenhao Huang , Guochao Jiang , Yanda Li , Deqing Yang , Jiaqing Liang

In this paper, we focus on examination results when examinees selectively skip examinations, to compare the difficulty levels of these examinations. We call the resultant data 'selectively omitted examination data' Examples of this type of…

Computers and Society · Computer Science 2021-03-10 Satoshi Takahashi , Masaki Kitazawa , Ryoma Aoki , Atsushi Yoshikawa

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during…

Information Retrieval · Computer Science 2026-04-23 Wenhan Liu , Xinyu Ma , Weiwei Sun , Yutao Zhu , Yuchen Li , Dawei Yin , Zhicheng Dou

Enterprise deep research often fails to produce decision-ready reports due to uneven information coverage, context explosion, and premature stopping. We propose a scalable Enterprise Deep Research (EDR) architecture to address these…

Computation and Language · Computer Science 2026-04-29 Prafulla Kumar Choubey , Kung-Hsiang Huang , Pranav Narayanan Venkit , Jiaxin Zhang , Vaibhav Vats , Yu Li , Xiangyu Peng , Chien-Sheng Wu

LLMs utilizing chain-of-thought reasoning often waste substantial compute by producing long, incorrect responses. Abstention can mitigate this by withholding outputs unlikely to be correct. While most abstention methods decide to withhold…

Machine Learning · Computer Science 2026-05-26 Hen Davidov , Nachshon Cohen , Oren Kalinsky , Yaron Fairstein , Guy Kushilevitz , Ram Yazdi , Patrick Rebeschini

Scaling machine learning models significantly improves their performance. However, such gains come at the cost of inference being slow and resource-intensive. Early-exit neural networks (EENNs) offer a promising solution: they accelerate…

Forced-choice conjoint designs have become a staple method in the experimentalist's toolkit. However, the forced-choice outcome is neither always consistent with the types of choices individuals make in real political contexts, nor is it…

Methodology · Statistics 2026-04-17 Thomas S. Robinson , Mats Ahrenshop , Spyros Kosmidis

Search systems are increasingly used for reasoning-intensive queries, where what makes a document relevant requires understanding or reasoning over the query-document relation rather than relying on surface vocabulary or topical similarity.…

Information Retrieval · Computer Science 2026-05-27 Nilesh Gupta , Wei-Cheng Chang , Ngot Bui , Cho-Jui Hsieh , Inderjit S. Dhillon

Many recent approaches towards neural information retrieval mitigate their computational costs by using a multi-stage ranking pipeline. In the first stage, a number of potentially relevant candidates are retrieved using an efficient…

Information Retrieval · Computer Science 2021-05-26 Marco Wrzalik , Dirk Krechel

Recent studies in Learning to Rank have shown the possibility to effectively distill a neural network from an ensemble of regression trees. This result leads neural networks to become a natural competitor of tree-based ensembles on the…

Machine Learning · Computer Science 2024-10-28 F. M. Nardini , C. Rulli , S. Trani , R. Venturini

Learning-to-rank (LTR) is a set of supervised machine learning algorithms that aim at generating optimal ranking order over a list of items. A lot of ranking models have been studied during the past decades. And most of them treat each…

Information Retrieval · Computer Science 2020-06-09 RuiXing Wang , Kuan Fang , RiKang Zhou , Zhan Shen , LiWen Fan

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

Reasoning models have demonstrated exceptional performance in tasks such as mathematics and logical reasoning, primarily due to their ability to engage in step-by-step thinking during the reasoning process. However, this often leads to…

Artificial Intelligence · Computer Science 2025-10-23 Yuqiao Tan , Shizhu He , Kang Liu , Jun Zhao

Retrieval-augmented generation has achieved strong performance on knowledge-intensive tasks where query-document relevance can be identified through direct lexical or semantic matches. However, many real-world queries involve abstract…

Information Retrieval · Computer Science 2026-04-03 Duolin Sun , Meixiu Long , Dan Yang , Junjie Wang , Yecheng Luo , Yue Shen , Jian Wang , Hualei Zhou , Chunxiao Guo , Peng Wei , Jiahai Wang , Jinjie Gu

Motivated by the widespread adoption of iterative project management techniques, we study the effects of workflow -- iterative or sequential -- on innovative behavior and performance. We conduct a series of laboratory experiments. Our first…

General Economics · Economics 2026-03-03 Evgeny Kagan , Christian Jost , Tobias Lieberum , Sebastian Schiffels

In machine learning practice, early stopping has been widely used to regularize models and can save computational costs by halting the training process when the model's performance on a validation set stops improving. However, conventional…

Machine Learning · Computer Science 2025-02-12 Suqin Yuan , Runqi Lin , Lei Feng , Bo Han , Tongliang Liu

While variable selection is essential to optimize the learning complexity by prioritizing features, automating the selection process is preferred since it requires laborious efforts with intensive analysis otherwise. However, it is not an…

Machine Learning · Computer Science 2019-10-29 Makiya Nakashima , Alex Sim , Youngsoo Kim , Jonghyun Kim , Jinoh Kim

Large reasoning models (LRMs) have achieved remarkable performance in complex reasoning tasks, driven by their powerful inference-time scaling capability. However, LRMs often suffer from overthinking, which results in substantial…

Computation and Language · Computer Science 2026-04-09 Yang Xiang , Yixin Ji , Ruotao Xu , Dan Qiao , Zheming Yang , Juntao Li , Min Zhang

A decision tree is one of the most popular approaches in machine learning fields. However, it suffers from the problem of overfitting caused by overly deepened trees. Then, a meta-tree is recently proposed. It solves the problem of…

Machine Learning · Statistics 2024-02-12 Ryota Maniwa , Naoki Ichijo , Yuta Nakahara , Toshiyasu Matsushima