English
Related papers

Related papers: Breaking Free from MMI: A New Frontier in Rational…

200 papers

Multivariate analysis of fMRI data has benefited substantially from advances in machine learning. Most recently, a range of probabilistic latent variable models applied to fMRI data have been successful in a variety of tasks, including…

Large reasoning models such as DeepSeek-R1 and OpenAI o1 generate extended chains of thought spanning thousands of tokens, yet their integration with retrieval-augmented generation (RAG) remains fundamentally misaligned. Current RAG systems…

Information Retrieval · Computer Science 2026-04-30 Dongxin Guo , Jikun Wu , Siu Ming Yiu

Multimodal information retrieval (MMIR) has gained attention for its flexibility in handling text, images, or mixed queries and candidates. Recent breakthroughs in multimodal large language models (MLLMs) boost MMIR performance by…

Information Retrieval · Computer Science 2026-02-27 Dawei Su , Dongsheng Wang

Estimation of information theoretic quantities such as mutual information and its conditional variant has drawn interest in recent times owing to their multifaceted applications. Newly proposed neural estimators for these quantities have…

Machine Learning · Computer Science 2020-07-24 Arnab Kumar Mondal , Arnab Bhattacharya , Sudipto Mukherjee , Prathosh AP , Sreeram Kannan , Himanshu Asnani

Multiple imputation provides us with efficient estimators in model-based methods for handling missing data under the true model. It is also well-understood that design-based estimators are robust methods that do not require accurately…

Methodology · Statistics 2020-06-11 Kyunghee Han , Pamela A. Shaw , Thomas Lumley

Large language models (LLMs) have been shown to be capable of impressive few-shot generalisation to new tasks. However, they still tend to perform poorly on multi-step logical reasoning problems. Here we carry out a comprehensive evaluation…

Artificial Intelligence · Computer Science 2022-05-20 Antonia Creswell , Murray Shanahan , Irina Higgins

Human reasoning relies on constructing and manipulating mental models -- simplified internal representations of situations used to understand and solve problems. Conceptual diagrams (e.g., a sketch drawn to aid reasoning) externalize these…

Artificial Intelligence · Computer Science 2025-09-30 Nasim Borazjanizadeh , Roei Herzig , Eduard Oks , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

Scientists frequently prioritize learning from data rather than training the best possible model; however, research in machine learning often prioritizes the latter. Marginal contribution feature importance (MCI) was developed to break this…

Machine Learning · Statistics 2024-11-12 Joseph Janssen , Vincent Guan , Elina Robeva

The modular structure of brain networks supports specialized information processing, complex dynamics, and cost-efficient spatial embedding. Inter-individual variation in modular structure has been linked to differences in performance,…

Large Language Models (LLMs) have become indispensable across academia, industry, and daily applications, yet current evaluation methods struggle to keep pace with their rapid development. One core challenge of evaluation in the large…

Computation and Language · Computer Science 2025-05-27 Yixin Cao , Jiahao Ying , Yaoning Wang , Xipeng Qiu , Xuanjing Huang , Yugang Jiang

Large reasoning models (LRMs) have demonstrated impressive capabilities in complex problem-solving, yet their internal reasoning mechanisms remain poorly understood. In this paper, we investigate the reasoning trajectories of LRMs from an…

Artificial Intelligence · Computer Science 2025-06-05 Chen Qian , Dongrui Liu , Haochen Wen , Zhen Bai , Yong Liu , Jing Shao

In the past few decades, researchers have proposed many discriminant analysis (DA) algorithms for the study of high-dimensional data in a variety of problems. Most DA algorithms for feature extraction are based on transformations that…

Computer Vision and Pattern Recognition · Computer Science 2012-06-12 Ali Shadvar

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional…

Machine Learning · Computer Science 2019-11-20 Weida Li , Mingxia Liu , Fang Chen , Daoqiang Zhang

Large language models (LMs) are capable of generating free-text rationales to aid question answering. However, prior work 1) suggests that useful self-rationalization is emergent only at significant scales (e.g., 175B parameter GPT-3); and…

Computation and Language · Computer Science 2024-05-24 Sahana Ramnath , Brihi Joshi , Skyler Hallinan , Ximing Lu , Liunian Harold Li , Aaron Chan , Jack Hessel , Yejin Choi , Xiang Ren

In this paper the theory of flexibly-bounded rationality which is an extension to the theory of bounded rationality is revisited. Rational decision making involves using information which is almost always imperfect and incomplete together…

Artificial Intelligence · Computer Science 2013-06-11 Tshilidzi Marwala

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

Multiple imputation (MI) has been widely applied to missing value problems in biomedical, social and econometric research, in order to avoid improper inference in the downstream data analysis. In the presence of high-dimensional data,…

Methodology · Statistics 2023-05-04 Zhiqi Bu , Zongyu Dai , Yiliang Zhang , Qi Long

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

In this paper, we introduce Writing in the Margins (WiM), a new inference pattern for Large Language Models designed to optimize the handling of long input sequences in retrieval-oriented tasks. This approach leverages the chunked prefill…

Computation and Language · Computer Science 2024-08-28 Melisa Russak , Umar Jamil , Christopher Bryant , Kiran Kamble , Axel Magnuson , Mateusz Russak , Waseem AlShikh