English
Related papers

Related papers: Joint Consistency: A Unified Test-Time Aggregation…

200 papers

Language models can be sampled multiple times to access the distribution underlying their responses, but existing methods cannot efficiently synthesize rich epistemic signals across different long-form responses. We introduce Consensus…

Computation and Language · Computer Science 2025-10-07 Sayan Ghosh , Shahzaib Saqib Warraich , Dhruv Tarsadiya , Gregory Yauney , Swabha Swayamdipta

State-of-the-art deep learning models have achieved significant performance levels on various benchmarks. However, the excellent performance comes at a cost of inefficient computational cost. Light-weight architectures, on the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mohammad Akbari , Amin Banitalebi-Dehkordi , Yong Zhang

Inference-time sampling can elicit strong reasoning abilities from language models without additional training. Existing power-sampling methods do so by sharpening the distribution over full generated outputs, favoring completions that are…

Machine Learning · Computer Science 2026-05-28 Aleksei Arzhantsev , Otmane Sakhi , Nicolas Chopin

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

Temporal data, obtained in the setting where it is only possible to observe one time point per experiment, is widely used in different research fields, yet remains insufficiently addressed from the statistical point of view. Such data often…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

Chain-of-thought (CoT) prompting enhances reasoning in large language models (LLMs) but often leads to verbose and redundant outputs, thus increasing inference cost. We hypothesize that many reasoning steps are unnecessary for producing…

Computation and Language · Computer Science 2025-09-30 Xin Liu , Lu Wang

The paper surveys more than forty characterizations of scoring methods for preference aggregation and contains one new result. A general scoring operator is {\it self-consistent} if alternative $i$ is assigned a greater score than $j$…

Optimization and Control · Mathematics 2007-05-23 Pavel Chebotarev , Elena Shamis

Density estimation is a central primitive in probabilistic modeling, yet continuous, discrete, and mixed-variable domains are often treated by separate objectives, limiting the ability to exploit a common statistical structure across data…

Artificial Intelligence · Computer Science 2026-05-12 Zhijun Zeng , Yixuan Jiang , Pipi Hu , Zuoqiang Shi

We consider a reconciliation problem, where two hosts wish to synchronize their respective sets. Efficient solutions for minimizing the communication cost between the two hosts have been previously proposed in the literature. However, they…

Information Theory · Computer Science 2012-12-13 H. T. Kung , Chia-Mu Yu

Reasoning models produce long traces of intermediate decisions and tool calls, making test-time verification important for ensuring correctness. Existing approaches either verify only the final answer, which misses early errors, or rely on…

Test-Time Compute (TTC) has emerged as a powerful paradigm for enhancing the performance of Large Language Models (LLMs) at inference, leveraging strategies such as Test-Time Training (TTT) and Retrieval-Augmented Generation (RAG). However,…

Computation and Language · Computer Science 2025-08-15 J. Pablo Muñoz , Jinjie Yuan

In-context learning (ICL) enhances the reasoning abilities of Large Language Models (LLMs) by prepending a few demonstrations. It motivates researchers to introduce more examples to provide additional contextual information for the…

Computation and Language · Computer Science 2025-05-27 Jun Gao , Qi Lv , Zili Wang , Tianxiang Wu , Ziqiang Cao , Wenjie Li

Selecting an appropriate reasoning method for a given query remains a key challenge in language model generation. Existing approaches typically generate multiple candidate responses and use an aggregation strategy to select the output…

Machine Learning · Computer Science 2025-11-11 Bao Nguyen , Hieu Trung Nguyen , Ruifeng She , Xiaojin Fu , Viet Anh Nguyen

Ensemble clustering integrates a set of base clustering results to generate a stronger one. Existing methods usually rely on a co-association (CA) matrix that measures how many times two samples are grouped into the same cluster according…

Machine Learning · Computer Science 2023-02-24 Yuheng Jia , Sirui Tao , Ran Wang , Yongheng Wang

In this paper, we introduce a new learning strategy based on a seminal idea of Mojirsheibani (1999, 2000, 2002a, 2002b), who proposed a smart method for combining several classifiers, relying on a consensus notion. In many aggregation…

Machine Learning · Statistics 2018-03-09 Aurélie Fischer , Mathilde Mougeot

Joint Energy-based Model (JEM) is a recently proposed hybrid model that retains strong discriminative power of modern CNN classifiers, while generating samples rivaling the quality of GAN-based approaches. In this paper, we propose a…

Machine Learning · Computer Science 2021-09-22 Xiulong Yang , Shihao Ji

We present consensus analysis of systems with single integrator dynamics interacting via time-varying graphs under the event-triggered control paradigm. Event-triggered control sparsifies the control applied, thus reducing the control…

Systems and Control · Computer Science 2017-05-03 S. Arun Kumar , N. R. Chowdhury , S. Srikant , J. Raisch

This paper proposes a simple unified inference approach on moment restrictions in the presence of nuisance parameters. The proposed test is constructed based on a new characterization that avoids the estimation of nuisance parameters and…

Methodology · Statistics 2025-12-19 Xingyu Li , Xiaojun Song , Zhenting Sun

Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class-wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem…

Machine Learning · Computer Science 2024-09-20 Kyeongbo Kong , Kyunghun Kim , Suk-Ju Kang