English
Related papers

Related papers: Test-Time Alignment of LLMs via Sampling-Based Opt…

200 papers

Pre-trained Vision-Language Models (VLMs) have recently shown promise in detecting anomalies. However, previous approaches are fundamentally limited by their reliance on human-designed prompts and the lack of accessible anomaly samples,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Pi-Wei Chen , Jerry Chun-Wei Lin , Wei-Han Chen , Jia Ji , Zih-Ching Chen , Feng-Hao Yeh , Chao-Chun Chen

Decoding from large language models (LLMs) typically relies on fixed sampling hyperparameters (e.g., temperature, top-p), despite substantial variation in task difficulty and uncertainty across prompts and individual decoding steps. We…

Machine Learning · Computer Science 2026-03-17 Chloe H. Su , Zhe Ye , Samuel Tenka , Aidan Yang , Soonho Kong , Udaya Ghai

We introduce $\Psi$-Sampler, an SMC-based framework incorporating pCNL-based initial particle sampling for effective inference-time reward alignment with a score-based generative model. Inference-time reward alignment with score-based…

Machine Learning · Computer Science 2025-10-28 Taehoon Yoon , Yunhong Min , Kyeongmin Yeo , Minhyuk Sung

Autoprompting is the process of automatically selecting optimized prompts for language models, which is gaining popularity due to the rapid development of prompt engineering driven by extensive research in the field of large language models…

Computation and Language · Computer Science 2025-09-09 Ernest A. Dyagin , Nikita I. Kulin , Artur R. Khairullin , Viktor N. Zhuravlev , Alena N. Sitkina

Autonomous driving vehicles aim to free the hands of vehicle operators, helping them to drive easier and faster, meanwhile, improving the safety of driving on the highway or in complex scenarios. Automated driving systems (ADS) are…

Robotics · Computer Science 2023-07-04 Yucheng LI

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

Computation and Language · Computer Science 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Safety of Large Language Models (LLMs) has become a critical issue given their rapid progresses. Greedy Coordinate Gradient (GCG) is shown to be effective in constructing adversarial prompts to break the aligned LLMs, but optimization of…

Computation and Language · Computer Science 2024-11-11 Yiran Zhao , Wenyue Zheng , Tianle Cai , Xuan Long Do , Kenji Kawaguchi , Anirudh Goyal , Michael Shieh

We propose an adaptive importance sampling scheme for Gaussian approximations of intractable posteriors. Optimization-based approximations like variational inference can be too inaccurate while existing Monte Carlo methods can be too slow.…

Computation · Statistics 2025-02-04 Willem van den Boom , Andrea Cremaschi , Alexandre H. Thiery

We study robust high-dimensional sparse regression under finite-variance heavy-tailed noise, epsilon-contamination, and alpha-mixing dependence via two subsampling estimators: Adaptive Importance Sampling (AIS) and Stratified Sub-sampling…

Statistics Theory · Mathematics 2026-03-11 Prateek Mittal , Joohi Chauhan

Approximate Dynamic Programming (ADP) is a methodology to solve multi-stage stochastic optimization problems in multi-dimensional discrete or continuous spaces. ADP approximates the optimal value function by adaptively sampling both action…

Optimization and Control · Mathematics 2021-07-02 Vijay Kumar , Mort Webster

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

Computation and Language · Computer Science 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh

While astonishingly capable, large Language Models (LLM) can sometimes produce outputs that deviate from human expectations. Such deviations necessitate an alignment phase to prevent disseminating untruthful, toxic, or biased information.…

Artificial Intelligence · Computer Science 2024-10-30 Long Tan Le , Han Shu , Tung-Anh Nguyen , Choong Seon Hong , Nguyen H. Tran

Large reasoning models (LRMs) achieve impressive reasoning capabilities by generating lengthy chain-of-thoughts, but this "overthinking" incurs high latency and cost without commensurate accuracy gains. In this work, we introduce AALC, a…

Computation and Language · Computer Science 2025-08-11 Ruosen Li , Ziming Luo , Quan Zhang , Ruochen Li , Ben Zhou , Ali Payani , Xinya Du

An important problem in space-time adaptive detection is the estimation of the large p-by-p interference covariance matrix from training signals. When the number of training signals n is greater than 2p, existing estimators are generally…

Signal Processing · Electrical Eng. & Systems 2021-07-26 Benjamin D. Robinson , Robert Malinas , Alfred O. Hero

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

Large language models (LLMs) have achieved remarkable progress, demonstrating unprecedented capabilities across various natural language processing tasks. However, the high costs associated with such exceptional performance limit the…

Computation and Language · Computer Science 2025-04-24 Lizhe Chen , Binjia Zhou , Yuyao Ge , Jiayi Chen , Shiguang NI

Retraining a model using its own predictions together with the original, potentially noisy labels is a well-known strategy for improving the model performance. While prior works have demonstrated the benefits of specific heuristic…

Machine Learning · Computer Science 2025-05-22 Adel Javanmard , Rudrajit Das , Alessandro Epasto , Vahab Mirrokni

Aligning Large Language Models (LLMs) traditionally relies on costly training and human preference annotations. Self-alignment seeks to reduce these expenses by enabling models to align themselves. To further lower costs and achieve…

Computation and Language · Computer Science 2024-11-15 Somanshu Singla , Zhen Wang , Tianyang Liu , Abdullah Ashfaq , Zhiting Hu , Eric P. Xing

Recently, Approximate Message Passing (AMP) has been integrated with stochastic localization (diffusion model) by providing a computationally efficient estimator of the posterior mean. Existing (rigorous) analysis typically proves the…

Statistics Theory · Mathematics 2025-03-18 Han Cui , Zhiyuan Yu , Jingbo Liu

Large language models excel at reasoning but lack key aspects of introspection, including anticipating their own success and the computation required to achieve it. Humans use real-time introspection to decide how much effort to invest,…

Machine Learning · Computer Science 2025-12-24 Rohin Manvi , Joey Hong , Tim Seyde , Maxime Labonne , Mathias Lechner , Sergey Levine
‹ Prev 1 3 4 5 6 7 10 Next ›