English
Related papers

Related papers: Leveraging Partial SMILES Validation Scheme for En…

200 papers

In existing Audio-Visual Speech Enhancement (AVSE) methods, objectives such as Scale-Invariant Signal-to-Noise Ratio (SI-SNR) and Mean Squared Error (MSE) are widely used; however, they often correlate poorly with perceptual quality and…

Sound · Computer Science 2026-03-18 Chih-Ning Chen , Jen-Cheng Hou , Hsin-Min Wang , Shao-Yi Chien , Yu Tsao , Fan-Gang Zeng

Current multimodal models often suffer from shallow reasoning, leading to errors caused by incomplete or inconsistent thought processes. To address this limitation, we propose Self-Verification and Self-Rectification (SVSR), a unified…

Artificial Intelligence · Computer Science 2026-05-29 Zhe Qian , Nianbing Su , Zhonghua Wang , Hebei Li , Zhongxing Xu , Yueying Li , Fei Luo , Zhuohan Ouyang , Yanbiao Ma

While Retrieval-Augmented Generation (RAG) has exhibited promise in utilizing external knowledge, its generation process heavily depends on the quality and accuracy of the retrieved context. Large language models (LLMs) struggle to evaluate…

Computation and Language · Computer Science 2025-10-13 Shi-Qi Yan , Quan Liu , Zhen-Hua Ling

Speculative reasoning has recently been proposed as a means to accelerate reasoning-intensive generation in large multimodal models, but its effectiveness is often constrained by misalignment between speculative drafts and target-verified…

Artificial Intelligence · Computer Science 2026-05-28 Yunhai Hu , Zining Liu , Xiangyang Yin , Tianhua Xia , Bo Bao , Eric Sather , Vithursan Thangarasa , Sai Qian Zhang

Direct Preference Optimization (DPO) using an implicit reward model has proven to be an effective alternative to reinforcement learning from human feedback (RLHF) for fine-tuning preference aligned large language models (LLMs). However, the…

Computation and Language · Computer Science 2024-09-30 Guoxin Chen , Minpeng Liao , Chengxi Li , Kai Fan

Large language models (LLMs) are increasingly applied to complex reasoning tasks that require executing several complex steps before receiving any reward. Properly assigning credit to these steps is essential for enhancing model…

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

Machine Learning · Computer Science 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Retrosynthesis planning, essential in organic synthesis and drug discovery, has greatly benefited from recent AI-driven advancements. Nevertheless, existing methods frequently face limitations in both applicability and explainability.…

Computational Engineering, Finance, and Science · Computer Science 2025-07-24 Situo Zhang , Hanqi Li , Lu Chen , Zihan Zhao , Xuanze Lin , Zichen Zhu , Bo Chen , Xin Chen , Kai Yu

Reinforcement learning (RL) has become a prevailing approach for fine-tuning large language models (LLMs) on complex reasoning tasks. Among recent methods, GRPO stands out for its empirical success in training models such as DeepSeek-R1,…

Machine Learning · Computer Science 2025-06-13 Wei Xiong , Jiarui Yao , Yuhui Xu , Bo Pang , Lei Wang , Doyen Sahoo , Junnan Li , Nan Jiang , Tong Zhang , Caiming Xiong , Hanze Dong

Reinforcement learning (RL) has emerged as a key paradigm for aligning and optimizing large language models (LLMs). Standard approaches treat the LLM as the policy and apply RL directly over the full vocabulary space. However, this…

Machine Learning · Computer Science 2026-02-17 Jing-Cheng Pang , Liang Lu , Xian Tang , Kun Jiang , Sijie Wu , Kai Zhang , Xubin Li

Although Large Audio-Language Models (LALMs) have exhibited outstanding performance in auditory understanding, their performance in affective computing scenarios, particularly in emotion recognition, reasoning, and subtle sentiment…

Sound · Computer Science 2025-09-23 Pengcheng Li , Botao Zhao , Zuheng Kang , Junqing Peng , Xiaoyang Qu , Yayun He , Jianzong Wang

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates significant potential in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing RLVR methods are often constrained by issues such as…

Artificial Intelligence · Computer Science 2026-01-14 Jinpeng Wang , Chao Li , Ting Ye , Mengyuan Zhang , Wei Liu , Jian Luan

In partially observable (PO) environments, deep reinforcement learning (RL) agents often suffer from unsatisfactory performance, since two problems need to be tackled together: how to extract information from the raw observations to solve…

Machine Learning · Computer Science 2019-12-25 Dongqi Han , Kenji Doya , Jun Tani

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

In drug-discovery-related tasks such as virtual screening, machine learning is emerging as a promising way to predict molecular properties. Conventionally, molecular fingerprints (numerical representations of molecules) are calculated…

Machine Learning · Computer Science 2019-11-13 Shion Honda , Shoi Shi , Hiroki R. Ueda

Reinforcement learning with verifiable rewards (RLVR) has emerged as the leading approach for enhancing reasoning capabilities in large language models. However, it faces a fundamental compute and memory asymmetry: rollout generation is…

Machine Learning · Computer Science 2026-04-23 Yixuan Even Xu , Yash Savani , Fei Fang , J. Zico Kolter

This work pioneers regret analysis of risk-sensitive reinforcement learning in partially observable environments with hindsight observation, addressing a gap in theoretical exploration. We introduce a novel formulation that integrates…

Machine Learning · Computer Science 2024-02-29 Tonghe Zhang , Yu Chen , Longbo Huang

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Reinforcement learning (RL) has become the dominant paradigm for improving the performance of language models on complex reasoning tasks. Despite the substantial empirical gains demonstrated by RL-based training methods like GRPO, a…

Artificial Intelligence · Computer Science 2025-10-27 Jiayu Wang , Yifei Ming , Zixuan Ke , Caiming Xiong , Shafiq Joty , Aws Albarghouthi , Frederic Sala