中文
相关论文

相关论文: Radiology Report Generation via Multi-objective Pr…

200 篇论文

Aligning Large Language Models (LLMs) with human preferences is crucial, but standard methods like Reinforcement Learning from Human Feedback (RLHF) are often complex and unstable. In this work, we propose a new, simpler approach that…

机器学习 · 计算机科学 2026-01-27 Saeed Najafi , Alona Fyshe

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

计算与语言 · 计算机科学 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Chang Liu , Yuanhe Tian , Yan Song

Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. In multi-objective reinforcement learning (MORL), one widely studied approach} addresses…

机器学习 · 计算机科学 2026-04-28 Ying-Tu Chen , Wei Hung , Bing-Shu Wu , Zhang-Wei Hong , Ping-Chun Hsieh

Radiology report generation (RRG) aims to automatically produce clinically faithful reports from chest X-ray images. Prevailing work typically follows a scale-driven paradigm, by multi-stage training over large paired corpora and oversized…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zhuoxiao Chen , Hongyang Yu , Ying Xu , Yadan Luo , Long Duong , Yuan-Fang Li

Multimodal large language models (MLLMs) have shown remarkable capabilities, yet their performance is often capped by the coarse nature of existing alignment techniques. A critical bottleneck remains the lack of effective reward models…

计算与语言 · 计算机科学 2026-02-03 Zicheng Kong , Dehua Ma , Zhenbo Xu , Alven Yang , Yiwei Ru , Haoran Wang , Zixuan Zhou , Fuqing Bie , Liuyu Xiang , Huijia Wu , Jian Zhao , Zhaofeng He

Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Zijian Zhou , Miaojing Shi , Meng Wei , Oluwatosin Alabi , Zijie Yue , Tom Vercauteren

Recent reinforcement learning (RL) approaches have advanced radiology report generation (RRG), yet two core limitations persist: (1) report-level rewards offer limited evidence-grounded guidance for clinical faithfulness; and (2) current…

机器学习 · 计算机科学 2026-04-16 Qin Zhou , Guoyan Liang , Qianyi Yang , Jingyuan Chen , Sai Wu , Chang Yao , Zhe Wang

Reinforcement Learning (RL) has emerged as a powerful tool for neural combinatorial optimization, enabling models to learn heuristics that solve complex problems without requiring expert knowledge. Despite significant progress, existing RL…

机器学习 · 计算机科学 2025-05-14 Mingjun Pan , Guanquan Lin , You-Wei Luo , Bin Zhu , Zhien Dai , Lijun Sun , Chun Yuan

Large language models (LLMs) have shown great potential in natural language processing tasks, but their application to machine translation (MT) remains challenging due to pretraining on English-centric data and the complexity of…

计算与语言 · 计算机科学 2025-01-24 Guofeng Cui , Pichao Wang , Yang Liu , Zemian Ke , Zhu Liu , Vimal Bhat

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li

Existing multi-objective preference alignment methods for large language models (LLMs) face limitations: (1) the inability to effectively balance various preference dimensions, and (2) reliance on auxiliary reward/reference models…

机器学习 · 计算机科学 2025-06-10 Qi Liu , Jingqing Ruan , Hao Li , Haodong Zhao , Desheng Wang , Jiansong Chen , Wan Guanglu , Xunliang Cai , Zhi Zheng , Tong Xu

Aligning generative models with human preference via RLHF typically suffers from overoptimization, where an imperfectly learned reward model can misguide the generative model to output undesired responses. We investigate this problem in a…

机器学习 · 计算机科学 2024-12-05 Zhihan Liu , Miao Lu , Shenao Zhang , Boyi Liu , Hongyi Guo , Yingxiang Yang , Jose Blanchet , Zhaoran Wang

Reinforcement learning (RL) has demonstrated remarkable success in text and image generation, yet its potential in 3D generation remains largely unexplored. Existing attempts typically rely on offline direct preference optimization (DPO)…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Zhen Zhou , Jian Liu , Biwen Lei , Jing Xu , Haohan Weng , Yiling Zhu , Zhuo Chen , Junfeng Fan , Yunkai Ma , Dazhao Du , Song Guo , Fengshui Jing , Chunchao Guo

Radiology report generation requires advanced medical image analysis, effective temporal reasoning, and accurate text generation. Although recent innovations, particularly multimodal large language models, have shown improved performance,…

计算与语言 · 计算机科学 2025-11-11 Kai Zhang , Christopher Malon , Lichao Sun , Martin Renqiang Min

Fine-tuning is integral for aligning large language models (LLMs) with human preferences. Multiple-Reference Preference Optimization (MRPO) builds on Direct Preference Optimization (DPO) by fine-tuning LLMs on preference datasets while…

机器学习 · 计算机科学 2025-12-12 Skyler Wu , Aymen Echarghaoui

Recent advancements in Large Language Models (LLMs) have been remarkable, with new models consistently surpassing their predecessors. These advancements are underpinned by extensive research on various training mechanisms. Among these,…

计算与语言 · 计算机科学 2024-12-12 Hansle Gwon , Imjin Ahn , Young-Hak Kim , Sanghyun Park , Tae Joon Jun

How can Large Language Models (LLMs) be aligned with human intentions and values? A typical solution is to gather human preference on model outputs and finetune the LLMs accordingly while ensuring that updates do not deviate too far from a…

计算与语言 · 计算机科学 2024-05-28 Hung Le , Quan Tran , Dung Nguyen , Kien Do , Saloni Mittal , Kelechi Ogueji , Svetha Venkatesh

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Phillip Sloan , Philip Clatworthy , Edwin Simpson , Majid Mirmehdi

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates significant potential in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing RLVR methods are often constrained by issues such as…

人工智能 · 计算机科学 2026-01-14 Jinpeng Wang , Chao Li , Ting Ye , Mengyuan Zhang , Wei Liu , Jian Luan