中文
相关论文

相关论文: Multimodal Large Language Model is a Human-Aligned…

200 篇论文

Image tagging, a fundamental vision task, traditionally relies on human-annotated datasets to train multi-label classifiers, which incurs significant labor and costs. While Multimodal Large Language Models (MLLMs) offer promising potential…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Ming-Kun Xie , Jia-Hao Xiao , Zhiqiang Kou , Zhongnian Li , Gang Niu , Masashi Sugiyama

Common image editing tasks typically adopt powerful generative diffusion models as the leading paradigm for real-world content editing. Meanwhile, although reinforcement learning (RL) methods such as Diffusion-DPO and Flow-GRPO have further…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Fan Li , Chonghuinan Wang , Lina Lei , Yuping Qiu , Jiaqi Xu , Jiaxiu Jiang , Xinran Qin , Zhikai Chen , Fenglong Song , Zhixin Wang , Renjing Pei , Wangmeng Zuo

With the rapid adoption of multimodal large language models (MLLMs) across diverse applications, there is a pressing need for task-centered, high-quality training data. A key limitation of current training datasets is their reliance on…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xiaoyu Lin , Aniket Ghorpade , Hansheng Zhu , Justin Qiu , Dea Rrozhani , Monica Lama , Mick Yang , Zixuan Bian , Ruohan Ren , Alan B. Hong , Jiatao Gu , Chris Callison-Burch

Deep generative models have the capacity to render high fidelity images of content like human faces. Recently, there has been substantial progress in conditionally generating images with specific quantitative attributes, like the emotion…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Alec Helbling , Christopher J. Rozell , Matthew O'Shaughnessy , Kion Fallah

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Establishing stable mappings between natural language expressions and visual percepts is a foundational problem for both cognitive science and artificial intelligence. Humans routinely ground linguistic reference in noisy, ambiguous…

人工智能 · 计算机科学 2026-02-24 Joseph Bingham

Video generation models have achieved remarkable progress in text-to-video tasks. These models are typically trained on text-video pairs with highly detailed and carefully crafted descriptions, while real-world user inputs during inference…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Jiale Cheng , Ruiliang Lyu , Xiaotao Gu , Xiao Liu , Jiazheng Xu , Yida Lu , Jiayan Teng , Zhuoyi Yang , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Recent advances in Multimodal Large Language Models (MLLMs) have enabled automated generation of structured layouts from natural language descriptions. Existing methods typically follow a code-only paradigm that generates code to represent…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Junrong Guo , Shancheng Fang , Yadong Qu , Hongtao Xie

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Video-and-language pre-training has shown promising improvements on various downstream tasks. Most previous methods capture cross-modal interactions with a transformer-based multimodal encoder, not fully addressing the misalignment between…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Dongxu Li , Junnan Li , Hongdong Li , Juan Carlos Niebles , Steven C. H. Hoi

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

计算与语言 · 计算机科学 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Multimodal large language models (MLLMs) have shown remarkable capabilities, yet their performance is often capped by the coarse nature of existing alignment techniques. A critical bottleneck remains the lack of effective reward models…

计算与语言 · 计算机科学 2026-02-03 Zicheng Kong , Dehua Ma , Zhenbo Xu , Alven Yang , Yiwei Ru , Haoran Wang , Zixuan Zhou , Fuqing Bie , Liuyu Xiang , Huijia Wu , Jian Zhao , Zhaofeng He

As Large Language Model (LLM) capabilities advance, the demand for high-quality annotation of exponentially increasing text corpora has outpaced human capacity, leading to the widespread adoption of LLMs in automatic evaluation and…

计算与语言 · 计算机科学 2026-04-02 Jiayu Wang , Junyoung Lee

Recent advances in Large Language Models (LLMs) have opened new avenues for sequential recommendation by enabling natural language reasoning over user behavior sequences. A common approach formulates recommendation as a language modeling…

信息检索 · 计算机科学 2026-04-08 Yu Wang , Yonghui Yang , Le Wu , Yi Zhang , Fei Liu , Richang Hong

Large Language Models integrating textual and visual inputs have introduced new possibilities for interpreting complex data. Despite their remarkable ability to generate coherent and contextually relevant text based on visual stimuli, the…

人机交互 · 计算机科学 2025-01-08 Giulio Antonio Abbo , Tony Belpaeme

With recent advancements in Large Multimodal Models (LMMs) across various domains, a novel prompting method called visual referring prompting has emerged, showing significant potential in enhancing human-computer interaction within…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Zongjie Li , Chaozheng Wang , Chaowei Liu , Pingchuan Ma , Daoyuan Wu , Shuai Wang , Cuiyun Gao

The integration of generative artificial intelligence (AI) into architectural design has advanced significantly, enabling the generation of text, images, and 3D models. However, prior AI applications lack support for text-to-parametric…

人机交互 · 计算机科学 2025-05-20 Guangxi Feng , Wei Yan

Advancements in Natural Language Processing (NLP), have led to the emergence of Large Language Models (LLMs) such as GPT, Llama, Claude, and Gemini, which excel across a range of tasks but require extensive fine-tuning to align their…

计算与语言 · 计算机科学 2025-04-01 Angela Lopez-Cardona , Carlos Segura , Alexandros Karatzoglou , Sergi Abadal , Ioannis Arapakis

Descriptive Multimodal Emotion Recognition (DMER) has garnered increasing research attention. Unlike traditional discriminative paradigms that rely on predefined emotion taxonomies, DMER aims to describe human emotional state using…

人机交互 · 计算机科学 2025-09-29 Zheng Lian , Licai Sun , Lan Chen , Haoyu Chen , Zebang Cheng , Fan Zhang , Ziyu Jia , Ziyang Ma , Fei Ma , Xiaojiang Peng , Jianhua Tao