English
Related papers

Related papers: HermesFlow: Seamlessly Closing the Gap in Multimod…

200 papers

Large language models (LLMs) have shown great success in text modeling tasks across domains. However, natural language exhibits inherent semantic hierarchies and nuanced geometric structure, which current LLMs do not capture completely…

Machine Learning · Computer Science 2025-11-07 Neil He , Rishabh Anand , Hiren Madhu , Ali Maatouk , Smita Krishnaswamy , Leandros Tassiulas , Menglin Yang , Rex Ying

Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanced generative…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Preference-conditioned image generation seeks to adapt generative models to individual users, producing outputs that reflect personal aesthetic choices beyond the given textual prompt. Despite recent progress, existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenyi Mo , Tianyu Zhang , Yalong Bai , Ligong Han , Ying Ba , Dimitris N. Metaxas

Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-level semantic focus…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Ruowen Zhao , Bangguo Li , Zuyan Liu , Yinan Liang , Junliang Ye , Fangfu Liu , Diankun Wu , Zhengyi Wang , Xumin Yu , Yongming Rao , Han Hu , Jun Zhu

With the bloom of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) that incorporate LLMs with pre-trained vision models have recently demonstrated impressive performance across diverse vision-language tasks. However,…

Computation and Language · Computer Science 2026-01-13 Ziyue Wang , Chi Chen , Yiqi Zhu , Fuwen Luo , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Maosong Sun , Yang Liu

Unsupervised Reinforcement Learning from Internal Feedback (RLIF) has emerged as a promising paradigm for eliciting the latent capabilities of Large Language Models (LLMs) without external supervision. However, current methods rely on…

Computation and Language · Computer Science 2026-05-26 Ruishuo Chen , Yu Chen , Zhuoran Li , Longbo Huang

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

Autoregressive video generation has improved rapidly in visual fidelity and interactivity, but it still suffers from long-term inconsistency and memory degradation. Most existing solutions either compress historical frames using predefined…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinzhuo Liu , Jiangning Zhang , Wencan Jiang , Yabiao Wang , Dingkang Liang , Zhucun Xue , Ran Yi , Yong Liu

We introduce OmniFlow, a novel generative model designed for any-to-any generation tasks such as text-to-image, text-to-audio, and audio-to-image synthesis. OmniFlow advances the rectified flow (RF) framework used in text-to-image models to…

Understanding of video creativity and content often varies among individuals, with differences in focal points and cognitive levels across different ages, experiences, and genders. There is currently a lack of research in this area, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Minghui Wu , Chenxu Zhao , Anyang Su , Donglin Di , Tianyu Fu , Da An , Min He , Ya Gao , Meng Ma , Kun Yan , Ping Wang

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

Large language models (LLMs) have been widely applied to emotional support conversation (ESC). However, complex multi-turn support remains challenging.This is because existing alignment schemes rely on sparse outcome-level signals, thus…

Computation and Language · Computer Science 2026-04-30 Chenghui Zou , Ning Wang , Tiesunlong Shen , Luwei Xiao , Chuan Ma , Xiangpeng Li , Rui Mao , Erik Cambria

Generative modeling has emerged as a powerful paradigm for representation learning, but its direct applicability to challenging fields like medical imaging remains limited: mere generation, without task alignment, fails to provide a robust…

Machine Learning · Computer Science 2025-10-28 Luca Caldera , Giacomo Bottacini , Lara Cavinato

Understanding and predicting object motion from egocentric video is fundamental to embodied perception and interaction. However, generating physically consistent 6DoF trajectories remains challenging due to occlusions, fast motion, and the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Abhishek Saroha , Huajian Zeng , Xingxing Zuo , Daniel Cremers , Xi Wang

There is growing interest in integrating high-fidelity visual synthesis capabilities into large language models (LLMs) without compromising their strong reasoning capabilities. Existing methods that directly train LLMs or bridge LLMs and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Han Lin , Jaemin Cho , Amir Zadeh , Chuan Li , Mohit Bansal

Large Language Models (LLMs) have been increasingly studied as neural knowledge bases for supporting knowledge-intensive applications such as question answering and fact checking. However, the structural organization of their knowledge…

Machine Learning · Computer Science 2026-01-16 Utkarsh Sahu , Zhisheng Qi , Mahantesh Halappanavar , Nedim Lipka , Ryan A. Rossi , Franck Dernoncourt , Yu Zhang , Yao Ma , Yu Wang

Aligning Large Language Models (LLMs) with the diverse spectrum of human values remains a central challenge: preference-based methods often fail to capture deeper motivational principles. Value-based approaches offer a more principled path,…

Artificial Intelligence · Computer Science 2026-02-04 Woojin Kim , Sieun Hyeon , Jusang Oh , Jaeyoung Do

Generative machine learning has emerged as a powerful tool for design representation and exploration. However, its application is often constrained by the need for large datasets of existing designs and the lack of interpretability about…

Machine Learning · Computer Science 2025-08-13 Eric Seng , Hugh O'Connor , Adam Boyce , Josh J. Bailey , Anton van Beek

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Such approaches depend on large-scale parameter updates, are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Abhishek Dalvi , Vasant Honavar