English
Related papers

Related papers: MMEmb-R1: Reasoning-Enhanced Multimodal Embedding …

200 papers

Multimodal Large Language Models (MLLMs) perform well in single-image visual grounding but struggle with real-world tasks that demand cross-image reasoning and multi-modal instructions. To address this, we adopt a reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bob Zhang , Haoran Li , Tao Zhang , Jianan Li , Cilin Yan , Xikai Liu , Jiayin Cai , Yanbin Hao

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

While large language models demonstrate remarkable capabilities across numerous domains, social intelligence - the capacity to perceive social cues, infer mental states, and generate appropriate responses - remains a critical challenge,…

Artificial Intelligence · Computer Science 2026-03-11 Jincenzi Wu , Yuxuan Lei , Jianxun Lian , Yitian Huang , Lexin Zhou , Haotian Li , Xing Xie , Helen Meng

While large language models show promise in medical applications, achieving expert-level clinical reasoning remains challenging due to the need for both accurate answers and transparent reasoning processes. To address this challenge, we…

Machine Learning · Computer Science 2025-09-22 Chi Liu , Derek Li , Yan Shu , Robin Chen , Derek Duan , Teng Fang , Bryan Dai

Recent advancements in building domain-specific large language models (LLMs) have shown remarkable success, especially in tasks requiring reasoning abilities like logical inference over complex relationships and multi-step problem solving.…

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Embedding models have been crucial in enabling various downstream tasks such as semantic similarity, information retrieval, and clustering. Recently, there has been a surge of interest in developing universal text embedding models that can…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Ziyan Jiang , Rui Meng , Xinyi Yang , Semih Yavuz , Yingbo Zhou , Wenhu Chen

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

Machine Learning · Computer Science 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Recent advancements in large language models (LLMs) have led to remarkable performance across a wide range of language understanding and mathematical tasks. As a result, increasing attention has been given to assessing the true reasoning…

Computation and Language · Computer Science 2025-03-14 Jonas Golde , Patrick Haller , Fabio Barth , Alan Akbik

Sequential Recommender Systems (SRS), which model a user's interaction history to predict the next item of interest, are widely used in various applications. However, existing SRS often struggle with low-popularity items, a challenge known…

Information Retrieval · Computer Science 2024-12-24 Qidong Liu , Xian Wu , Wanyu Wang , Yejing Wang , Yuanshao Zhu , Xiangyu Zhao , Feng Tian , Yefeng Zheng

Multimodal retrieval over text corpora remains a fundamental challenge: the best vision-language encoder achieves only 27.6 nDCG@10 on MM-BRIGHT, a reasoning-intensive multimodal retrieval benchmark, underperforming strong text-only…

Embodied navigation requires agents to integrate perception, reasoning, and action for robust interaction in complex 3D environments. Existing approaches often suffer from incoherent and unstable reasoning traces that hinder generalization…

Robotics · Computer Science 2025-09-16 Qingxiang Liu , Ting Huang , Zeyu Zhang , Hao Tang

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Large language models (LLMs) have shown an impressive ability to perform tasks believed to require thought processes. When the model does not document an explicit thought process, it becomes difficult to understand the processes occurring…

Computation and Language · Computer Science 2024-06-21 Yuval Shalev , Amir Feder , Ariel Goldstein
‹ Prev 1 8 9 10 Next ›