English
Related papers

Related papers: IntuiTF: MLLM-Guided Transfer Function Optimizatio…

200 papers

Spatial filtering with a desired directivity pattern is advantageous for many audio applications. In this work, we propose neural directional filtering with user-defined directivity patterns (UNDF), which enables spatial filtering based on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-24 Weilong Huang , Srikanth Raj Chetupalli , Emanuël A. P. Habets

Image-text matching (ITM) aims to address the fundamental challenge of aligning visual and textual modalities, which inherently differ in their representations, continuous, high-dimensional image features vs. discrete, structured text. We…

Multimedia · Computer Science 2025-07-14 Junyu Chen , Yihua Gao , Mingyong Li

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most…

Machine Learning · Computer Science 2026-04-21 Seerat Kaur , Sukhjit Singh Sehra , Dariush Ebrahimi

Transforming a large language model (LLM) into a Vision-Language Model (VLM) can be achieved by mapping the visual tokens from a vision encoder into the embedding space of an LLM. Intriguingly, this mapping can be as simple as a shallow MLP…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Benno Krojer , Shravan Nayak , Oscar Mañas , Vaibhav Adlakha , Desmond Elliott , Siva Reddy , Marius Mosbach

Spatial reasoning in 3D scenes requires precise geometric calculations that challenge vision-language models. Visual programming addresses this by decomposing problems into steps calling specialized tools, yet existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Shengguang Wu , Xiaohan Wang , Yuhui Zhang , Hao Zhu , Serena Yeung-Levy

While Vision-Language Models (VLMs) excel in many areas, they struggle with complex spatial reasoning, which requires problem decomposition and strategic tool use. Fine-tuning smaller, more deployable models offers an efficient path to…

Machine Learning · Computer Science 2025-11-04 Gio Huh , Dhruv Sheth , Rayhan Zirvi , Frank Xiao

In modern computer vision, the optimal representation of 3D shape continues to be task-dependent. One fundamental operation applied to such representations is differentiable rendering, as it enables inverse graphics approaches in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

Software Engineering · Computer Science 2026-04-13 Sebastian Lubos , Alexander Felfernig , Damian Garber , Gerhard Leitner , Julian Schwazer , Manuel Henrich

We introduce a general, scalable computational framework for multi-axis 3D printing based on implicit neural fields (INFs) that unifies all stages of toolpath generation and global collision-free motion planning. In our pipeline, input…

Robotics · Computer Science 2025-09-09 Jiasheng Qu , Zhuo Huang , Dezhao Guo , Hailin Sun , Aoran Lyu , Chengkai Dai , Yeung Yam , Guoxin Fang

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Xiaoxiao Long , Cheng Lin , Lingjie Liu , Yuan Liu , Peng Wang , Christian Theobalt , Taku Komura , Wenping Wang

Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively…

Machine Learning · Computer Science 2026-04-10 Sikai Bai , Haoxi Li , Jie Zhang , Yongjiang Liu , Song Guo

Image-Language Foundation Models (ILFMs) have demonstrated remarkable success in vision-language understanding, providing transferable multimodal representations that generalize across diverse downstream image-based tasks. The advancement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jinxuan Li , Chaolei Tan , Haoxuan Chen , Jianxin Ma , Jian-Fang Hu , Jianhuang Lai , Wei-Shi Zheng

While model serving has unlocked unprecedented capabilities, the high cost of serving large-scale models continues to be a significant barrier to widespread accessibility and rapid innovation. Compiler optimizations have long driven…

Machine Learning · Computer Science 2026-02-05 Annabelle Sujun Tang , Christopher Priebe , Rohan Mahapatra , Lianhui Qin , Hadi Esmaeilzadeh

In recent years, the introduction of Multi-modal Large Language Models (MLLMs) into video understanding tasks has become increasingly prevalent. However, how to effectively integrate temporal information remains a critical research focus.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Xiaoyi Bao , Chenwei Xie , Hao Tang , Tingyu Weng , Xiaofeng Wang , Yun Zheng , Xingang Wang

Test-time adaptation paradigm provides flexibility towards domain shifts by performing immediate adaptation on unlabeled target data from the source model. Vision-Language Models (VLMs) leverage their generalization capabilities for diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jisu Han , Wonjun Hwang

The integration of visual inputs with large language models (LLMs) has led to remarkable advancements in multi-modal capabilities, giving rise to visual large language models (VLLMs). However, effectively harnessing VLLMs for intricate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Renjie Pi , Lewei Yao , Jiahui Gao , Jipeng Zhang , Tong Zhang

Volumetric visualization has long been dominated by Direct Volume Rendering (DVR), which operates on dense voxel grids and suffers from limited scalability as resolution and interactivity demands increase. Recent advances in 3D Gaussian…

Graphics · Computer Science 2026-04-15 Yuxuan Wang , Qibiao Li , Youcheng Cai

Precise 3D environmental mapping is pivotal in robotics. Existing methods often rely on predefined concepts during training or are time-intensive when generating semantic maps. This paper presents Open-Fusion, a groundbreaking approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Kashu Yamazaki , Taisei Hanyu , Khoa Vo , Thang Pham , Minh Tran , Gianfranco Doretto , Anh Nguyen , Ngan Le

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but they continue to struggle with spatial understanding. Existing spatial MLLMs often rely on explicit 3D inputs or architecture-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hunar Batra , Haoqin Tu , Hardy Chen , Yuanze Lin , Cihang Xie , Ronald Clark

Fine-tuning large language models (LLMs) is essential for enhancing their performance on specific tasks but is often resource-intensive due to redundant or uninformative data. To address this inefficiency, we introduce DELIFT (Data…

Computation and Language · Computer Science 2025-03-21 Ishika Agarwal , Krishnateja Killamsetty , Lucian Popa , Marina Danilevksy