Computer Vision and Pattern Recognition · Computer Science
iLLaVA: An Image is Worth Fewer Than 1/3 Input Tokens in Large Multimodal Models
Lianyu Hu, Liqing Gao, Fanhua Shang, Liang Wan +1
2026-03-10
Computer Vision and Pattern Recognition · Computer Science
Rethinking Token Reduction for Large Vision-Language Models
Yi Wang, Haofei Zhang, Qihan Huang, Anda Cao +6
2026-03-24
Robotics · Computer Science
Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
Yujie Wei, Jiahan Fan, Jiyu Guo, Ruichen Zhen +4
2026-02-03
Machine Learning · Computer Science
Decoding Hidden Markov Models Faster Than Viterbi Via Online Matrix-Vector (max, +)-Multiplication
Massimo Cairo, Gabriele Farina, Romeo Rizzi
2015-12-14
Computation and Language · Computer Science
Chimera: A Lossless Decoding Method for Accelerating Large Language Models Inference by Fusing all Tokens
Ziqian Zeng, Jiahong Yu, Qianshi Pang, Zihao Wang +3
2024-04-19
Computer Vision and Pattern Recognition · Computer Science
FocusLLaVA: A Coarse-to-Fine Approach for Efficient and Effective Visual Token Compression
Yuke Zhu, Chi Xie, Shuang Liang, Bo Zheng +1
2024-11-22
Computation and Language · Computer Science
Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potential
Mohammad Samragh, Arnav Kundu, David Harrison, Kumari Nishu +3
2025-07-17
Computer Vision and Pattern Recognition · Computer Science
ST$^3$: Accelerating Multimodal Large Language Model by Spatial-Temporal Visual Token Trimming
Jiedong Zhuang, Lu Lu, Ming Dai, Rui Hu +3
2024-12-31
Computation and Language · Computer Science
On Speculative Decoding for Multimodal Large Language Models
Mukul Gagrani, Raghavv Goel, Wonseok Jeon, Junyoung Park +2
2024-04-16
Computation and Language · Computer Science
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang +1
2023-12-07
Audio and Speech Processing · Electrical Eng. & Systems
Faster Speech-LLaMA Inference with Multi-token Prediction
Desh Raj, Gil Keren, Junteng Jia, Jay Mahadeokar +1
2024-09-13
Computer Vision and Pattern Recognition · Computer Science
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections
Roy Miles, Pradyumna Reddy, Ismail Elezi, Jiankang Deng
2024-10-22
Computer Vision and Pattern Recognition · Computer Science
LLaVA-Mini: Efficient Image and Video Large Multimodal Models with One Vision Token
Shaolei Zhang, Qingkai Fang, Zhe Yang, Yang Feng
2025-03-04
Computer Vision and Pattern Recognition · Computer Science
Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters
Kevin Y. Li, Sachin Goyal, Joao D. Semedo, J. Zico Kolter
2025-04-22
Computation and Language · Computer Science
SPEED: Speculative Pipelined Execution for Efficient Decoding
Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, Hasan Genc +3
2024-01-04
Computer Vision and Pattern Recognition · Computer Science
LightVLM: Acceleraing Large Multimodal Models with Pyramid Token Merging and KV Cache Compression
Lianyu Hu, Fanhua Shang, Wei Feng, Liang Wan
2025-09-03
Computer Vision and Pattern Recognition · Computer Science
Stateful Token Reduction for Long-Video Hybrid VLMs
Jindong Jiang, Amala Sanjay Deshmukh, Kateryna Chumachenko, Karan Sapra +6
2026-03-03
Computer Vision and Pattern Recognition · Computer Science
TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model
Cheng Yang, Yang Sui, Jinqi Xiao, Lingyi Huang +7
2025-04-01
Computation and Language · Computer Science
Vocabulary Customization for Efficient Domain-Specific LLM Deployment
Christian Herold, Michael Kozielski, Nicholas Santavas, Yannick Versley +1
2025-10-01
Computation and Language · Computer Science
L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compression
Junxuan Zhang, Zhengxue Cheng, Yan Zhao, Shihao Wang +3
2024-12-25
Computer Vision and Pattern Recognition · Computer Science
Towards Lossless Ultimate Vision Token Compression for VLMs
Dehua Zheng, Mouxiao Huang, Borui Jiang, Hailin Hu +1
2025-12-11