English
Related papers

Related papers: DODO: Discrete OCR Diffusion Models

200 papers

We present DeepSeek-OCR as an initial investigation into the feasibility of compressing long contexts via optical 2D mapping. DeepSeek-OCR consists of two components: DeepEncoder and DeepSeek3B-MoE-A570M as the decoder. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Haoran Wei , Yaofeng Sun , Yukun Li

Visual Document Retrieval (VDR) typically operates as text-to-image retrieval using specialized bi-encoders trained to directly embed document images. We revisit a zero-shot generate-and-encode pipeline: a vision-language model first…

Information Retrieval · Computer Science 2025-09-22 Thong Nguyen , Yibin Lei , Jia-Huei Ju , Andrew Yates

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) models for language modeling, allowing flexible generation order and parallel generation of multiple tokens. However, this flexibility…

Machine Learning · Computer Science 2026-03-24 Changxiao Cai , Gen Li

Spelling correction from visual input poses unique challenges for vision language models (VLMs), as it requires not only detecting but also correcting textual errors directly within images. We present ReViCo (Real Visual Correction), the…

Computation and Language · Computer Science 2025-09-23 Junhong Liang , Bojun Zhang

Billions of public domain documents remain trapped in hard copy or lack an accurate digitization. Modern natural language processing methods cannot be used to index, retrieve, and summarize their texts; conduct computational textual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Tom Bryan , Jacob Carlson , Abhishek Arora , Melissa Dell

Diffusion-based multimodal large language models (Diffusion MLLMs) have recently demonstrated impressive non-autoregressive generative capabilities across vision-and-language tasks. However, Diffusion MLLMs exhibit substantially slower…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Shuochen Chang , Xiaofeng Zhang , Qingyang Liu , Li Niu

To fully understand the 3D context of a single image, a visual system must be able to segment both the visible and occluded regions of objects, while discerning their occlusion order. Ideally, the system should be able to handle any object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Jiayang Ao , Qiuhong Ke , Krista A. Ehinger

Object level hallucination remains a central reliability challenge for vision language models (VLMs), particularly in binary object existence verification. Existing benchmarks emphasize aggregate accuracy but rarely disentangle whether…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 JiYang Wang , Jiawei Chen , Mengqi Xiao , Yu Cheng , Yangfu Li , Zhaoxia Yin

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 MinHyuk Jang , Youngdong Jang , JaeHyeok Lee , Feng Yang , Gyeongrok Oh , Jongheon Jeong , Sangpil Kim

Diffusion Transformers (DiTs) have achieved state-of-the-art (SOTA) image generation quality but suffer from high latency and memory inefficiency, making them difficult to deploy on resource-constrained devices. One major efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Haoran You , Connelly Barnes , Yuqian Zhou , Yan Kang , Zhenbang Du , Wei Zhou , Lingzhi Zhang , Yotam Nitzan , Xiaoyang Liu , Zhe Lin , Eli Shechtman , Sohrab Amirghodsi , Yingyan Celine Lin

Diffusion language models offer parallel token generation and inherent bidirectionality, promising more efficient and powerful sequence modeling compared to autoregressive approaches. However, state-of-the-art diffusion models (e.g., Dream…

Computation and Language · Computer Science 2025-10-10 Zhanqiu Hu , Jian Meng , Yash Akhauri , Mohamed S. Abdelfattah , Jae-sun Seo , Zhiru Zhang , Udit Gupta

Diffusion Language Models (DLMs) have recently emerged as a strong alternative to autoregressive language models (LMs). DLMs offer comparable accuracy with faster inference speed via parallel decoding. However, standard DLM decoding…

Machine Learning · Computer Science 2025-11-27 Hengyu Fu , Baihe Huang , Virginia Adams , Charles Wang , Venkat Srinivasan , Jiantao Jiao

Depth of field is an important factor of imaging systems that highly affects the quality of the acquired spatial information. Extended depth of field (EDoF) imaging is a challenging ill-posed problem and has been extensively addressed in…

Image and Video Processing · Electrical Eng. & Systems 2020-05-27 Ugur Akpinar , Erdem Sahin , Monjurul Meem , Rajesh Menon , Atanas Gotchev

Various imaging techniques have significantly enhanced our ability to visualize objects embedded within complex media such as biological tissues, fog, atmosphere, or various turbid media. Optical imaging, in particular, offers multiple…

Optics · Physics 2025-05-05 Mingwei He , Sujit K. Sahoo , Chengyuan Xiao , Cuong Dang

Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bottleneck. Diffusion VLMs offer a more parallel decoding paradigm, yet directly converting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Baoyou Chen , Hanchen Xia , Peng Tu , Haojun Shi , Liwei Zhang , Weihao Yuan , Siyu Zhu

End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language…

Robotics · Computer Science 2025-09-25 Pengxiang Li , Yinan Zheng , Yue Wang , Huimin Wang , Hang Zhao , Jingjing Liu , Xianyuan Zhan , Kun Zhan , Xianpeng Lang

Autoregressive (AR) models remain the standard for natural language generation but still suffer from high latency due to strictly sequential decoding. Recent diffusion-inspired approaches, such as LlaDA and Dream, mitigate this by…

Computation and Language · Computer Science 2025-10-16 Qinglin Zhu , Yizhen Yao , Runcong Zhao , Yanzheng Xiang , Amrutha Saseendran , Chen Jin , Philip Teare , Bin Liang , Yulan He , Lin Gui

Conditioning image generation facilitates seamless editing and the creation of photorealistic images. However, conditioning on noisy or Out-of-Distribution (OoD) images poses significant challenges, particularly in balancing fidelity to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Bastien van Delft , Tommaso Martorella , Alexandre Alahi

Document parsing has garnered widespread attention as vision-language models (VLMs) advance OCR capabilities. However, the field remains fragmented across dozens of specialized models with varying strengths, forcing users to navigate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Hao Feng , Wei Shi , Ke Zhang , Xiang Fei , Lei Liao , Dingkang Yang , Yongkun Du , Xuecheng Wu , Jingqun Tang , Yang Liu , Hong Chen , Can Huang