English
Related papers

Related papers: DiTMoS: Delving into Diverse Tiny-Model Selection …

200 papers

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

Deep neural networks (DNNs) can easily be cheated by some imperceptible but purposeful noise added to images, and erroneously classify them. Previous defensive work mostly focused on retraining the models or detecting the noise, but has…

Artificial Intelligence · Computer Science 2024-05-31 Jing Wen

Training deep neural networks (DNNs) on edge devices has attracted increasing attention due to its potential to address challenges related to domain adaptation and privacy preservation. However, DNNs typically rely on large datasets for…

Machine Learning · Computer Science 2025-08-05 Boran Zhao , Haiduo Huang , Qiwei Dang , Wenzhe Zhao , Tian Xia , Pengju Ren

Diffusion Multi-modal Large Language Models (dMLLMs) have recently emerged as a novel architecture unifying image generation and understanding. However, developing effective and efficient Test-Time Scaling (TTS) methods to unlock their full…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yi Xin , Siqi Luo , Tianxiang Xu , Qi Qin , Haoxing Chen , Kaiwen Zhu , Zhiwei Zhang , Yangfan He , Rongchao Zhang , Jinbin Bai , Shuo Cao , Bin Fu , Junjun He , Yihao Liu , Yuewen Cao , Xiaohong Liu

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To avoid the huge…

Artificial Intelligence · Computer Science 2026-03-17 Mark Deutel , Simon Geis , Axel Plinge

Running deep neural networks on microcontroller units (MCUs) is severely constrained by limited memory resources. While TinyML techniques reduce model size and computation, they often fail in practice due to excessive peak Random Access…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Junyu Lu , Shashwath Suresh , Hao Liu , Qi Hong , Qing Wang

Neural networks and deep learning are changing the way that artificial intelligence is being done. Efficiently choosing a suitable network architecture and fine-tune its hyper-parameters for a specific dataset is a time-consuming task given…

Machine Learning · Computer Science 2019-05-16 David Laredo , Yulin Qin , Oliver Schütze , Jian-Qiao Sun

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Deep learning algorithms have shown tremendous success in many recognition tasks; however, these algorithms typically include a deep neural network (DNN) structure and a large number of parameters, which makes it challenging to implement…

Neural and Evolutionary Computing · Computer Science 2018-04-23 Shihui Yin , Gaurav Srivastava , Shreyas K. Venkataramanaiah , Chaitali Chakrabarti , Visar Berisha , Jae-sun Seo

Large Deep Neural Networks (DNNs) are the backbone of today's artificial intelligence due to their ability to make accurate predictions when being trained on huge datasets. With advancing technologies, such as the Internet of Things,…

Machine Learning · Computer Science 2023-07-14 Mark Deutel , Philipp Woller , Christopher Mutschler , Jürgen Teich

Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to…

Artificial Intelligence · Computer Science 2026-02-05 Zicheng Xu , Xiuyi Lou , Guanchu Wang , Yu-Neng Chuang , Feng Luo , Guangyao Zheng , Alexander S. Szalay , Zirui Liu , Vladimir Braverman

In this paper, we want to show the potential benefit of a dynamic auto-tuning approach for the inference process in the Deep Neural Network (DNN) context, tackling the object detection challenge. We benchmarked different neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Emanuele Vitali , Anton Lokhmotov , Gianluca Palermo

Among parallel decoding paradigms, diffusion large language models (dLLMs) have emerged as a promising candidate that balances generation quality and throughput. However, their integration with Mixture-of-Experts (MoE) architectures is…

Machine Learning · Computer Science 2026-02-03 Hao Mark Chen , Zhiwen Mo , Royson Lee , Qianzhou Wang , Da Li , Shell Xu Hu , Wayne Luk , Timothy Hospedales , Hongxiang Fan

Low-precision networks, with weights and activations quantized to low bit-width, are widely used to accelerate inference on edge devices. However, current solutions are uniform, using identical bit-width for all filters. This fails to…

Machine Learning · Computer Science 2020-04-14 Zhaowei Cai , Nuno Vasconcelos

Reconfigurable intelligent surface (RIS) is an emerging technology for improving performance in fifth-generation (5G) and beyond networks. Practically channel estimation of RIS-assisted systems is challenging due to the passive nature of…

Signal Processing · Electrical Eng. & Systems 2021-07-16 Nipuni Ginige , K. B. Shashika Manosha , Nandana Rajatheva , Matti Latva-aho

DTMM is a library designed for efficient deployment and execution of machine learning models on weak IoT devices such as microcontroller units (MCUs). The motivation for designing DTMM comes from the emerging field of tiny machine learning…

Machine Learning · Computer Science 2024-01-18 Lixiang Han , Zhen Xiao , Zhenjiang Li

Deep Neural Networks (DNNs) are increasingly deployed across diverse industries, driving demand for mobile device support. However, existing mobile inference frameworks often rely on a single processor per model, limiting hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Yunquan Gao , Zhiguo Zhang , Praveen Kumar Donta , Chinmaya Kumar Dehury , Xiujun Wang , Dusit Niyato , Qiyang Zhang

Multimodal deep learning (MDL) has achieved remarkable success across various domains, yet its practical deployment is often hindered by incomplete multimodal data. Existing incomplete MDL methods either discard missing modalities, risking…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Siyi Du , Xinzhe Luo , Declan P. O'Regan , Chen Qin

DNN+NeuroSim is an integrated framework to benchmark compute-in-memory (CIM) accelerators for deep neural networks, with hierarchical design options from device-level, to circuit-level and up to algorithm-level. A python wrapper is…

Emerging Technologies · Computer Science 2020-03-17 Xiaochen Peng , Shanshi Huang , Hongwu Jiang , Anni Lu , Shimeng Yu

Recently, neural architecture search (NAS) has been applied to automatically search high-performance networks for medical image segmentation. The NAS search space usually contains a network topology level (controlling connections among…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yufan He , Dong Yang , Holger Roth , Can Zhao , Daguang Xu