English
Related papers

Related papers: StructuredDNA: A Bio-Physical Framework for Energy…

200 papers

Exploiting sparsity in deep neural networks (DNNs) has been a promising area for meeting the growing computation requirements. To minimize the overhead of sparse acceleration, hardware designers have proposed structured sparsity support,…

Machine Learning · Computer Science 2025-05-27 Geonhwa Jeong , Po-An Tsai , Abhimanyu R. Bambhaniya , Stephen W. Keckler , Tushar Krishna

As the global need for large-scale data storage is rising exponentially, existing storage technologies are approaching their theoretical and functional limits in terms of density and energy consumption, making DNA based storage a potential…

Emerging Technologies · Computer Science 2021-10-12 Yotam Nahum , Eyar Ben-Tolila , Leon Anavy

Addressing the resource waste caused by fixed computation paradigms in deep learning models under dynamic scenarios, this paper proposes a Transformer$^{-1}$ architecture based on the principle of deep adaptivity. This architecture achieves…

Machine Learning · Computer Science 2025-01-29 Lumen AI , Tengzhou No. 1 Middle School , Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Xu Tianhao

Structured documents analysis and recognition are essential for modern online on-boarding processes, and document localization is a crucial step to achieve reliable key information extraction. While deep-learning has become the standard…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Anastasiia Kabeshova , Guillaume Betmont , Julien Lerouge , Evgeny Stepankevich , Alexis Bergès

Weight pruning is among the most popular approaches for compressing deep convolutional neural networks. Recent work suggests that in a randomly initialized deep neural network, there exist sparse subnetworks that achieve performance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Vinay Kumar Verma , Nikhil Mehta , Shijing Si , Ricardo Henao , Lawrence Carin

The remarkable performance of deep Convolutional neural networks (CNNs) is generally attributed to their deeper and wider architectures, which can come with significant computational costs. Pruning neural networks has thus gained interest…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yang He , Lingao Xiao

This paper and accompanying Python and C++ Framework is the product of the authors perceived problems with narrow (Discrimination based) AI. (Artificial Intelligence) The Framework attempts to develop a genetic transfer of experience…

Neural and Evolutionary Computing · Computer Science 2026-04-23 Jamie Nicholas Shelley , Optishell Consultancy

Motivated by the needs from an airline crew scheduling application, we introduce structured convolutional kernel networks (Struct-CKN), which combine CKNs from Mairal et al. (2014) in a structured prediction framework that supports…

Machine Learning · Computer Science 2021-07-26 Yassine Yaakoubi , François Soumis , Simon Lacoste-Julien

Domain decomposition is a technique used to reduce memory overhead on large neutron transport problems. Currently, the optimal load-balanced processor allocation for these domains is typically determined through small-scale simulations of…

Computational Physics · Physics 2025-08-18 Alexander Mote , Todd Palmer , Lizhong Chen

The human brain utilizes spikes for information transmission and dynamically reorganizes its network structure to boost energy efficiency and cognitive capabilities throughout its lifespan. Drawing inspiration from this spike-based…

Human-Computer Interaction · Computer Science 2025-02-20 Jiangrong Shen , Qi Xu , Gang Pan , Badong Chen

Many countries are currently challenged with the extensive integration of renewable energy sources, which necessitates vast capacity expansion measures. These measures in turn require comprehensive power flow studies, which are often…

Optimization and Control · Mathematics 2019-09-26 Julia Sistermanns , Matthias Hotz , Dominic Hewes , Rolf Witzmann , Wolfgang Utschick

Weight pruning methods of DNNs have been demonstrated to achieve a good model pruning rate without loss of accuracy, thereby alleviating the significant computation/storage requirements of large-scale DNNs. Structured weight pruning methods…

Neural and Evolutionary Computing · Computer Science 2019-03-28 Tianyun Zhang , Shaokai Ye , Kaiqi Zhang , Xiaolong Ma , Ning Liu , Linfeng Zhang , Jian Tang , Kaisheng Ma , Xue Lin , Makan Fardad , Yanzhi Wang

For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two…

Machine Learning · Computer Science 2020-01-07 Colin Graber , Alexander Schwing

Deep learning has driven significant technological advancements, but its high energy consumption limits its use on battery-operated edge devices. Spiking Neural Networks (SNNs) offer promising reductions in inference-time energy…

Hardware Architecture · Computer Science 2026-04-21 Zhanglu Yan , Zhenyu Bai , Tulika Mitra , Weng-Fai Wong

We propose a novel interpretation technique to explain the behavior of structured output models, which learn mappings between an input vector to a set of output variables simultaneously. Because of the complex relationship between the…

Machine Learning · Computer Science 2025-08-12 S. Fatemeh Seyyedsalehi , Mahdieh Soleymani , Hamid R. Rabiee

Recently, there have been increasing demands to construct compact deep architectures to remove unnecessary redundancy and to improve the inference speed. While many recent works focus on reducing the redundancy by eliminating unneeded…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Eunwoo Kim , Chanho Ahn , Songhwai Oh

Structural DNA nanotechnology has advanced to the extent that extremely complex structures can be designed. Much of this advancement has been due to the development of automated DNA design and simulation tools. Typically, the tools (e.g.…

Biomolecules · Quantitative Biology 2021-12-01 Durham Smith , Grigory Tikhomirov

Recently, deep learning has made remarkable strides, especially with generative modeling, such as large language models and probabilistic diffusion models. However, training these models often involves significant computational resources,…

Machine Learning · Computer Science 2024-12-31 Lujia Zhong , Shuo Huang , Yonggang Shi

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Structure-Based drug design (SBDD) has emerged as a popular approach in drug discovery, leveraging three-dimensional protein structures to generate drug ligands. However, existing generative models encounter several key challenges: (1)…

Machine Learning · Computer Science 2025-11-27 Qingsong Zhong , Haomin Yu , Yan Lin , Wangmeng Shen , Long Zeng , Jilin Hu