中文
相关论文

相关论文: Towards Efficient Calculation of Information Measu…

200 篇论文

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

机器学习 · 计算机科学 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

The concept of effective order is a popular methodology in the deterministic literature for the construction of efficient and accurate integrators for differential equations over long times. The idea is to enhance the accuracy of a…

数值分析 · 数学 2016-08-18 Gilles Vilmart

For decades, the Bj{\o}ntegaard Delta (BD) has been the metric for evaluating codec Rate-Distortion (R-D) performance. Yet, in most studies, BD is determined using just 4-5 R-D data points, could this be sufficient? As codecs and quality…

多媒体 · 计算机科学 2024-10-17 Xinyu Hang , Shenpeng Song , Zhimeng Huang , Chuanmin Jia , Siwei Ma , Wen Gao

This paper proposes a novel computationally efficient algorithm for optimal sizing of Battery Energy Storage Systems (BESS) considering renewable energy bidding strategies. Unlike existing two-stage methods, our algorithm enables the…

系统与控制 · 电气工程与系统科学 2026-02-24 Taiyo Mantani , Hikaru Hoshino , Tomonari Kanazawa , Eiko Furutani

Sequential Multiple-Assignment Randomized Trials (SMARTs) play an increasingly important role in psychological and behavioral health research. This experimental approach enables researchers to answer scientific questions about how to…

统计方法学 · 统计学 2023-06-21 John J. Dziak , Daniel Almirall , Walter Dempsey , Catherine Stanger , Inbal Nahum-Shani

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

人工智能 · 计算机科学 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

Model order reduction plays a crucial role in simplifying complex systems while preserving their essential dynamic characteristics, making it an invaluable tool in a wide range of applications, including robotic systems, signal processing,…

系统与控制 · 电气工程与系统科学 2025-04-22 Shenghan Mei , Ziqin He , Yidan Mei , Xin Mao , Anqi Dong , Ren Wang , Can Chen

Mathematical methods of step-by-step and combined shifts are proposed for experimental data processing to reconstruct the measuring system impulse response distorted by shift-invariant blur. Proposed methods base on direct non-blind…

信号处理 · 电气工程与系统科学 2019-01-24 Andrey V. Novikov-Borodin

We study the problem of supervised linear dimensionality reduction, taking an information-theoretic viewpoint. The linear projection matrix is designed by maximizing the mutual information between the projected signal and the class label…

机器学习 · 计算机科学 2012-07-03 Minhua Chen , William Carson , Miguel Rodrigues , Robert Calderbank , Lawrence Carin

Advanced optimization algorithms such as Newton method and AdaGrad benefit from second order derivative or second order statistics to achieve better descent directions and faster convergence rates. At their heart, such algorithms need to…

机器学习 · 计算机科学 2022-08-31 Yao Lu , Mehrtash Harandi , Richard Hartley , Razvan Pascanu

In recent years, there has been an upswing of interest in estimating information from data emerging in a lot of areas beyond communications. This paper aims at estimating the information between two random phenomena by using consolidated…

信息论 · 计算机科学 2020-05-07 Jaume Riba , Ferran de Cabrera

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

信息论 · 计算机科学 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

Basic block reordering is an important step for profile-guided binary optimization. The state-of-the-art goal for basic block reordering is to maximize the number of fall-through branches. However, we demonstrate that such orderings may…

编程语言 · 计算机科学 2020-04-14 Andy Newell , Sergey Pupyrev

Binary embeddings provide efficient and powerful ways to perform operations on large scale data. However binary embedding typically requires long codes in order to preserve the discriminative power of the input space. Thus binary coding…

数据结构与算法 · 计算机科学 2015-12-08 Felix X. Yu , Aditya Bhaskara , Sanjiv Kumar , Yunchao Gong , Shih-Fu Chang

Variance-reduced gradient estimators for policy gradient methods have been one of the main focus of research in the reinforcement learning in recent years as they allow acceleration of the estimation process. We propose a variance-reduced…

机器学习 · 计算机科学 2023-11-28 Saber Salehkaleybar , Sadegh Khorasani , Negar Kiyavash , Niao He , Patrick Thiran

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Block coordinate descent (BCD) methods are widely used for large-scale numerical optimization because of their cheap iteration costs, low memory requirements, amenability to parallelization, and ability to exploit problem structure. Three…

最优化与控制 · 数学 2022-08-02 Julie Nutini , Issam Laradji , Mark Schmidt

We present an efficient second-order finite difference scheme for solving the 2D sine-Gordon equation, which can inherit the discrete energy conservation for the undamped model theoretically. Due to the semi-implicit treatment for the…

数值分析 · 数学 2017-06-28 Xiaorong Kang , Wenqiang Feng , Kelong Cheng , Chunxiang Guo

Input binarization has shown to be an effective way for network acceleration. However, previous binarization scheme could be regarded as simple pixel-wise thresholding operations (i.e., order-one approximation) and suffers a big accuracy…

计算机视觉与模式识别 · 计算机科学 2017-08-30 Zefan Li , Bingbing Ni , Wenjun Zhang , Xiaokang Yang , Wen Gao

We provide an analytical framework for balanced realization model order reduction of linear control systems which depend on an unknown parameter. Besides recovering known results for the first order corrections, we obtain explicit novel…

系统与控制 · 计算机科学 2016-06-24 Carles Batlle , Nestor Roqueiro