English
Related papers

Related papers: Dynamic Scale Inference by Entropy Minimization

200 papers

We show that the natural scaling of measurement for a particular problem defines the most likely probability distribution of observations taken from that measurement scale. Our approach extends the method of maximum entropy to use…

Quantitative Methods · Quantitative Biology 2010-03-02 Steven A. Frank , D. Eric Smith

Recently, learning algorithms motivated from sharpness of loss surface as an effective measure of generalization gap have shown state-of-the-art performances. Nevertheless, sharpness defined in a rigid region with a fixed radius, has a…

Machine Learning · Computer Science 2021-06-30 Jungmin Kwon , Jeongseop Kim , Hyunseo Park , In Kwon Choi

The performance of modern deep learning-based systems dramatically depends on the quality of input objects. For example, face recognition quality would be lower for blurry or corrupted inputs. However, it is hard to predict the influence of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Roman Kail , Kirill Fedyanin , Nikita Muravev , Alexey Zaytsev , Maxim Panov

Gradient descent is the primary workhorse for optimizing large-scale problems in machine learning. However, its performance is highly sensitive to the choice of the learning rate. A key limitation of gradient descent is its lack of natural…

Optimization and Control · Mathematics 2025-07-15 Oscar Smee , Fred Roosta , Stephen J. Wright

Transformers have proven highly effective across various applications, especially in handling sequential data such as natural languages and time series. However, transformer models often lack clear interpretability, and the success of…

Machine Learning · Computer Science 2025-12-01 Wei Shi , Yuan Cao

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Rongchang Xie , Fei Yu , Jiachao Wang , Yizhou Wang , Li Zhang

Scale variation is one of the most challenging problems in face detection. Modern face detectors employ feature pyramids to deal with scale variation. However, it might break the feature consistency across different scales of faces. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Leilei Cao , Yao Xiao , Lin Xu

By dynamic planning, we refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. A recent paradigm, active inference, brings fundamental insights into the adaptation of biological…

Artificial Intelligence · Computer Science 2024-11-13 Matteo Priorelli , Ivilin Peev Stoianov

Envelope extraction in nuclear magnetic resonance (NMR) is a fundamental step for processing the data space generated by this technique. Envelope detection accuracy improves with increasing the number of sampling points; however, we propose…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Ehsun Assadi

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

AI inference scaling is often tuned through 1D heuristics (a fixed reasoning pass) or 2D bivariate trade-offs (e.g., accuracy vs. compute), which fail to consider cost and latency constraints. We introduce a 3D optimization framework that…

Machine Learning · Computer Science 2025-11-18 Minseok Jung , Abhas Ricky , Muhammad Rameez Chatni

We present a novel approach to perform the unsupervised domain adaptation for object detection through forward-backward cyclic (FBC) training. Recent adversarial training based domain adaptation methods have shown their effectiveness on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Siqi Yang , Lin Wu , Arnold Wiliem , Brian C. Lovell

We propose a multiscale approach for predicting quantities in dynamical systems which is explicitly structured to extract information in both fine-to-coarse and coarse-to-fine directions. We envision this method being generally applicable…

Atmospheric and Oceanic Physics · Physics 2025-12-30 Karl Otness , Laure Zanna , Joan Bruna

Most image matching methods perform poorly when encountering large scale changes in images. To solve this problem, firstly, we propose a scale-difference-aware image matching method (SDAIM) that reduces image scale differences before local…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Yujie Fu , Yihong Wu

Real-world vision based applications require fine-grained classification for various area of interest like e-commerce, mobile applications, warehouse management, etc. where reducing the severity of mistakes and improving the classification…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Sudeep Kumar Sahoo , Sathish Chalasani , Abhishek Joshi , Kiran Nanjunda Iyer

The ability to detect and track objects in the visual world is a crucial skill for any intelligent agent, as it is a necessary precursor to any object-level reasoning process. Moreover, it is important that agents learn to track objects…

Machine Learning · Computer Science 2019-11-21 Eric Crawford , Joelle Pineau

Data-driven decision-making is performed by solving a parameterized optimization problem, and the optimal decision is given by an optimal solution for unknown true parameters. We often need a solution that satisfies true constraints even…

Optimization and Control · Mathematics 2020-03-03 Akihiro Yabe , Takanori Maehara

Object detection has made substantial progress in the last decade, due to the capability of convolution in extracting local context of objects. However, the scales of objects are diverse and current convolution can only process single-scale…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junliang Chen , Xiaodong Zhao , Linlin Shen

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement…

Machine Learning · Computer Science 2026-02-03 Minjae Kwon , Tyler Ingebrand , Ufuk Topcu , Lu Feng

We introduce a multi-scale framework for low-level vision, where the goal is estimating physical scene values from image data---such as depth from stereo image pairs. The framework uses a dense, overlapping set of image regions at multiple…

Computer Vision and Pattern Recognition · Computer Science 2015-04-15 Ayan Chakrabarti , Ying Xiong , Steven J. Gortler , Todd Zickler