English
Related papers

Related papers: Is Bigger Always Better? Efficiency Analysis in Re…

200 papers

We present an empirical study in the geometric task of learning interatomic potentials, which shows equivariance matters even more at larger scales; we show a clear power-law scaling behaviour with respect to data, parameters and compute…

Machine Learning · Computer Science 2026-05-06 Khang Ngo , Siamak Ravanbakhsh

Is reduction always a good scientific strategy? Does it always lead to a gain in information? The very existence of the special sciences above and beyond physics seems to hint no. Previous research has shown that dimension reduction…

Information Theory · Computer Science 2021-04-28 Thomas Varley , Erik Hoel

Neural scaling laws describe how model performance improves as a power law with size, but existing work focuses on models above 100M parameters. The sub-20M regime -- where TinyML and edge AI operate -- remains unexamined. We train 90…

Machine Learning · Computer Science 2026-03-10 Mohammed Alnemari , Rizwan Qureshi , Nader Begrazadah

YOLOv4 achieved the best performance on the COCO dataset by combining advanced techniques for regression (bounding box positioning) and classification (object class identification) using the Darknet framework. To enhance accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Athulya Sundaresan Geetha

Large language model pre-training has become increasingly expensive, with most practitioners relying on scaling laws to allocate compute budgets for model size and training tokens, commonly referred to as Compute-Optimal or Chinchilla…

Machine Learning · Computer Science 2024-05-03 Zhen Guo

The better accuracy and efficiency trade-off has been a challenging problem in object detection. In this work, we are dedicated to studying key optimizations and neural network architecture choices for object detection to improve accuracy…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Guanghua Yu , Qinyao Chang , Wenyu Lv , Chang Xu , Cheng Cui , Wei Ji , Qingqing Dang , Kaipeng Deng , Guanzhong Wang , Yuning Du , Baohua Lai , Qiwen Liu , Xiaoguang Hu , Dianhai Yu , Yanjun Ma

Current methods for low- and few-shot object detection have primarily focused on enhancing model performance for detecting objects. One common approach to achieve this is by combining model finetuning with data augmentation strategies.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Vladislav Li , Georgios Tsoumplekas , Ilias Siniosoglou , Vasileios Argyriou , Anastasios Lytos , Eleftherios Fountoukidis , Panagiotis Sarigiannidis

This paper investigates the impact of various data augmentation techniques on the performance of object detection models. Specifically, we explore classical augmentation methods, image compositing, and advanced generative models such as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Ang Jia Ning Shermaine , Michalis Lazarou , Tania Stathaki

Visuals captured by high-flying aerial drones are increasingly used to assess biodiversity and animal population dynamics around the globe. Yet, challenging acquisition scenarios and tiny animal depictions in airborne imagery, despite…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Mowen Xue , Theo Greenslade , Majid Mirmehdi , Tilo Burghardt

Cut-to-length harvesters collect useful information for modeling relationships between forest attributes and airborne laser scanning (ALS) data. However, harvesters operate in mature forests, which may introduce selection biases that can…

Applications · Statistics 2022-12-20 Janne Räty , Marius Hauglin , Rasmus Astrup , Johannes Breidenbach

Real-time object detection is a fundamental but challenging task in computer vision, particularly when computational resources are limited. Although YOLO-series models have set strong benchmarks by balancing speed and accuracy, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Xiaochun Lei , Siqi Wu , Weilin Wu , Zetao Jiang

Scaling up neural models has yielded significant advancements in a wide array of tasks, particularly in language generation. Previous studies have found that the performance of neural models frequently adheres to predictable scaling laws,…

Information Retrieval · Computer Science 2024-07-16 Yan Fang , Jingtao Zhan , Qingyao Ai , Jiaxin Mao , Weihang Su , Jia Chen , Yiqun Liu

Current state-of-the-art one-stage object detectors are limited by treating each image region separately without considering possible relations of the objects. This causes dependency solely on high-quality convolutional feature…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Tolga Aksoy , Ugur Halici

Scaling Laws have emerged as a powerful framework for understanding how model performance evolves as they increase in size, providing valuable insights for optimizing computational resources. In the realm of Sequential Recommendation (SR),…

Artificial Intelligence · Computer Science 2025-02-20 Tingjia Shen , Hao Wang , Chuhan Wu , Jin Yao Chin , Wei Guo , Yong Liu , Huifeng Guo , Defu Lian , Ruiming Tang , Enhong Chen

We explore the scaling behaviors of artificial intelligence to establish practical techniques for training foundation models on high-resolution electro-optical (EO) datasets that exceed the current state-of-the-art scale by orders of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Charith Wickrema , Eliza Mace , Hunter Brown , Heidys Cabrera , Nick Krall , Matthew O'Neill , Shivangi Sarkar , Lowell Weissman , Eric Hughes , Guido Zarrella

This paper explores the size-invariance of evaluation metrics in Salient Object Detection (SOD), especially when multiple targets of diverse sizes co-exist in the same image. We observe that current metrics are size-sensitive, where larger…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Feiran Li , Qianqian Xu , Shilong Bao , Zhiyong Yang , Runmin Cong , Xiaochun Cao , Qingming Huang

This paper presents an efficient way of detecting directed objects by predicting their center coordinates and direction angle. Since the objects are of uniform size, the proposed model works without predicting the object's width and height.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Đorđe Nedeljković

Underwater object detection (UOD) remains a critical challenge in computer vision due to underwater distortions which degrade low-level features and compromise the reliability of even state-of-the-art detectors. While YOLO models have…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Edwine Nabahirwa , Wei Song , Minghua Zhang , Shufan Chen

Small targets are particularly difficult to detect due to their low pixel count, complex backgrounds, and varying shooting angles, which make it hard for models to extract effective features. While some large-scale models offer high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xuerui Zhang

Current mainstream object detection methods for large aerial images usually divide large images into patches and then exhaustively detect the objects of interest on all patches, no matter whether there exist objects or not. This paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Xingxing Xie , Gong Cheng , Qingyang Li , Shicheng Miao , Ke Li , Junwei Han