English
Related papers

Related papers: A Survey of Deep Learning: From Activations to Tra…

200 papers

In the past few years, machine learning-based approaches have had some great success for rendering animated feature films. This survey summarizes several of the most dramatic improvements in using deep neural networks over traditional…

Graphics · Computer Science 2020-05-27 Shilin Zhu

In recent years, deep learning using neural network architecture, i.e. deep neural networks, has been on the frontier of computer science research. It has even lead to superhuman performance in some problems, e.g., in computer vision, games…

Machine Learning · Computer Science 2022-04-07 Maciej Świechowski

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Transformers have achieved great success across a wide range of applications, yet the theoretical foundations underlying their success remain largely unexplored. To demystify the strong capacities of transformers applied to versatile…

Machine Learning · Computer Science 2026-03-25 Chenyang Zhang , Qingyue Zhao , Quanquan Gu , Yuan Cao

Transformers have become one of the most important architectural innovations in deep learning and have enabled many breakthroughs over the past few years. Here we propose a simple network architecture, gMLP, based on MLPs with gating, and…

Machine Learning · Computer Science 2021-06-03 Hanxiao Liu , Zihang Dai , David R. So , Quoc V. Le

"Deep Learning"/"Deep Neural Nets" is a technological marvel that is now increasingly deployed at the cutting-edge of artificial intelligence tasks. This dramatic success of deep learning in the last few years has been hinged on an enormous…

Machine Learning · Computer Science 2021-04-30 Anirbit Mukherjee

Crack detection plays a crucial role in civil infrastructures, including inspection of pavements, buildings, etc., and deep learning has significantly advanced this field in recent years. While numerous technical and review papers exist in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xinan Zhang , Haolin Wang , Yung-An Hsieh , Zhongyu Yang , Anthony Yezzi , Yi-Chang Tsai

With the ever-growing presence of deep artificial neural networks in every facet of modern life, a growing body of researchers in educational data science -- a field consisting of various interrelated research communities -- have turned…

Computers and Society · Computer Science 2024-05-01 Juan D. Pinto , Luc Paquette

This book explores the role of Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) in driving the progress of big data analytics and management. The book focuses on simplifying the complex mathematical concepts…

Today, intelligent systems that offer artificial intelligence capabilities often rely on machine learning. Machine learning describes the capacity of systems to learn from problem-specific training data to automate the process of analytical…

Artificial Intelligence · Computer Science 2021-04-15 Christian Janiesch , Patrick Zschech , Kai Heinrich

The rapid advancement of deep learning (DL) has transformed healthcare, particularly in cancer detection and diagnosis. DL surpasses traditional machine learning and human accuracy, making it a critical tool for identifying diseases.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-21 Yassine Habchi , Hamza Kheddar , Yassine Himeur , Adel Belouchrani , Erchin Serpedin , Fouad Khelifi , Muhammad E. H. Chowdhury

DeepSeek-V3 and DeepSeek-R1 are leading open-source Large Language Models (LLMs) for general-purpose tasks and reasoning, achieving performance comparable to state-of-the-art closed-source models from companies like OpenAI and Anthropic --…

Machine Learning · Computer Science 2025-03-17 Chengen Wang , Murat Kantarcioglu

Deep Learning (DL) techniques are now widespread and being integrated into many important systems. Their classification and recognition abilities ensure their relevance for multiple application domains. As machine-learning that relies on…

Software Engineering · Computer Science 2019-02-01 Gaetan J. D. R. Hains , Arvid Jakobsson , Youry Khmelevsky

Transformer based models have shown remarkable capabilities in sequence learning across a wide range of tasks, often performing well on specific task by leveraging input-output examples. Despite their empirical success, a comprehensive…

Machine Learning · Computer Science 2025-06-03 Yifan Hao , Chenlu Ye , Chi Han , Tong Zhang

Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these…

Machine Learning · Computer Science 2020-08-04 James O' Neill

The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer…

Machine Learning · Computer Science 2021-05-04 Michael M. Bronstein , Joan Bruna , Taco Cohen , Petar Veličković

Deep learning has sparked a network of mutual interactions between different disciplines and AI. Naturally, each discipline focuses and interprets the workings of deep learning in different ways. This diversity of perspectives on deep…

Machine Learning · Computer Science 2019-08-28 Raul Vicente

Much of the present-day Artificial Intelligence (AI) utilizes artificial neural networks, which are sophisticated computational models designed to recognize patterns and solve complex problems by learning from data. However, a major…

Machine Learning · Computer Science 2024-06-21 Aditya Datar , Pramit Saha

Visual saliency models have enjoyed a big leap in performance in recent years, thanks to advances in deep learning and large scale annotated data. Despite enormous effort and huge breakthroughs, however, models still fall short in reaching…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ali Borji

The development of practical applications, such as autonomous driving and robotics, has brought increasing attention to 3D point cloud understanding. While deep learning has achieved remarkable success on image-based tasks, there are many…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Haoming Lu , Humphrey Shi