Latest Articles for Activation Functions

Machine Learning Graph Convolutional Networks: An Overview

Discover how Graph Convolutional Networks analyze complex data in various fields.

2025-07-03T07:29:54+00:00 ― 5 min read

Machine Learning Kolmogorov-Arnold Networks: A New Path in Reinforcement Learning

Exploring KANs as a new approach for efficient reinforcement learning models.

2025-06-30T17:21:06+00:00 ― 6 min read

Machine Learning Finding Better Activation Functions for Deep Learning

A new method improves activation function search for deep learning models.

2025-06-28T11:30:00+00:00 ― 7 min read

Disordered Systems and Neural Networks Neural Networks and Spin Models: A Unique Connection

Exploring the relationship between neural networks and spin models during training.

2025-06-24T20:18:06+00:00 ― 6 min read

Machine Learning The Role of Polynomial Neural Networks in Machine Learning

Exploring polynomial neural networks and their applications in various fields.

2025-06-21T01:09:24+00:00 ― 5 min read

Machine Learning Advancements in Quaternion-Valued Convolutional Neural Networks

Analyzing the impact of quaternion-based components on image classification performance.

2025-06-20T12:58:42+00:00 ― 5 min read

Machine Learning Applying Deep Learning to Differential Equations

An overview of how deep learning methods tackle differential equations.

2025-06-19T03:52:05+00:00 ― 6 min read

Machine Learning Efficiency in Quantized Neural Networks

This study examines performance and conditions for quantized neural networks under fixed-point arithmetic.

2025-06-12T03:32:20+00:00 ― 6 min read

Computer Vision and Pattern Recognition Improving Implicit Neural Representations with SL A-INR Method

A new approach enhances image and shape representation using a learnable activation function.

2025-06-11T14:21:42+00:00 ― 6 min read

Machine Learning Introducing the Kolmogorov-Arnold Transformer Model

KAT improves deep learning by using advanced KANs to replace MLPs.

2025-06-11T11:04:12+00:00 ― 5 min read

Machine Learning Improving Machine Learning with Iterative Thresholding

A method to enhance machine learning models dealing with corrupted data.

2025-06-09T08:47:00+00:00 ― 5 min read

Machine Learning Tuning Neural Networks: A Look at Hyperparameters

Learn how hyperparameters affect neural network performance and complexity.

2025-06-06T18:45:30+00:00 ― 4 min read

Computation and Language The Rise of Small Language Models

Small language models are changing how technology works in everyday devices.

2025-06-06T10:35:42+00:00 ― 7 min read

Machine Learning Comparing Neural Networks: MLPs vs. KANs

This article examines MLPs and KANs in low-data environments.

2025-06-03T21:46:32+00:00 ― 7 min read

Machine Learning Introducing Zorro Activation Functions for Neural Networks

Zorro functions provide smooth solutions for enhanced neural network performance.

2025-06-03T16:37:48+00:00 ― 5 min read

Machine Learning Understanding Neural Network Reconstruction Techniques

Learn about how to reconstruct neural networks and its implications.

2025-05-31T14:37:18+00:00 ― 5 min read

Neuroscience Understanding Recurrent Neural Networks: Insights and Applications

Explore how RNNs mimic brain functions in problem-solving tasks.

2025-05-30T13:31:56+00:00 ― 6 min read

Computation and Language The Role of Polynomial Composition Activations in Machine Learning

Discover the impact of PolyCom on neural networks and their performance.

2025-05-29T08:29:51+00:00 ― 6 min read

Machine Learning Kolmogorov-Arnold Networks: A New Approach

KANs offer flexibility and efficiency in machine learning compared to MLPs.

2025-05-29T00:27:00+00:00 ― 5 min read

Applications Using Machine Learning to Predict Mortality in Older Adults

This study examines mortality prediction in older adults using a 1D-CNN model.

2025-05-26T07:05:58+00:00 ― 8 min read

Neurons and Cognition Understanding Memory Through Firing Rate Models

A look at how firing rate models explain memory formation and retrieval.

2025-05-23T20:56:20+00:00 ― 7 min read

Machine Learning Addressing the Dying ReLU Problem with HeLU

HeLU activation function solves ReLU’s limitations for deep learning models.

2025-05-22T20:46:03+00:00 ― 6 min read

Machine Learning Understanding Activation Sparsity in Language Models

Exploring activation sparsity to improve language model efficiency.

2025-05-22T17:42:42+00:00 ― 5 min read

Machine Learning Introducing xIELU: A New Activation Function

xIELU offers a promising alternative to traditional activation functions in deep learning.

2025-05-19T01:30:40+00:00 ― 7 min read

Computer Vision and Pattern Recognition Branching Neural Networks: The ANDHRA Approach

Explore how the ANDHRA Bandersnatch enhances neural networks through branching.

2025-05-02T15:34:40+00:00 ― 7 min read

Systems and Control Advancing Fuzzy General Grey Cognitive Maps

Discover the latest developments in fuzzy cognitive maps and their real-world applications.

2025-04-05T05:25:48+00:00 ― 7 min read

High Energy Physics - Phenomenology Neural Networks: Unlocking Particle Physics Insights

Discover how neural networks transform data analysis in particle physics.

2025-02-28T02:19:24+00:00 ― 6 min read

Hardware Architecture Flex-PE: The Future of AI Processing

Flex-PE enhances AI efficiency with adaptable processing power.

2025-02-20T10:16:30+00:00 ― 6 min read

Machine Learning PowerMLP: The Fast Track for Neural Networks

PowerMLP offers a speedy solution for efficient neural network training.

2025-02-19T21:49:50+00:00 ― 7 min read

Machine Learning Revolutionizing Neural Networks with TAAFS

Discover how TAAFS improves neural networks for complex tasks.

2025-02-11T12:16:12+00:00 ― 5 min read

Algebraic Topology The Art of Neural Networks in Computing

Neural networks learn from data, transforming how computers make decisions.

2025-02-05T00:52:10+00:00 ― 7 min read

Machine Learning Deep ReLU Networks: The Key to AI Learning

Discover how deep ReLU networks learn and why injectivity matters.

2025-01-22T08:59:13+00:00 ― 7 min read

Image and Video Processing ProKAN: A Leap Forward in Liver Tumor Segmentation

New method improves liver tumor detection in CT scans, aiding medical decisions.

2025-01-20T18:57:36+00:00 ― 7 min read

Numerical Analysis New Activation Function Boosts Neural Network Performance

A fresh activation function enhances neural networks for solving complex physical problems.

2025-01-17T12:47:46+00:00 ― 5 min read