NeuroSCA: Evolving Activation Functions for Side-Channel Analysis

The choice of activation functions can significantly impact the performance of neural networks. Due to an ever-increasing number of new activation functions being proposed in the literature, selecting the appropriate activation function becomes even more difficult. Consequently, many researchers approach this problem from a different angle, in...

Predicting traction return current in electric railway systems through physics-informed neural networks

This paper addresses the problem of determining the distribution of the return current in electric railway traction systems. The dynamics of traction return current are simulated in all three space dimensions by informing the neural networks with the Partial Differential Equations (PDEs) known as telegraph equations. In addition, this work...

Graph-Adaptive Activation Functions for Graph Neural Networks

Network data are essential in applications such as recommender systems, social networks, and sensor networks. A unique characteristic that these data encompass is the coupling between the data values and the underlying network structure on which these data are defined. Graph Neural Networks (GNNs) have been designed as tools to extend the...

Activating frequencies: Exploring non-linearities in the Fourier domain

Convolutional Neural Networks (CNNs) are achieving state of the art performance in computer vision. One downside of CNNs is their computational complexity. One way to make CNNs more computational efficient is by implementing their convolutions in the frequency domain, using Fast Fourier Transforms (FFTs). This has as a consequence that most...