Adaptive Activation Function Generation for Artificial Neural Networks through Fuzzy Inference with Application in Grooming Text Categorisation

Zuo, Zheming, Li, Jie, Wei, Bo, Yang, Longzhi, Chao, Fei and Naik, Nitin (2019) Adaptive Activation Function Generation for Artificial Neural Networks through Fuzzy Inference with Application in Grooming Text Categorisation. In: 2019 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 23-26 June 2019, New Orleans. (In Press)

[img]
Preview
Text (Full text)
Zuo et al - Adaptive Activation Function Generation for Artificial Neural Networks AAM.pdf - Accepted Version

Download (14MB) | Preview

Abstract

The activation function is introduced to determine the output of neural networks by mapping the resulting values of neurons into a specific range. The activation functions often suffer from ‘gradient vanishing’, ‘non zero-centred function outputs’, ‘exploding gradients’, and ‘dead neurons’, which may lead to deterioration in the classification performance. This paper proposes an activation function generation approach using the Takagi-Sugeno-Kang inference in an effort to address such challenges. In addition, the proposed method further optimises the coefficients in the activation function using the genetic algorithm such that the activation function can adapt to different applications. This approach has been applied to a digital forensics application of online grooming detection. The evaluations confirm the superiority of the proposed activation function for online grooming detection using an imbalanced data set.

Item Type: Conference or Workshop Item (Paper)
Subjects: G700 Artificial Intelligence
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Becky Skoyles
Date Deposited: 10 Apr 2019 08:53
Last Modified: 29 Apr 2019 09:45
URI: http://nrl.northumbria.ac.uk/id/eprint/38881

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics


Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence