Manuscript Title:

AUTO-ADAPTIVE THE WEIGHT IN BATCH BACK PROPAGATION ALGORITHM VIA DYNAMIC LEARNING RATE

Author:

MOHAMMED SARHAN AL_DUAIS, ABDUALMAJED A.G. AL- KHULAIDI, FATMA SUSILAWATI. MOHAMAD, BELAL AL-FUTHAIDI, SADIK ALI MURSHID AL- TAWEEL, WALID YOUSEF, MUMTAZIMAH MOHAMAD

DOI Number:

DOI:10.5281/zenodo.8348528

Published : 2023-09-10

About the author(s)

1. MOHAMMED SARHAN AL_DUAIS - Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Terengganu, Malaysia.
2. ABDUALMAJED A.G. AL- KHULAIDI - Faculty of Computer Science and Information Technology, Sana’a University, Sana’a Yemen.
3. FATMA SUSILAWATI. MOHAMAD - Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Terengganu, Malaysia.
4. BELAL AL-FUTHAIDI - Faculty of Computing and IT, University Of Science & Technology Sana’a, Yemen.
5. SADIK ALI MURSHID AL- TAWEEL - Faculty of Computing and It, University of Science & Technology Sana’a, Yemen, Altaweel.
6. WALID YOUSEF - Faculty of Computing and IT, University of Science & Technology Sana’a, Yemen.
7. MUMTAZIMAH MOHAMAD - Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Terengganu, Malaysia.

Full Text : PDF

Abstract

Batch back propagation (BBP) algorithm is commonly used in many applications, including robotics, automation, and global positioning systems. The man drawbacks of batch back propagation (BBP) algorithm is slow training, and there are several parameters needs to be adjusted manually, also suffers
from saturation training. The objective of this study is to improve the speed uptraining of the BBP algorithm and to remove the saturation training. To overcome these problems, we have created a new dynamic learning rate to escape the local minimum, which enables a faster training time. We presented dynamic batch backpropagation algorithm (DBBPLR) which training with dynamic learning rate. This technique was implemented using a sigmoid function. The XOR problem, the Balance dataset, and the Iris dataset were used as benchmarks with different structures to test the efficiency of the dynamic learning rate. The real datasets were divided into a training set and a testing set, and 75 experiments were carried out using Matlab software2016a. From the experimental results, it can be shown that the DBBPLR algorithm provides superior performance over the existing BBP algorithm in terms of training, the speed of training, time training, number of epochs and accuracy training and also with existing work.


Keywords

Artificial neural network, Batch Back-propagation algorithm, local minimum, Speed up Training, dynamic training rate. Auto -Adaptive the weight