Optimasi Learning Rate Neural Network Backpropagation Dengan Search Direction Conjugate Gradient Pada Electrocardiogram
Abstract
This paper develops a Neural network (NN) using conjugate gradient (CG). The modification of this method is in defining the direction of linear search. The conjugate gradient method has several methods to determine the steep size such as the Fletcher-Reeves, Dixon, Polak-Ribere, Hestene Steifel, and Dai-Yuan methods by using discrete electrocardiogram data. Conjugate gradients are used to update learning rates on neural networks by using different steep sizes. While the gradient search direction is used to update the weight on the NN. The results show that using Polak-Ribere get an optimal error, but the direction of the weighting search on NN widens and causes epoch on NN training is getting longer. But Hestene Steifel, and Dai-Yua could not find the gradient search direction so they could not update the weights and cause errors and epochs to infinity.
References
M. Badrul, N. Mandiri Jakarta, J. Damai No dan W. Jati Barat Jakarta Selatan, “Optimasi Neural Network Dengan Algoritma Genetika Untuk Prediksi Hasil Pemilukada,” pp. 2355-3421.
O. Soesanto, S. S. M. Si, A. E. Fahrudin, S. Si, M. Eng, D. Turianto dan S. Kom, “Optimasi Learning Radial Basis Function Neural Network dengan Extended Kalman Filter,” Kumpulan jurnaL Ilmu Komputer (KLIK), vol. 03, no. 02, 2015.
J. Bernal dan J. Torres-Jimenez, “SAGRAD: A program for neural network training with simulated annealing and the conjugate gradient method,” Journal of Research of the National Institute of Standards and Technology, vol. 120, pp. 113-128, 2015.
A. G. Karegowda, A. Manjunath dan M. Jayaram, “Application of Genetic Algorithm Optimized Neural Network Connection Weights for Medical Diagnosis of PIMA Indians Diabetes,” International Journal on Soft Computing, vol. 2, no. 2, pp. 15-23, 31 5 2011.
A. Y. Prathama, “Pendekatan Ann (Artificial Neural Network) Untuk Penentuan Prosentase Bobot Pekerjaan Dan Estimasi Nilai Pekerjaan Struktur Pada Rumah Sakit Pratama,” Jurnal Teknosains, vol. 7, no. 1, p. 14, 13 7 2018.
X.-B. Jin, X.-Y. Zhang, K. Huang dan G.-G. Geng, “Stochastic Conjugate Gradient Algorithm with Variance Reduction,” 26 10 2017.
F. Jing Wang, C. L. Philip Chen, “On the Conjugate Gradients (CG) Training Algorithm of Fuzzy Neural Networks (FNNs) via Its Equivalent Fully Connected Neural Networks (FFNNs),” IEEE International Conference on Systems, Man, and Cybernetics, vol. October 14, no. 17, pp. 2446-2451, 2012.
A. Riza Habibi, R. Bagus Edy Wibowo dan P. Student, “Modification Of Neural Network Algorithm Using Conjugate Gradient With Addition Of Weight Initialization,” Journal of Theoretical and Applied Information Technology, vol. 10, no. 1, 2015.
A. Y. Al Bayati, N. A. Sulaiman dan G. W. Sadiq, “A Modified Conjugate Gradient Formula for Back Propagation Neural Network Algorithm,” Journal of Computer Science, vol. 5, no. 11, pp. 849-856, 2009.
A. R. Habibi, S. I. Putri dan L. Hakim, “Aplikasi Representasi Real Time Gelombang Electrocardiograph Diskrit,” Jurnal Ilmiah Teknologi Informasi Asia, vol. 12, no. 01, 2018.
G. Taylor, R. Burmeister, Z. Xu, B. Singh, A. Patel dan T. Goldstein, “Training Neural Networks Without Gradients: A Scalable ADMM Approach,” 2016.
A. Abashar, M. Mamat, A. Alhawarat, F. Susilawati, Z. Salleh dan Z. A. Zakaria, A Modified Fletcher-Reeves Conjugate Gradient Method For Unconstrained Optimization, 2016.
A. T.Jayalakshmi, “Statistical Normalization and Back Propagation for Classification,” International Journal of Computer Theory and Engineering, vol. 3, no. 1, pp. 89-93, 2011.
A. S. Anagun dan T. Sarac, “Optimization of performance of genetic algorithm for 0-1 knapsack problems using taguchi method,” dalam Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2006.
