Analysis of Meta-Heuristic Feature Selection Techniques on classifier performance with specific reference to psychiatric disorder
Abstract
Optimization plays an important role in solving complex computational problems. Meta-Heuristic approaches work as an optimization technique. In any search space, these approaches play an excellent role in local as well as global search. Nature-inspired approaches, especially population-based ones, play a role in solving the problem. In the past decade, many nature-inspired population-based methods have been explored by researchers to facilitate computational intelligence. These methods are based on insects, birds, animals, sea creatures, etc. This research focuses on the use of Meta-Heuristic methods for the feature selection. A better optimization approach must be introduced to reduce the computational load, depending on the problem size and complexity. The correct feature set must be chosen for the diagnostic system to operate effectively. Here, population-based Meta-Heuristic optimization strategies have been used to pick the features. By choosing the best feature set, the Butterfly Optimization Algorithm (BOA) with the Enhanced Lion Optimization Algorithm (ELOA) approach would reduce classifier overhead. The results clearly demonstrate that the combined strategy has higher performance outcomes when compared to other optimization strategies.
References
Arora, S., & Singh, S. (2019). Butterfly optimization algorithm: a novel approach for global optimization. Soft Computing, 23(3), 715–734. https://doi.org/10.1007/s00500-018-3102-4
Askarzadeh, A. (2016). A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm. Computers & Structures, 169, 1–12. https://doi.org/10.1016/j.compstruc.2016.03.001
Dhiman, G., & Kumar, V. (2019). Spotted hyena optimizer for solving complex and non-linear constrained engineering problems. In Harmony Search and Nature Inspired Optimization Algorithms: Theory and Applications, ICHSA 2018, Springer Singapore, pp. 857-867.
Dorigo, M., & Di Caro, G. (1999). Ant colony optimization: A new meta-heuristic. In: Proceedings of the 1999 Congress on Evolutionary Computation-CEC99, 2, 1477. https://doi.org/10.1109/CEC.1999.782657
Dubey, D.A. (2021). Optimized hybrid learning for multi disease prediction enabled by lion with butterfly optimization algorithm. Sadhana, 46, 63. https://doi.org/10.1007/s12046-021-01574-8
Galeshchuk, S. (2016). Neural networks performance in exchange rate prediction. Neurocomputing, 172, 446–452. https://doi.org/10.1016/j.neucom.2015.03.100
Gangwar, M., Mishra, R. B., & Yadav, R. S. (2014). Application of decision tree method in the diagnosis of neuropsychiatric diseases. IEEE, In Asia-Pacific World Congress on Computer Science and Engineering, pp. 1-8. https://doi.org/10.1109/APWCCSE.2014.7053880
Gangwar, M., Singh, A.P., Ojha, B. K., Shukla, H. K., Srivastava, R., & Goyal, N. (2020a). Intelligent Computing Model For Psychiatric Disorder. Journal of Critical Reviews, 7(7), 600-603. https://doi.org/10.31838/jcr.07.07.108
Gangwar, M., Singh, A.P., Ojha, B. K., Srivastava, R., & Singh, S. (2020b). Machine learning techniques in the detection and classification of psychiatric diseases. Journal of Advanced Research in Dynamical and Control Systems, 12(5), 639-646. https://doi.org/10.5373/JARDCS/V12SP5/20201799
Gangwar, M., Yadav, R. S., & Mishra, R. B. (2012). Semantic Web Services for medical health planning. IEEE, In 2012, 1st International Conference on Recent Advances in Information Technology (RAIT), pp. 614-618. https://doi.org/10.1109/RAIT.2012.6194599
Harifi, S., Khalilian, M., Mohammadzadeh, J., & Ebrahimnejad, S. (2019). Emperor Penguins Colony: a new metaheuristic algorithm for optimization. Evolutionary Intelligence, 12(2), 211–226. https://doi.org/10.1007/s12065-019-00212-x
Heidari, A. A., Mirjalili, S., Faris, H., Aljarah, I., Mafarja, M., & Chen, H. (2019). Harris hawks optimization: Algorithm and applications. Future Generation Computer Systems, 97, 849–872. https://doi.org/10.1016/j.future.2019.02.028
Hussien, A. G., Amin, M., Wang, M., Liang, G., Alsanad, A., Gumaei, A., & Chen, H. (2020). Crow Search Algorithm: Theory, Recent Advances, and Applications. IEEE Access, 8, 173548–173565. https://doi.org/10.1109/ACCESS.2020.3024108
Ismail, W.N., Fathimathul Rajeena, P.P., & Mona A.S. Ali. (2023). A Meta-Heuristic Multi-Objective Optimization Method for Alzheimer’s Disease Detection Based on Multi-Modal Data. Mathematics, 11(4), 957. https://doi.org/10.3390/math11040957
Karaboga, D., & Basturk, B. (2007). A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. Journal of Global Optimization, 39(3), 459–471. https://doi.org/10.1007/s10898-007-9149-x
Karaboga, D., & Kaya, E. (2019). Adaptive network based fuzzy inference system (ANFIS) training approaches: a comprehensive survey. Artificial Intelligence Review, 52(4), 2263–2293. https://doi.org/10.1007/s10462-017-9610-2
Kaur, S., Kumar, Y., Koul, A., & Kumar Kamboj, S. (2023). A systematic review on metaheuristic optimization techniques for feature selections in disease diagnosis: Open issues and challenges. Archives of Computational Methods in Engineering. State of the Art Reviews, 30(3), 1863–1895. https://doi.org/10.1007/s11831-022-09853-1
Kennedy, J. and Eberhart, R. (1995). Particle Swarm Optimization. Proceedings of the IEEE International Conference on Neural Networks, 4, 1942-1948. https://doi.org/10.1109/ICNN.1995.488968
Khan, M.A., & Algarni, F. (2020). A Healthcare Monitoring System for the Diagnosis of Heart Disease in the IoMT Cloud Environment Using MSSO-ANFIS. IEEE Access, 8, 122259–122269. https://doi.org/10.1109/ACCESS.2020.3006424
Lamy, J.B. (2019). Artificial feeding birds (AFB): a new metaheuristic inspired by the behaviour of pigeons. Advances in nature-inspired computing and applications, Cham: Springer. pp. 43–60. https://doi.org/10.1007/978-3-319-96451-5_3
Li, X., Zhang, J., & Safara, F. (2023). Improving the Accuracy of Diabetes Diagnosis Applications through a Hybrid Feature Selection Algorithm. Neural Processing Letters, 55(1), 153–169. https://doi.org/10.1007/s11063-021-10491-0
Mirjalili, S. (2015). Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowledge-Based Systems, 89, 228–249. https://doi.org/10.1016/j.knosys.2015.07.006
Nandhini, S., & Ashokkumar, K. (2021). Improved crossover based monarch butterfly optimization for tomato leaf disease classification using convolutional neural network. Multimedia Tools and Applications, 80(12), 18583–18610. https://doi.org/10.1007/s11042-021-10599-4
Pan, W.T. (2012). A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example. Knowledge-Based Systems, 26, 69–74. https://doi.org/10.1016/j.knosys.2011.07.001
Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural Networks, 61, 85–117. https://doi.org/10.1016/j.neunet.2014.09.003
Sharma, M., & Kaur, P. (2020). A Comprehensive Analysis of Nature-Inspired Meta-Heuristic Techniques for Feature Selection Problem. Archives of Computational Methods in Engineering, 28(3), 1103–1127. https://doi.org/10.1007/s11831-020-09412-6
Singh, C., Gangwar, M., & Kumar, U. (2021). A Review on Neuro-Fuzzy System in the Diagnosis of Psychiatric Disorder. Webology, 18(SI01), 164-182.https://doi.org/10.14704/WEB/V18SI01/WEB18052
Singh, S., Gupta, P., Ojha, B.K., Kumar, R., Shukla, H.K., Srivastava, R., Singh, C., & Gangwar, M. (2020). A supply chain management based patient forecasting model for dental hospital. Journal of Critical Reviews, 7(3), 600-603. https://doi.org/10.31838/jcr.07.03.76
Tarle, B., & Jena, S. (2021). Ant lion optimization based medical data classification using modified neuro fuzzy classifier. Wireless Personal Communications, 117(2), 1223–1242. https://doi.org/10.1007/s11277-020-07919-6
Verma, A., Agarwal, G., & Gupta, A. (2022). A novel generalized fuzzy intelligence-based ant lion optimization for internet of things based disease prediction and diagnosis. Cluster Computing, 25(5), 3283-3298. https://doi.org/10.1007/s10586-022-03565-8
Wang, G.G., Deb, S., & Coelho, L. (2015). Elephant Herding Optimization. In: 2015 3rd international symposium on computational and business intelligence (ISCBI), Bali, Indonesia. https://doi.org/10.1109/ISCBI.2015.8
Wang, G.G., Deb, S., & Cui, Z. (2019). Monarch butterfly optimization. Neural Computing and Applications, 31(7), 1995–2014. https://doi.org/10.1007/s00521-015-1923-y
Yang, X.S. (2009). Firefly Algorithms for Multimodal Optimization. In O. Watanabe & T. Zeugmann (Eds.), Stochastic Algorithms: Foundations and Applications, Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 169–178.
Yang, X.S. (2010). A New Metaheuristic Bat-Inspired Algorithm. In J. R. González, D. A. Pelta, C. Cruz, G. Terrazas, & N. Krasnogor (Eds.), Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 65–74. https://doi.org/10.1007/978-3-642-12538-6_6
Yazdani, M., & Jolai, F. (2016). Lion Optimization Algorithm (LOA): A nature-inspired metaheuristic algorithm. Journal of Computational Design and Engineering, 3(1), 24–36. https://doi.org/10.1016/j.jcde.2015.06.003
Zhou, H., Cheng, H., Wei, Z., Zhao, X., Tang, A., & Xie, L. (2021). A Hybrid Butterfly Optimization Algorithm for Numerical Optimization Problems. Computational Intelligence and Neuroscience, 2021, 1–14. https://doi.org/10.1155/2021/7981670
Copyright (c) 2023 International Academic Publishing House (IAPH)
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
