Secure and Scalable AI: Insights into Federated Learning Algorithms and Platforms
DOI:
https://doi.org/10.48001/jocevd.2024.2215-27Keywords:
Artificial Intelligence (AI), Federated Learning (FL), Frameworks, Secure, ScalableAbstract
This paper takes a closer look at the rapidly advancing field of Federated Learning (FL), a decentralized machine learning approach that focuses on preserving data privacy by training models across multiple devices. It highlights key algorithms like Federated Averaging (FedAvg) and its more refined versions Hierarchical Federated Averaging (HierFAVG) and Federated Matched Averaging (FedMA) which improve model aggregation techniques. The discussion extends to both Horizontal and Vertical Federated Learning (HFL and VFL), illustrating how they handle data partitioning and communication differently. Additionally, the paper reviews prominent FL frameworks and simulators, including TensorFlow Federated (TFF), PySyft, Flower, and FedML, emphasizing their roles in facilitating experiments and ensuring scalability. Critical features like data distribution, communication topologies, and security measures in FL simulators are explored. Ultimately, the paper offers a comprehensive overview of FL frameworks, algorithms, and architectures, showcasing their ability to advance distributed AI while tackling the challenges of data diversity and privacy.
Downloads
References
Arouj, A., & Abdelmoniem, A. M. (2024). Towards energy-aware federated learning via collaborative computing approach. Computer Communications, 221, 131-141. https://doi.org/10.1016/j.comcom.2024.04.012.
Dasaradharami Reddy, K., & Gadekallu, T. R. (2023). A comprehensive survey on federated learning techniques for healthcare informatics. Computational Intelligence and Neuroscience, 2023(1), 8393990. https://doi.org/10.1155/2023/8393990.
Kasturi, A., Ellore, A. R., & Hota, C. (2020). Fusion learning: A one shot federated learning. In Computational Science–ICCS 2020: 20th International Conference, Amsterdam, The Netherlands, June 3–5, 2020, Proceedings, Part III 20 (pp. 424-436). Springer International Publishing. https://doi.org/10.1007/978-3-030-50420-5_31.
Kołodziej, T., & Rosciszewski, P. (2021). Towards Scalable Simulation of Federated Learning. In Neural Information Processing: 28th International Conference, ICONIP 2021, Sanur, Bali, Indonesia, December 8–12, 2021, Proceedings, Part V 28 (pp. 248-256). Springer International Publishing. https://doi.org/10.1007/978-3-030-92307-5_29.
Li, L., Wang, J., & Xu, C. (2020, August). Flsim: An extensible and reusable simulation framework for federated learning. In International Conference on Simulation Tools and Techniques (pp. 350-369). Cham: Springer International Publishing.
https://doi.org/10.1007/978-3-030-72792-5_30.
Liang, Y., Guo, Y., Gong, Y., Luo, C., Zhan, J., & Huang, Y. (2021). Flbench: A benchmark suite for federated learning. In Intelligent Computing and Block Chain: First BenchCouncil International Federated Conferences, FICC 2020, Qingdao, China, October 30–November 3, 2020, Revised Selected Papers 1 (pp. 166-176). Springer Singapore. https://doi.org/10.1007/978-981-16-1160-5_14.
Saha, S., Hota, A., Chattopadhyay, A. K., Nag, A., & Nandi, S. (2024). A multifaceted survey on privacy preservation of federated learning: progress, challenges, and opportunities. Artificial Intelligence Review, 57(7), 184. https://doi.org/10.1007/s10462-024-10766-7.
Sheng, T., Shen, C., Liu, Y., Ou, Y., Qu, Z., Liang, Y., & Wang, J. (2023). Modeling global distribution for federated learning with label distribution skew. Pattern Recognition, 143, 109724. https://doi.org/10.1016/j.patcog.2023.109724.
Vrana, J., & Singh, R. (2021). Digitization, digitalization, and digital transformation. Handbook of nondestructive evaluation 4.0, 1-17. https://doi.org/10.1007/978-3-030-48200-8_39-1.
Wang, G., Xu, F., Zhang, H., & Zhao, C. (2022). Joint resource management for mobility supported federated learning in Internet of Vehicles. Future Generation Computer Systems, 129, 199-211. https://doi.org/10.1016/j.future.2021.11.020.
Xia, Q., Ye, W., Tao, Z., Wu, J., & Li, Q. (2021). A survey of federated learning for edge computing: Research problems and solutions. High-Confidence Computing, 1(1), 100008. https://doi.org/10.1016/j.hcc.2021.100008.
Yu, L., & Wu, L. (2020). Towards byzantine-resilient federated learning via group-wise robust aggregation. Federated Learning: Privacy and Incentive, 81-92. https://doi.org/10.1007/978-3-030-63076-8_6.