Bilateral Teleoperation with a Shared Design of Master and Slave Devices for Robotic Excavators in Agricultural Applications

Ilham Amani Rozaini; Nurul Emylia Natasya Ahmad Zakey; Mohd Hairi Mohd Zaman; Mohd Faisal Ibrahim; Seri Mastura Mustaza; Asraf Mohamed Moubark

doi:10.52756/ijerr.2023.v35spl.011

Authors

Ilham Amani Rozaini Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0009-0005-9202-6025
Nurul Emylia Natasya Ahmad Zakey Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0009-0007-7879-1964
Mohd Hairi Mohd Zaman Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0000-0003-1678-4869
Mohd Faisal Ibrahim Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0000-0002-5046-1206
Seri Mastura Mustaza Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0000-0002-7907-4197
Asraf Mohamed Moubark Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia https://orcid.org/0000-0002-7596-5515

DOI:

https://doi.org/10.52756/ijerr.2023.v35spl.011

Keywords:

Kinematic, master-slave, robot arm, teleoperation

Abstract

The main objective of this study is to develop a shared design of master and slave devices for bilateral teleoperation mechanisms used for robotic excavators in agricultural applications. In robot teleoperation research, many potential applications within controlled and hazardous environments come to light. Robots, with their capacity for remote control by human operators through master devices, often employ the master-slave teleoperation approach. This strategy finds frequent use across manufacturing, construction, and agriculture industries. The master-slave system necessitates two interdependent components that collaboratively steer the robot in real time. However, challenges arise when manipulating the robot arm proves challenging due to structural differences between the master device (such as a joystick) and the slave device (the robot arm). A stable operational framework must be established for the robot to function optimally. This teleoperation system employs a master device to govern the actions of the slave device, a dynamic that heavily influences the operational complexity. Hence, the focal point of this study is to enhance the master-slave algorithm for teleoperation applications that rely on controlling robot arm movements. Despite the differing dimensions of the master and slave devices, they both share a common structure. The kinematic model bridging these components must be intelligible to ensure user-friendliness, facilitating effortless robot control. Calculating the robot arm's end effector movement and positioning involves employing the forward kinematics of the arm, determined through Denavit-Hartenberg parameters and transformation matrices. By mitigating communication delays between the master and slave devices using a technique centered around the robot arm's end effector position, the effectiveness of teleoperation can be significantly improved. Our designed robot arm attains 80% to 100% precision across joints. In summary, streamlining the robot arm's structure and minimizing delays offers a route to bolstering both stability and efficiency in robotic movement.

References

Adzeman, M. A. M., Zaman, M. H. M., Nasir, M. F., Ibrahim, M. F., & Mustaza, S. M. (2020). Kinematic modeling of a low cost 4 DOF robot arm system. International Journal of Emerging Trends in Engineering Research, 8(10), 6828–6834. https://doi.org/10.30534/ijeter/2020/328102020

Aguiar, A. S., Santos, F. N. Dos, Cunha, J. B., Sobreira, H., & Sousa, A. J. (2020). Localization and mapping for robots in agriculture and forestry: A survey. Robotics, 9(4), 97. https://doi.org/10.3390/robotics9040097

Caiza, G., Garcia, C. A., Naranjo, J. E., & Garcia, M. V. (2020). Flexible robotic teleoperation architecture for intelligent oil fields. Heliyon, 6(2020), e03833. https://doi.org/10.1016/j.heliyon.2020.e03833

Chikelu, P. O. (2023). Model design and development of a telescopic palm fruit harvester. Modern Mechanical Engineering, 13(01), 1–20. https://doi.org/10.4236/mme.2023.131001

Correa, M., Cárdenas, D., Carvajal, D., & Ruiz-del-Solar, J. (2022). Haptic teleoperation of impact hammers in underground mining. Applied Sciences, 12(3), 1428. https://doi.org/10.3390/app12031428

Crowley, M. (2020). Foreign labor shortages in the Malaysian palm oil industry: Impacts and recommendations. Asian Journal of Agriculture and Development, 17(2), 1–18. https://doi.org/10.37801/ajad2020.17.2.1

Firdaus, M., Aziz, A., Firdaus, M., & Aziz, A. (2018). Mechanization in oil palm harvesting. International Journal of Academic Research in Business & Social Sciences, 8(5), 247–256. https://doi.org/10.6007/IJARBSS/v8-i5/4098

Huang, L., Yamada, H., Ni, T., & Li, Y. (2017). A master-slave control method with gravity compensation for a hydraulic teleoperation construction robot. Advances in Mechanical Engineering, 9(7). https://doi.org/10.1177/1687814017709701

Hudzari, M., Bakar, M. A., & Mohd Sabir, M. S. (2020). Conceptual development of automated harvester for tall oil palm tree. Advances in Agricultural and Food Research Journal, 1(2), a0000151. https://doi.org/10.36877/aafrj.a0000151

Kang, H., Zhou, H., Wang, X., & Chen, C. (2020). Real-time fruit recognition and grasping estimation for robotic apple harvesting. Sensors, 20(19), 1–15. https://doi.org/10.3390/s20195670

Kebria, P. M., Khosravi, A., Nahavandi, S., Shi, P., & Alizadehsani, R. (2020). Robust adaptive control scheme for teleoperation systems with delay and uncertainties. IEEE Transactions on Cybernetics, 50(7), 3243–3253. https://doi.org/10.1109/TCYB.2019.2891656

Khalid, M. R., & Shuib, A. R. (2014). Field evaluation of harvesting machines for tall oil palms. Journal of Oil Palm Research, 26(2), 125–132.zer

Lampinen, S., Koivumaki, J., Zhu, W. H., & Mattila, J. (2021). Force-sensor-less bilateral teleoperation control of dissimilar master-slave system with arbitrary scaling. IEEE Transactions on Control Systems Technology, 30(3), 1037–1051. https://doi.org/10.1109/TCST.2021.3091314

Lawrence, D. A. (1993). Stability and transparency in bilateral teleoperation. IEEE Transactions on Robotics and Automation, 9(5), 624–637. https://doi.org/10.1109/70.258054

Lee, J., Kim, B., Sun, D., Han, C., & Ahn, Y. (2019). Development of unmanned excavator vehicle system for performing dangerous construction work. Sensors, 19(22), 4853. https://doi.org/10.3390/s19224853

Lee, J.-D., Li, W.-C., Shen, J.-H., & Chuang, C.-W. (2018). Multi-robotic arms automated production line. 2018 4th International Conference on Control, Automation and Robotics (ICCAR), 26–30. https://doi.org/10.1109/ICCAR.2018.8384639

Liu, G., Geng, X., Liu, L., & Wang, Y. (2019). Haptic based teleoperation with master-slave motion mapping and haptic rendering for space exploration. Chinese Journal of Aeronautics, 32(3), 723–736. https://doi.org/10.1016/j.cja.2018.07.009

Mail, M. F., Maja, J. M., Marshall, M., Cutulle, M., Miller, G., & Barnes, E. (2023). Agricultural harvesting robot concept design and system components: A review. AgriEngineering, 5(2), 777–800. https://doi.org/10.3390/agriengineering5020048

Pan, C., Liu, X., & Jiang, W. (2017). Design and synchronization control of heterogeneous robotic teleoperation system. 2017 Chinese Automation Congress (CAC), pp. 406–410. https://doi.org/10.1109/CAC.2017.8242801

Rai, A., Kundu, K., Dev, R., Keshari, J. P., & Gupta, D. (2023). Design and development Virtual Doctor Robot for contactless monitoring of patients during COVID-19. International Journal of Experimental Research and Review, 31, 42–50. https://doi.org/10.52756/10.52756/ijerr.2023.v31spl.005

Schäfer, M. B., Stewart, K. W., & Pott, P. P. (2019). Industrial robots for teleoperated surgery - A systematic review of existing approaches. Current Directions in Biomedical Engineering, 5(1), 153–156. https://doi.org/10.1515/cdbme-2019-0039

Sowat, S. N., Ishak, W., Ismail, W., Mahadi, M. R., Bejo, S. K., Saufi, M., & Kassim, M. (2018). Trend in the development of oil palm fruit harvesting technologies in Malaysia. Jurnal Teknologi, 80(2), 83–91. https://doi.org/10.11113/jt.v80.11298

Sun, D., Baek, I., Hwang, S., Lee, S., Lee, S. K., Jang, S., Ji, C., Han, J., & Han, C. (2020). Sensor-based straight-line control of the end-point of a typical retrofitted hydraulic excavator. Automation in Construction, 120, 103385. https://doi.org/10.1016/j.autcon.2020.103385

Ting, H. Z., Zaman, M. H. M., Ibrahim, M. F., & Moubark, A. M. (2021). Kinematic analysis for trajectory planning of open-source 4-DoF robot arm. International Journal of Advanced Computer Science and Applications, 12(6), 769–777. http://dx.doi.org/10.14569/IJACSA.2021.0120690

Tugal, H., Carrasco, J., Falcon, P., & Barreiro, A. (2017). Stability analysis of bilateral teleoperation with bounded and monotone environments via Zames–Falb multipliers. IEEE Transactions on Control Systems Technology, 25(4), 1331–1344. https://doi.org/10.1109/TCST.2016.2601289

Wagner, N., Kirk, R., Hanheide, M., & Cielniak, G. (2021). Efficient and robust orientation estimation of strawberries for fruit picking applications. 2021 IEEE International Conference on Robotics and Automation (ICRA), 13857–13863. https://doi.org/10.1109/ICRA48506.2021.9561848

Wang, J., & Liu, J. (2022). Bilateral coordination quantisation control for master-slave flexible manipulators based on PDE dynamic model. International Journal of Control, 95(8), 2279–2292. https://doi.org/10.1080/00207179.2021.1906448

Yang, X., Yan, J., Hua, C., & Guan, X. (2022). Position measurement based slave torque feedback control for teleoperation systems with time-varying communication delays. IEEE/CAA Journal of Automatica Sinica, 10(2), 388-402. https://doi.org/10.1109/JAS.2022.106076

You, A., Sukkar, F., Fitch, R., Karkee, M., & Davidson, J. R. (2020). An efficient planning and control framework for pruning fruit trees. 2020 IEEE International Conference on Robotics and Automation (ICRA), 3930–3936. https://doi.org/10.1109/ICRA40945.2020.9197551

Zaman, M. H. M., Ibrahim, M. F., Zainal, N., & Nasir, M. F. (2020). Dual-arm robot with mobile robot platform with master-slave configuration for teleoperation application. International Journal of Advanced Trends in Computer Science and Engineering, 9(1.4), 685–688. https://doi.org/10.30534/ijatcse/2020/9691.42020