Development Algorithm and Assessing the Efficacy of Voice Control Robotic Prosthetic Hand
DOI:
https://doi.org/10.15282/mekatronika.v7i1.11801Keywords:
Voice Control, Prosthetic Hand, Raberyy Pi, Google Cloud API, Speech RecognitionAbstract
This research investigates the development and evaluation of a voice-controlled robotic prosthetic hand, offering a potentially more intuitive and user-friendly interface for individuals with upper limb differences. The system utilizes a Raspberry Pi as the central processing unit, leveraging the Python Speech Recognition library and the Google Cloud Speech API for speech-to-text conversion and command recognition. Five servo motors, controlled via a PCA9685 driver board, actuate the prosthetic hand’s fingers, mimicking essential grasping and individual finger movements. The performance of the system was assessed through rigorous testing with three participants, focusing on metrics such as word recognition accuracy, command success rate, and overall system latency. Results demonstrated high recognition accuracy, exceeding 97% across all participants, confirming the effectiveness of the chosen speech recognition engine. Command success rates were also consistently high, indicating reliable translation of spoken commands into the intended hand movements. However, the “grip” command presented challenges due to phonetic similarities with other words, highlighting the need for further optimization in speech recognition. Analysis of the system latency revealed that audio capture and processing time on the Raspberry Pi was the dominant contributor to overall delay, suggesting potential benefits from exploring local speech recognition methods. The servo motor performance was consistently fast and accurate, confirming the viability of the mechanical design and control strategy. This research successfully demonstrates the feasibility of voice control for robotic prosthetic hands, providing a foundation for future development and highlighting the importance of addressing pronunciation variability, optimizing latency, and incorporating user feedback for improved usability.
References
[1] Engdahl, S. M., & Gates, D. H. (2021). Differences in quality of movements made with body-powered and myoelectric prostheses during activities of daily living. Clinical Biomechanics, 84. https://doi.org/10.1016/j.clinbiomech.2021.105311
[2] Keerthi, P. S., Al Mamun, S., Tonima, R. A., Shanta, S. A., Ahmed, A., & Zishan, M. S. R. (2021). Design and Implementation of A Human Prosthetic Hand. International Conference on Robotics, Electrical and Signal Processing Techniques, 640–643. https://doi.org/10.1109/ICREST51555.2021.9331202
[3] Singh, A., Srivastava, S., Kumar, K., Imran, S., Kaur, M., Rakesh, N., Nand, P., & Tyagi, N. (2022). IoT-Based Voice-Controlled Automation (pp. 827–837). https://doi.org/10.1007/978-981-16-2594-7_66
[4] Pradeep, J., Jamna, A., & Sasikumar, R. (2023). Low-Cost Voice-Controlled Prosthetic Arm with Five Degrees of Freedom. IETE Journal of Research, 69(7), 4047–4052. https://doi.org/10.1080/03772063.2021.1958069
[5] Samant, P., & Agarwal, R. (2015). Real-time speech recognition system for prosthetic arm control | Request PDF. International Journal of Sensing, Computing & Control. https://www.researchgate.net/publication/281203342_Real-time_speech_recognition_system_for_prosthetic_arm_control
[6] Oppus, C. M., Prado, J. R. R., Escobar, J. C., Mariñas, J. A. G., & Reyes, R. S. J. (2017). Brain-computer interface and voice-controlled 3D printed prosthetic hand. IEEE Region 10 Annual International Conference, Proceedings/TENCON, 2689–2693. https://doi.org/10.1109/TENCON.2016.7848527
[7] Jafarzadeh, M., & Tadesse, Y. (2020). End-to-End Learning of Speech 2D Feature-Trajectory for Prosthetic Hands. Proceedings - 2020 2nd International Conference on Transdisciplinary AI, TransAI 2020, 25–33. https://doi.org/10.1109/TRANSAI49837.2020.00010
[8] Abdul-Nafa, A. D., Ahmed, S. S., Ahmed, Y. S., & Alsaydia, O. M. (2023). Control Robotic Hand Depending on Voice Commands and IoT. Nano Biomedicine and Engineering, 15(3), 288–295. https://doi.org/10.26599/NBE.2023.9290028
[9] M. H. M. Ariff, H. Zamzuri, N. Zulkarnain, M. H. C. Hasan, S. M. H. Fahami " Robust Composite nonlinear Feedback for nonlinear Steer-by-Wire Vehicle Yaw control" Bulletin of Electrical Engineering and Informatics 8 (1), 214-222.
[10] Xiang Meng and Yan Song " Application Research and Implementation of Voice Control System Based on Android Speech Recognition." Journal of Physics: Conference Series, Volume 1865, 2021 International Conference on Advances in Optics and Computational Sciences (ICAOCS) , January 2021.
[11] Lijun Bai " Research on Voice Control Technology for Smart Home System" Proceedings of the Asia Conference on Electrical, Power and Computer Engineering, No, 43 pages 1-7, June 2022.
[12] Vu M, Wang H, Li Z, Haffari G, Xing and Chen C. " Voicify Your UI" Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. Vol.7, Issue 1, No. 44, pages 1-22, March 2023.
[13] Li, S.-A.; Liu, Y.-Y.; Chen, Y.-C.; Feng, H.-M.; Shen, P.-K.; Wu, Y.-C. Voice Interaction Recognition Design in Real-Life Scenario Mobile Robot Applications. Appl. Sci. 2023, 13, 3359
[14] Rahul Baruah, Sonali Mondal and Biswajt Das “A Machine Learning Based Approach to Control Device using Recognition System” Journal of Emerging Technologies and Innovative Research. Vol.11, Issue 4, April 2024.
[15] Xiyang Chen “Research on Voice Control and Analysis Technology for the elderly at home” Proceedings of the 2nd International Conference on Intelligent Design and Innovative Technology (ICIDIT), pp.152-162, October 2023.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 The Author(s)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
