Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
Article Sidebar
Main Article Content
Abstract
The advancement of smart technologies has led to the development of innovative home automation devices, with smart mirrors emerging as a modern convenience tool. This paper focuses on the design and implementation of a gesture-controlled smart mirror, incorporating a two-way mirror, monitor, raspberry pi, gesture-enabled camera, power adaptor and a swipeable interface to enhance user interaction. The objectives of the paper include designing a comprehensive smart mirror using CAD, integrating gesture control technology through Python's OpenCV package, constructing a functional prototype utilizing the Magic Mirror software, and conducting extensive testing. Key tests conducted include usability test to assess user interaction, functionality test to validate gesture control and mirror operations, data analysis for performance metrics, and visibility test for optimal display quality. Functionality test showed an average gesture detection accuracy of 92.5%, with the swipe left and swipe right gestures achieving the highest accuracy. In the usability test, the average response time across all gestures was 0.75 seconds, which is within the acceptable range for real-time interaction. Other performance indicators like error rate, average user satisfaction, device uptime and gesture latency were tested. These results demonstrated the effectiveness of the gesture-controlled interface, with the prototype showing high accuracy in gesture recognition and overall positive user feedback in terms of usability and reliability. The findings of this work suggest that the developed smart mirror could serve as a valuable addition to smart home environments, offering a seamless and interactive experience for users.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
Singh, R., Saxena, T., Gangwar, S., Sengar, B. S., & Chauhan, A. S. (2023). Smart mirror using Raspberry Pi. International Journal for Research in Applied Science & Engineering Technology, 11(3), 2109–2112. https://doi.org/10.22214/ijraset.2023.49906
Bhake, S., Parekh, S., Kulkarni, S., Sayam, S., Shaikh, S., & Barbadekar, A. (2022). Smart mirror using IoT and Raspberry Pi. International Journal for Research in Applied Science & Engineering Technology, 10(12), 382–385. https://doi.org/10.22214/ijraset.2022.47880
Mallick, S., Singh, T., & Podder, S. (2023). IoT-based smart mirror using Raspberry Pi. International Journal for Research in Applied Science & Engineering Technology, 11(1), 460–467. https://doi.org/10.22214/ijraset.2023.48583
Nalini, N., Ashish, S., & Abhishek, C. (2023). The mirror of the future: Building an interactive smart mirror with AI-based virtual assistant and intruder alert (theft detection). Research Square. https://doi.org/10.21203/rs.3.rs-2690711/v1
Hongyu, Z., Dongying, W., Yang, Y., & Zhenrong, Z. (2023). Research progress of human-computer interaction technology based on gesture recognition. Electronics, 12(13), 2805. https://doi.org/10.3390/electronics12132805
Sangamesh, N., Abhishek, M., Samrudh, S., Yashraj, K., & Gujar, A. D. (2023). Computer vision-based media control using hand gestures. International Journal for Research in Applied Science & Engineering Technology, 11(5), 6642–6646. https://doi.org/10.22214/ijraset.2023.52881
Suryateja, C. M., Boppu, S., Cenkeramaddi, L. R., & Ramkumar, B. (2022). Hand gesture recognition system in the complex background for edge computing devices. In Proceedings of the International Symposium on Smart Electronic Systems (13–18). https://doi.org/10.1109/iSES54909.2022.00016
Batool, A., Hashmi, B. N., Ali, A., Naeem, S., & Anam, S. (2022). IoT-based smart mirror. In Proceedings of MOL2NET'22 Conference on Molecular, Biomedical, Computational & Network Science and Engineering (1–15).
Saradhi, M. V., Nikitha, A., Bhavana, D. R., Akshay, G. K. R., & Sushmitha, C. (2022). Survey on IoT-based smart mirror with temperature and news. World Journal of Advanced Research and Reviews, 16(2), 998–1001. https://doi.org/10.30574/wjarr.2022.16.2.1258
Chiew, C., Muhammad, E. R., & Kamalanathan, S. (2022). Recommendations for developing an IoT-based smart mirror with gesture control. In Proceedings of the International Conference on Decision Aid Sciences and Applications (650–659). https://doi.org/10.1109/DASA54658.2022.9764996
Canwen, X., Julian, M., & Penghan, W. (2023). Mirror: A natural language interface for data querying, summarization, and visualization. In Companion Proceedings of the ACM Web Conference 2023 (49–52). https://doi.org/10.1145/3543873.3587309
Chari, S. K., Raja, M., & Kishore, S. R. (2023). Raspberry Pi-based smart mirror. In Proceedings of the International Conference on Communications and Cyber Physical Engineering (pp. 211–220). https://doi.org/10.1007/978-981-19-8086-2_21
Reddy, D. S. P., Pranav, Y. S., Kora, P., & Arvind, V. (2023). Smart mirror using Raspberry Pi 4. In Intelligent Manufacturing and Energy Sustainability: Proceedings of ICIMES 2023 (pp. 25–33). https://doi.org/10.1007/978-981-19-8497-6_3
Altyar, S. S., Hussein, S. S., & Mohammed, M. J. (2022). Human recognition by utilizing voice recognition and visual recognition. International Journal of Nonlinear Analysis and Applications, 13(1), 343–351. https://doi.org/10.22075/ijnaa.2022.5501
Badwaik, D., Game, E., Zade, P. S. M., Kathote, P., & Bhoyar, G. (2022). A review paper on health monitoring smart mirror. International Journal for Science Technology and Engineering, 10(4), 451–454. https://doi.org/10.22214/ijraset.2022.41267
Miotto, R., Danieletto, M., Scelza, J., Kidd, B. A., & Dudley, J. T. (2018). Reflecting health: Smart mirrors for personalized medicine. NPJ Digital Medicine, 1, 62. https://doi.org/10.1038/s41746-018-0068-7
Safa, M., Meenakshi, K., Saranya, G., Geetha, G., & Karpagaselvi, S. (2020). Enhancing smart mirror with human health care perspective towards intelligence in IoT-based environment. In Proceedings of the International Conference on Power, Energy, Control and Transmission Systems (1–8). https://doi.org/10.1109/ICPECTS49113.2020.9337037
Chang, L. W., Liu, H. L., Ying, C. Y., Tsai, W. Y., & Tsai, Y. Y. (2021). A mirror-based personal health monitoring system integrating wearable devices and non-contact measurements. In Proceedings of the IEEE International Conference on Consumer Electronics - Taiwan (1–2). https://doi.org/10.1109/ICCE-TW52618.2021.9602975