A Deep Learning Approach for Face Detection and Recognition to Initiate Human-Robot Conversation

Authors

  • Abdul Halim Ismail Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA
  • Mohammed Khaled Ahmed Al Ghaili Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA
  • Mohamad Amir Hamzah Md Yusof Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA
  • Saeed Akash Mastoi Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA
  • Muhammad Hisyam Rosle Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA https://orcid.org/0000-0003-3259-4547
  • Bukhari Ilias Dept. of Mechatronic Engineering, Faculty of Electrical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA
  • Muhamad Safwan Muhamad Azmi Faculty of Mechanical Engineering & Technology, University Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, MALAYSIA. https://orcid.org/0000-0001-9209-0194

DOI:

https://doi.org/10.58915/amci.v13i2.609

Abstract

Artificial Intelligence (AI) is currently booming at almost all field. The inauguration of OpenAI ChatGPT using Natural Language Processing (NLP) has played a vital role in exposing AI to the public. It is estimated about 1.8 billion users visit ChatGPT site in a month, with further planning of apps creation in iTunes Apple App Store and Android Google Playstore. Therefore, it is interesting and natural to implement such technology in robotic field. This paper presents the attempt to employ AI into the mobile robot system towards the main goals of conversational intelligence between human and robot. First, the robot head is designed and assembled, then a screen that functioned as the robot face is attached. Afterwards the detection and recognition system were developed giving the ability to the robot to recognize registered persons and the robot eye is able to track where the person is, in the camera Field-of-View (FOV). In addition, all these systems are developed on in-situ device i.e. NVIDIA® JetsonTM Nano. It is targeted that the proposed system is able to initiate a natural conversation between a robot and a human user.

Keywords:

Mobile robot, conversational intelligence, deep learning

Downloads

Published

2024-06-04

How to Cite

Abdul Halim Ismail, Mohammed Khaled Ahmed Al Ghaili, Mohamad Amir Hamzah Md Yusof, Saeed Akash Mastoi, Muhammad Hisyam Rosle, Bukhari Ilias, & Muhamad Safwan Muhamad Azmi. (2024). A Deep Learning Approach for Face Detection and Recognition to Initiate Human-Robot Conversation. Applied Mathematics and Computational Intelligence (AMCI), 13(2), 1–10. https://doi.org/10.58915/amci.v13i2.609

Issue

Vol. 13 No. 2 (2024): June 2024

Section

Articles