Signal and Image Processing Letters
Vol. 1 No. 1: March 2019

Real-time Facial Expression Recognition to Track Non-verbal Behaviors as Lie Indicators During Interview

Arif Budi Setiawan (Universitas Ahmad Dahlan)
Kaspul Anwar (Universitas Ahmad Dahlan)
Laelatul Azizah (Universitas Ahmad Dahlan)
Adhi Prahara (Universitas Ahmad Dahlan)

Article Info

Publish Date
31 Mar 2019


During interview, a psychologist should pay attention to every gesture and response, both verbal and nonverbal language/behaviors, made by the client. Psychologist certainly has limitation in recognizing every gesture and response that indicates a lie, especially in interpreting nonverbal behaviors that usually occurs in a short time. In this research, a real time facial expression recognition is proposed to track nonverbal behaviors to help psychologist keep informed about the change of facial expression that indicate a lie. The method tracks eye gaze, wrinkles on the forehead, and false smile using combination of face detection and facial landmark recognition to find the facial features and image processing method to track the nonverbal behaviors in facial features. Every nonverbal behavior is recorded and logged according to the video timeline to assist the psychologist analyze the behavior of the client. The result of tracking nonverbal behaviors of face is accurate and expected to be useful assistant for the psychologists.

Copyrights © 2019

Journal Info





Biochemistry, Genetics & Molecular Biology Computer Science & IT Electrical & Electronics Engineering Engineering Neuroscience


The Signal and Image Processing Letters (SIMPLE) is an international, peer-reviewed, open access, online journal of applied research in the field of Signal and Image Processing. It is designed to provide rapid dissemination of original, cutting-edge ideas and timely, significant contributions in the ...