Five-Factor Personality Expression through Eye Gaze

Presenter

Wilhen Alberto Hui Mei

Campus

UMass Boston

Sponsor

Funda Durupinar Babur, Department of Computer Science, UMass Boston

Schedule

Session 2, 11:30 AM - 12:15 PM [Schedule by Time][Poster Grid for Time/Location]

Location

Poster Board A8, Campus Center Auditorium, Row 1 (A1-A20) [Poster Location Map]

Abstract

This paper discusses the intersection of psychology, computer graphics, and human-computer interaction, focusing on the role of eye gaze in understanding human behavior and its application in animating virtual characters. Researchers have explored how eye gaze is linked to attention, revealing its significance in decision-making, non-verbal communication, and its association with personality traits. More specifically, there is a strong link between features, such as blinks, eyeball movements, and visual attention, with the Big Five personality traits - Openness, Conscientiousness, Extroversion, Agreeableness, and Neuroticism. The question is: How do eye movements connect with individual differences in personality? For example, you are able to tell someone is shy if the person avoids eye contact with you throughout the conversation. This example and the literature tell us that there is a connection between gaze behavior and personality. Leveraging these findings, computer graphics has explored the animation of eye gaze in virtual characters to enhance realism and expressiveness. Our research extends the exploration of eye gaze animation in virtual characters by training a convolutional neural network with the First Impression dataset, which contains 6,000 YouTube videos of people speaking to the camera, with their labeled personality scores attached to every frame of the video. More specifically, we trained the neural network from the eye gaze features and predicted the personality scores. Our initial experiments yield promising results and we are currently comparing our model with other datasets.

Keywords

virtual reality, artificial intelligence, human-computer interaction, big five personality traits, computer science

Research Area

Artificial Intelligence

SIMILAR ABSTRACTS (BY KEYWORD)