Facial Affect and Arousal as a Complement to Gaze Measures in Infant Speech Sound Perception Studies
Sho Tsuji, Fernanda Alonso, Hiromichi Hagihara, Nanako Kimura, Linda Polka, Irena Lovčević
Frontiers in Neural Circuits (in press)
Abstract
This study explores infant facial expressions during visual habituation to investigate perceptual attunement to native and non-native speech sounds. Using automated facial affect analysis based on Facial Action Units, we analyzed valence, arousal, positive affect, and negative affect during the experiment. Valence and arousal decreased with habituation, while positive affect increased, with differences between native and non-native stimuli. Facial affect showed links to discrimination outcomes, with better native discrimination linked to reduced negative affect. These findings highlight the potential of facial expression analysis as a complementary tool to gaze-based measures in early language development research.