The Effects of Robot Voices and Appearances on Users’ Emotion Recognition and Subjective Perception

Simple item page
dc.contributor.authorKo, Sangjinen
dc.contributor.authorBarnes, Jaclynen
dc.contributor.authorDong, Jiayuanen
dc.contributor.authorPark, Chunghyuken
dc.contributor.authorHoward, Ayannaen
dc.contributor.authorJeon, Myounghoonen
dc.date.accessioned2024-01-23T14:34:37Zen
dc.date.available2024-01-23T14:34:37Zen
dc.date.issued2023-02-22en
dc.description.abstractAs the influence of social robots in people's daily lives grows, research on understanding people's perception of robots including sociability, trust, acceptance, and preference becomes more pervasive. Research has considered visual, vocal, or tactile cues to express robots' emotions, whereas little research has provided a holistic view in examining the interactions among different factors influencing emotion perception. We investigated multiple facets of user perception on robots during a conversational task by varying the robots' voice types, appearances, and emotions. In our experiment, 20 participants interacted with two robots having four different voice types. While participants were reading fairy tales to the robot, the robot gave vocal feedback with seven emotions and the participants evaluated the robot's profiles through post surveys. The results indicate that (1) the accuracy of emotion perception differed depending on presented emotions, (2) a regular human voice showed higher user preferences and naturalness, (3) but a characterized voice was more appropriate for expressing emotions with significantly higher accuracy in emotion perception, and (4) participants showed significantly higher emotion recognition accuracy with the animal robot than the humanoid robot. A follow-up study (N=10) with voice-only conditions confirmed that the importance of embodiment. The results from this study could provide the guidelines needed to design social robots that consider emotional aspects in conversations between robots and users.en
dc.description.versionAccepted versionen
dc.format.extent33 page(s)en
dc.format.mimetypeapplication/pdfen
dc.identifier.doihttps://doi.org/10.1142/S0219843623500019en
dc.identifier.eissn1793-6942en
dc.identifier.issn0219-8436en
dc.identifier.issue01en
dc.identifier.orcidJeon, Myounghoon [0000-0003-2908-671X]en
dc.identifier.urihttps://hdl.handle.net/10919/117596en
dc.identifier.volume20en
dc.language.isoenen
dc.publisherWorld Scientificen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectRoboticsen
dc.subjectSocial robotsen
dc.subjectconversational agenten
dc.subjectemotive voicesen
dc.subjectuser perceptionen
dc.subjectuser preferenceen
dc.subjectTRUSTen
dc.subjectFACEen
dc.titleThe Effects of Robot Voices and Appearances on Users’ Emotion Recognition and Subjective Perceptionen
dc.title.serialInternational Journal of Humanoid Roboticsen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten
dc.type.otherArticleen
pubs.organisational-group/Virginia Techen
pubs.organisational-group/Virginia Tech/Engineeringen
pubs.organisational-group/Virginia Tech/Engineering/Industrial and Systems Engineeringen
pubs.organisational-group/Virginia Tech/All T&R Facultyen
pubs.organisational-group/Virginia Tech/Engineering/COE T&R Facultyen

Files

Original bundle
Now showing 1 - 1 of 1
Name:
EmotiveRobotVoice_minorRevision_AcceptedVersion.docx
Size:
1.52 MB
Format:
Microsoft Word XML
Description:
Accepted version
Download
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
1.5 KB
Format:
Plain Text
Description:
Download

Collections

All Faculty Deposits
Scholarly Works, Industrial and Systems Engineering