Ennis, Cathy, McDonnell, Rachel and O'Sullivan, Carol (2010) Seeing is believing: body motion dominates in multisensory conversations. ACM Transactions on Graphics (TOG), 29 (4). ISSN 1557-7368Full text not available from this repository.
In many scenes with human characters, interacting groups are an important factor for maintaining a sense of realism. However, little is known about what makes these characters appear realistic. In this paper, we investigate human sensitivity to audio mismatches (i.e., when individuals' voices are not matched to their gestures) and visual desynchronization (i.e., when the body motions of the individuals in a group are mis-aligned in time) in virtual human conversers. Using motion capture data from a range of both polite conversations and arguments, we conduct a series of perceptual experiments and determine some factors that contribute to the plausibility of virtual conversing groups. We found that participants are more sensitive to visual desynchronization of body motions, than to mismatches between the characters' gestures and their voices. Furthermore, synthetic conversations can appear sufficiently realistic once there is an appropriate balance between talker and listener roles. This is regardless of body motion desynchronization or mismatched audio.
|Subjects:||Q Science > QA Mathematics > Electronic computers. Computer science
T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
|Divisions:||School of Computing > Staff Research and Publications|
|Depositing User:||CAOIMHE NI MHAICIN|
|Date Deposited:||07 Oct 2014 13:59|
|Last Modified:||07 Oct 2014 13:59|
Actions (login required)