Modeling sound gestures in multimodal human-computer interaction.

Supervisor
Antonio Rodà - Università di Udine
Date and time
Tuesday, July 10, 2007 at 5:00 PM - Aula Verde (Ciclo COVAR)
Place
Ca' Vignal - Piramide, Floor 0, Hall Verde
Programme Director
Marco Squassina
External reference
Publication date
June 27, 2007
Department
 

Summary

Multimodal interfaces, since they provide the user with multiple modes of interaction with a system, require to combine signals acquired from different kinds of sensors. The talk will focus on an interaction paradigm combining movement and sound in a multimodal environment. This paradigm is based on the extension of the gesture concept to sounds and is validated by several experiments that investigate the communication capabilities of sound gestures. The use of multivariate analysis and pattern recognition methods will be also discussed, for defining a semantic space that allows to represent qualities of sound and gestures at a higher level of abstraction.






© 2002 - 2021  Verona University
Via dell'Artigliere 8, 37129 Verona  |  P. I.V.A. 01541040232  |  C. FISCALE 93009870234