Laszlo Hunyadi

Interdisciplinary approaches to the study of multimodal human-human/human-machine communication/interaction

The workshop is a theoretical extension and practical elaboration of issues raised in the presentation of the project HuComTech "Theory and Practice of Multimodal Human-Machine Interaction technologies". It is built on the following modules:

• Why is multimodality essential in the study of human communication?
• Multimodality as a challenge in human-machine interaction
• An introduction to the HuComTech theoretical-technological model
• Introduction to and hands-on experience with video annotation
• Introduction to and hands-on experience with audio annotation
• Multimodality and unimodality: two complementary approaches to the annotation of complex functional and pragmatic events
• From corpus to database 1: database structure
• From corpus to database 1: queries and interpretation

Workshop participants will have the chance to have practical experience with project planning, annotation and interpretation of query results.