Laszlo Hunyadi
Interdisciplinary approaches to the study of multimodal human-human/human-machine communication/interaction
The workshop is a theoretical extension and practical elaboration of issues raised in the presentation of the project HuComTech "Theory and Practice of Multimodal Human-Machine Interaction technologies". It is built on the following modules:
- Why is multimodality essential in the study of human communication and a challenge in human-machine interaction?
- Multimodality vs. unimodality: two complementary approaches to undestanding complex functional and pragmatic events
- An introduction to the HuComTech theoretical-technological model
- Introduction to and hands-on experience with video annotation
- Introduction to and hands-on experience with audio annotation
- From corpus to database 1: database structure
- From corpus to database 2: queries and interpretation
Workshop participants will have the chance to have practical experience with project planning, annotation and interpretation of query results.