Amir Hussain

Anna Esposito

Maria Marinaro

Raffaele Martone

This volume brings together the peer-reviewed contributions of the participants at the COST 2102 and euCognition International Training School on “Multimodal Signals: C- nitive and Algorithmic Issues” held in Vietri sul Mare, Salerno, Italy, April 22 –26, 2008. The school was sponsored by COST (European Cooperation in the Field of Scientific and Technical Research, www.cost.esf.org) in the domain of Information and Communi- tion Technologies (ICT) for disseminating the advances of the research activities developed within Action 2102: “Cross-Modal Analysis of Verbal and Nonverbal Communication” (www.cost.esf.org/domains_actions/ict/Actions/Verbal_and_Non- verbal _Communication) and by euCognition: The European Network for Advancement of Artificial Cognitive Systems (www.euCognition.org). COST Action 2102, in its second year of life, brought together about 60 European and 6 overseas scientific laboratories whose aim is to develop interactive dialogue systems and intelligent virtual avatars graphically embodied in a 2D and/or 3D int- active virtual world, able to interact intelligently with the environment, other avatars, and particularly with human users. The main theme of the school was to investigate the mathematical and psycholo- cal tools for modelling human–machine interaction through access to a graded series of tasks for measuring the amount of adjustment (as well as intelligence and achie- ment) needed for introducing new concepts in the information communication te- nology domain in order to develop adaptive, socially enabled and human-centered automatic systems able to serve remote applications in medicine, learning, care, re- bilitation, and for accessibility to work, employment, and information.

COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008, Revised Selected and Invited Papers

Multimodal Signals: Cognitive and Algorithmic Issues

This book constitutes the thoroughly refereed post-conference proceedings of the COST Action 2102 and euCognition supported international school on Multimodal Signals: 'Cognitive and Algorithmic Issues' held in Vietri sul Mare, Italy, in April 2008. The 34 revised full papers presented were carefully reviewed and selected from participants’ contributions and invited lectures given at the workshop. The volume is organized in two parts; the first on Interactive and Unsupervised Multimodal Systems contains 14 papers. The papers deal with the theoretical and computational issue of defining algorithms, programming languages, and determinist models to recognize and synthesize multimodal signals. These are facial and vocal expressions of emotions, tones of voice, gestures, eye contact, spatial arrangements, patterns of touch, expressive movements, writing patterns, and cultural differences, in anticipation of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services. The second part of the volume, on Verbal and Nonverbal Communication Signals, presents 20 original studies devoted to the modeling of timing synchronisation between speech production, gestures, facial and head movements in human communicative expressions and on their mutual contribution for an effective communication.

Antonietta M. Esposito

Vincent Müller

Gaetano Scarpetta

This volume brings together the advanced research results obtained by the European COST Action 2102: "Cross Modal Analysis of Verbal and Nonverbal Communication". The research published in this book was discussed at the 3rd jointly EUCOGII-COST 2102 International Training School entitled "Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues ", held in Caserta, Italy, on March 15-19, 2010. The book is arranged into two scientific sections. The 18 revised papers of the first section, "Human-Computer Interaction: Cognitive and Computational Issues", deal with conjectural and processing issues of defining models, algorithms, and strategies for implementing cognitive behavioural systems. The second section, "Synchrony through Verbal and Nonverbal Signals", presents 21 revised lectures that provide theoretical and practical solutions to the modelling of timing synchronization between linguistic and paralinguistic expressions, actions, body movements, activities in human interaction and on their assistance for an effective communication.

Raffaele Martone

About

Books

Join the club