Action-Coordinating Prosody

Speech Prosody 2016

Nigel G. Ward, Saiful Abu

Abstract: This paper is an initial exploration of how prosody helps coordinate action, based on examination of speech and motion in a two-player maze game where the players run and jump to avoid obstacles, and coordinate movements to solve problems. We use an unsupervised method, Principal Component Analysis applied to a to a large set of time-spread features, to discover patterns of behavior involving both prosodic features and game actions. These patterns include prosodic constructions involved in assessing, planning, inhibiting, cuing, and synchronizing actions.

paper pdf

Factor Visualizations

Factor Loadings

Audio Examples: of dimension 23p, of dimension 7n


Gameplay Data Collection: Samples etc.

Nigel Ward's Publications