Cro-Create: Weaving Sound Using Crochet Gestures

Cro-Create is a crochet gesture recognition sonifier for individual and collaborative use. In single user mode, Cro-Create directly scales and maps numerical palm orientation values detected by a motion sensor to sound. In dual user mode, the system affords users with additional auditory feedback by detecting when two users’ gestures are synchronized by segmenting the gestural procedure of making a stitch in crochet into three stages and utilizing a dynamic time warping algorithm to classify and recognize these stages; when the system determines that both users have produced the same gesture, the sonification is complemented by a distinguishable chord. Through this demonstration we introduce our tool to share procedural state for the physical craftmaking process, crochet, through sound.