From shape to sound: sonification of two dimensional curves by reenaction of biological movements

authors

• Thoret Etienne
• Aramaki Mitsuko
• Kronland-Martinet Richard
• Velay Jean-Luc
• Ystad Sølvi

keywords

• Gesture
• Sonification
• Sound Perception
• Friction sounds
• Scraping
• 2/3-power law
• Drawings

document type

abstract

Sonifying two dimensional data is a common problem. In this study, we propose a method to synthesize sonic metaphors of two dimensional curves based on the mental representation of the sound produced by the friction of the pencil when somebody is drawing or writing on a paper. The relevance of such approach is firstly presented. Secondly, synthesis of friction sounds allows to investigate the relevance of the kinematics in the perception of a gesture underlying a sound. In third part, a biological law linking the curvature of a shape to the velocity of the gesture which have draw the shape is calibrated from the auditory point of view. It enables to generate friction sounds with a physically based synthesis model from a given shape.

more information