Natan Sinigaglia

SYMBODY

The SYMBODY project is an endeavour aimed at exploring the intricate connections between human body movement and sound synthesis, to unravel the multifaceted aspects of human movement. It aspires to extend its influence beyond the boundaries of art, venturing into significant realms of scientific inquiry and societal progress.

The project aims to reveal the dynamic interplay between body movements and sound by crafting a bespoke, customizable toolbox. This toolbox aims to capture and visualize these relationships in real-time, generating spatialized audio and graphics. Through the utilization of machine learning, we seek to contribute to the understanding of human-machine interaction and advance the field of movement analysis and prediction.

With a focus on modelling human movement and enriching its comprehensive representation, SYMBODY aims to extend predictive models for professional movement. The project envisions contributions that could hold promising implications for disciplines such as kinesiology and biomechanics, potentially refining techniques utilized in diverse fields including dance, sports science, rehabilitation, and ergonomics.

Moreover, within the domain of explainable AI, SYMBODY strives to shed light on the intricate connections between body movements and sound. Through innovative tools, our project not only aims to expand comprehension of human-machine interaction but also provides avenues for artistic exploration, as well as future applications in assistive technology, entertainment, and therapy.

The project aims to develop a comprehensive toolbox comprising a streamlined methodology for dataset creation, machine learning tools to explore the relationship between body movement and sound, data visualization tools for enhanced comprehension, and a live application capable of representing movement-sound correlations in real-time.

By fostering connections between art, science, and society, SYMBODY emerges as a pioneering experimental project with the potential to deepen our understanding of human movement, enrich scientific dialogue, and contribute to societal well-being. SYMBODY represents an exciting collaboration between artist Natan Sinigaglia, In4Art, HekaLab (PiNA), and TMC.