Concept:
The movements of a skate dancer act as triggers for music effects. Multiple skaters can perform at once, improvising with each other and collectively remixing a song.
How:
- Teachable Machine – webcam captures the live video of the dancers and PoseNet is used to track their body positions, which are then analyzed by an algorithm that has been trained to recognize distinct, common dance moves. When a certain dance move is recognized (above a certain percentage of accuracy), it triggers its designated sound effect through a Max patch into Ableton Live.
Tutorials:
- Intro to JavaScript and Max
- p5.js and Ableton
- How to use PoseNet to classify poses
- How to use PoseNet to output Pose Regression
- QUESTION: What is the precise output that will tell Ableton to play a sound?
Leave a Reply
You must be logged in to post a comment.