Robotic Musician
Shimon Dances
Marimba playing robot, Shimon, uses gestures and visual queues to improve collaboration with musicians.
Dancer dancing with a Forest arm
Robotic Dancer
Forest
A forest of twelve robot arms (uFactory xArm) use dancer-inspired movement and music input to dance with humans.
The first big project that I worked on for my masters! We integrated the gestures and audio work from prosody into a performance with other robots. Shimon, our marimba playing robot, ended up playing drums with a new generative algorithm, a santoor bot, and also very early guitarbot.
We spent 4 weeks working with dancers from Kennessaw State University to figure out ways to choreograph and perform with robots as collaborators, rather than tools.
Below is a nice
Relevant Publications
Robotic Dancing, Emotional Gestures and Prosody: A Framework for Gestures of Three Robotic Platforms
Amit Rogel, Richard Savery, Gil Weinberg
Sound and Robotics Book Chapter
Other Media
Want to Get Humans to Trust Robots? Let Them Dance
Published 2021
Scientific American
Building Human-Robot Relationships Through Music and Dance
Published 2021
IEEE Spectrum
Finding Their Groove
Published 2021
University Article
A Forest of Robots Builds Trust Through Dance
Published 2021
Mathworks Article
Finding Their Groove
Published 2021
University Article
Next
Human Robot Interaction
Robotic Emotional Gestures (Prosody)
An NSF funded project where we used emotional musical prosody and emotional gestures to improve trust between humans and robots.