
Robotic Emotional Gestures (Prosody)
An NSF funded project where we used emotional musical prosody and emotional gestures to improve trust between humans and robots.
Hi, I'm Amit ā PhD in Robotics and Music. I am a fourth year PhD student at Georgia Tech in the department for Music Technology. My research focuses on using music to express a robot's movement in order to improve human robotic collaboration. I also work on robotic musicians such as a marimba playing robot, guitar playing robot, and interactive art exhibit that plays music on itself.
An NSF funded project where we used emotional musical prosody and emotional gestures to improve trust between humans and robots.
A forest of twelve robot arms (uFactory xArm) use dancer-inspired movement and music input to dance with humans.
Marimba playing robot, Shimon, uses gestures and visual queues to improve collaboration with musicians.
Recently built interactive exhibit using strings, drums, and robotic arms to create a robotic musician that uses vision and audio input to modify lights, robot movemnents, and string playing.
I've been fortunate enough to have my robots perform AND perform with my robots! Here are some notable events we have done!
I got to play trombone with Shimon in a venue of 3,000 people! We performed two songs in which shimon generated his own lyrics and one song where he improvises based on what we play.
We presented Shimon at the Georgia Tech Booth at SC24. did performances where Shimon learned how to do song covers! During the day Shimon also had an interactive demo for people to play with.
Shimon did a performance for the internet company, Cox, where we showed some songs Shimon wrote
I performed trombone with Shimon where we did an hour long concert with some incredible musicians in Greece. We had limited time as customs had a lot of trouble getting the robot to Greece
I got to show off Medusai at a gorgeous 3D theater where Loki and the Mandalorian were filmed. The animators there helped with some wonderful animations.
Not me this time, but the superstar Shimon got to perform with the band Coin on their (at the time) new song Chapstick
Shimon rapped with Jeff goldblum on his show, The World According to Jeff. Youll notice the xArms dancing in the background (this was their first ever performance)!
One of the performances we did with Forest was for a building construction conference. I got to debut my system to automatically generate dances!
This event was the first event to use our new gestures and code for call and response: it was musically informed rules using markov models to improv