Dancing with VAI, an Artificially Intelligent Dance Partner [Video]

A project housed inside a 15-foot-tall geodesic dome allows people to dance with a computer-controlled figure named VAI.

The virtual partner “watches” and improvises its own moves based on prior experiences. When the human responds, the figure reacts again, creating an impromptu dance couple based on artificial intelligence (AI).

The LuminAI project dome designed and constructed Jessica Anderson, a digital media master’s student at the Georgia Institute of Technology. The system uses Kinect devices to capture the person’s movement, which is then projected as a digitally enhanced silhouette on the dome’s screens.

The dome is lined with custom-made projection panels for mapping.

The surfaces allow people to watch their own shadowy avatar as it struts with a virtual character named VAI, which learns how to dance by paying attention to which moves the current user (and everyone before them) is doing and when. The more moves it sees, the better and deeper the computer’s dance vocabulary. It then uses this vocabulary as a basis for future improvisation.


“Co-creative artificial intelligence, or using AI as a creative collaborator, is rare,” says Brian Magerko, the Georgia Tech digital media associate professor who leads the project. “As computers become more ubiquitous, we must understand how they can co-exist with humans. Part of that is creating things together.”

“This episodic memory is filled with experiences of how people have danced with it in the past,” says Mikhail Jacob, a computer science PhD student and lead developer of the LuminAI technology. “For example, the computer learns to predict that when one person pumps their arms into the air, their partner is likely to do something similar. So on seeing that movement, the avatar might pump its arms sideways at the same pace or use that as the basis for its response.”

The team says this improvisation is one of the most important parts of the project. The avatar recognizes patterns, but doesn’t always react the same way every time. That means that the person must improvise too, which leads to greater creativity all around. All the while, the computer is capturing these new experiences and storing the information to use as a basis for future dance sessions.

“Humans aren’t fully in the driver’s seat anymore. The process gives autonomy back to the computer,” says Jacob. “LuminAI forces a person to create something new—potentially something better—with their partner because they’re forced to take their (virtual) partner’s actions into consideration.”

The technology has broader implications than art. As Magerko explains it, these days AI mostly relies on instructions fed to it by humans, and programming a computer with every possible instruction is impossible.

“That’s because humans are so unpredictable,” says Magerko. “Let’s say a computer and a person are going to write a story together about a family conversation at a restaurant. The story could go in a typical fashion or veer wildly into novel territory. The computer won’t do well unless it has been programmed with all of the pieces of knowledge that the story could possibly contain.

“However, if it can learn that knowledge from people and prior experiences, its improvisation can become somewhat consistent and accurate and the AI learning new story content (or dance moves) becomes part of the user experience.”

Source: Republished from Futurity.org as a derivative work under the Attribution 4.0 International license. Original article posted to Futurity by .

Featured Photo Credit: Georgia Tech

Now, Check Out: