Interactive storytelling tools for museums

You’re viewing a sculpture from the Classical Period in Greek history. Fascinating in itself. Yet how much more interesting would it be if you could see how the characters from the period interact? That is the premise behind the IST project ART-E-FACT.

[ClickPress, Thu Apr 28 2005] ART-E-FACT researchers have developed a generic mixed-reality platform that enables museums and other cultural institutions to construct interactive storytelling facilities around key exhibits. “It is a combination of virtual and physical environments,” says Anja Hoffmann of the Department of Digital Storytelling at the Zentrum für Graphische Datenverarbeitung in Darmstadt, Germany. “When a person stands within a designated area holding a certain object – a magnifying glass, say – his or her gestures are monitored using an infra-red video-tracking system that is sensitive to a special marker on the object.”

Discussing Plato’s Republic
The platform can present two virtual characters on screen and have them discuss, for example, Plato’s Republic and the virtues of justice, wisdom, courage and moderation. The characters’ responses to the user are driven by gestures towards certain parts of the exhibit, or by direct interaction using a keyboard and a chat facility.

What is unique about the system, Hoffmann maintains, is the ability it gives to users to design and programme virtual characters. “We have an engine that controls the storyline with artificial intelligence and rule-based logic behind it, so that characters react intelligently to interactions with the user. If a user stands still and makes no reaction, the characters will be pro-active and start a discussion on their own.”

To make the discussions more lively, the virtual characters can be programmed with human traits and shortcomings, in emotions as well as appearance. One character can have the patience of a saint, for example, while another can be extremely short-tempered.

The platform has been piloted at two locations; at the Academy of Fine Arts in Vienna, where two virtual characters discuss works of art, the artists and the history of art, and at the site of the Greek partner the Sacred Convent of The Annunciation, where two characters discuss Byzantine icons and their history.

Interactive aspects appreciated
Most users particularly appreciated the interactive aspects of the system, and apart from some dislike of the characters, user feedback has generally been positive. Hoffmann says that character designers in particular liked the system and appreciated the possibilities it offered compared to Flash or similar tools.

ART-E-FACT finished at the end of February 2005. However, the project partners are still developing the environment. They are trying to incorporate more learning concepts in response to some user comments which saw the systems as good “edutainment” only. The platform will be presented at another exhibition at the Vienna Academy of Fine Arts in June 2005, and the team are hoping to demonstrate the system at further museums or exhibitions.

PLEASE MENTION IST RESULTS AS THE SOURCE OF THIS STORY AND, IF PUBLISHING ONLINE, PLEASE HYPERLINK TO: http://istresults.cordis.lu/
Contact: Tara Morris, +32-2-2861985, tmorris@gopa-cartermill.com