Presentation at SXSW 2024
Official Event Description by ASU MIX Center: ASU is shaping the future creative workforce, offering transdisciplinary degrees in immersive media and extended reality arts—“XRts”— in Arizona and California. The Media and Immersive eXperience (MIX) Center is a world-class facility powered by cutting-edge technology—a hub for collaboration among creators, researchers and worldbuilders. Worlds for Change, the ASU XRts worldbuilding contest celebrating the next generation of XR creators and their visions of the future, will award grand prize winners at SXSW 2024.
On-Site Event
This project stands as one of my proudest achievements, marking a breakthrough in my expertise with Blueprint Visual Scripting in Unreal Engine 5, user interface interaction, visual design, and environment building. One of the biggest challenges during the early stages was testing workflows between Unreal Engine and TouchDesigner while ensuring the scripting logic functioned seamlessly in both presentation versions. For the smaller Ultra Reality screen, the project runs as a standalone game using an Xbox controller, facilitated by Unreal Engine’s built-in gamepad input mapping for easy implementation. Conversely, the larger screen installation incorporates interactive hand gesture inputs. For example, to select a level for teleportation, the audience raises their hand toward a button and holds it steady, triggering the teleport after a set duration. TouchDesigner processes these gestures, with OpenSoundControl (OSC) enabling communication with Unreal Engine. My responsibilities included leading the setup of Blueprint Visual Scripting and ensuring smooth integration with TouchDesigner.
Once in the level, the screen displays videos about ASU’s academic programs, sponsors, and study centers. After the video ends, the system returns to the main menu. A timer is also set in the main menu to prevent inactivity; if no interaction occurs, a world and video are selected randomly to showcase the experience.
One click: animate the planet to the middle of the screen.
Another click: launch the new level. Without confirmation: Animate the planet back to the orbit ring.
Once the video ends, return the viewer to the idle.
OSC message is also sent at the beginning and end of a level to communicate with on-site Touchdesigner feature
Volvox Labs
Contribution
Logic Implementation, Blueprint Scripting,
World Creation, Visual Effects