Here I will log my process in creating an 3D interactive story telling environment which utilizing room-space AR as the primary tool of design. I will be posting progress updates, tips, and other potential paths this technology can take in live event and performance design.
The main technologies I will be using in order to develop this system are the Unity3D game engine, TouchDesigner, Blender, and the Optitrack Motion Capture system. I have chosen these programs based on my prior expertise and availability.
I hope to catalog my entire process in video documentation and will post the resulting content here.
Below is a preview demo of the system. I will be posting more about how the system works, including the math, shaders, and methods used, as this blog continues. This video has not been altered – the scene displayed in the frame is projected content on the floor of a stage.