YouTube Video
Project Description
We’ve built the UI that breaks the boundary of a 2D chat window. We’ve made the digital twin come alive by moving into the virtual world. Our screen is an AR experience of a live factory, with an orchestrator running the UI and multiple agents operating the factory: sales, warehouse, production. All interactible via the in-virtual-world digital twin.
A2A, 3D A2UI, generating live dashboards and responding. Highlight information with spatial awareness.
Prior Work
We experimented with the 3D environment before to ensure the toolchain is viable. The Agents and generative UI is all done during the hackathon.