Gwanghwa Su
Machine-learning based XR Monument
Delivered Gwanghwasu in Gwanghwa Sidae:The Age of Light, the national XR project series, incorporating AI deep learning solutions and AR technology
Client
Ministry of Culture, Sports and Tourism / KOCCA
Deliverable
UX Design, Interaction Design, Project Coordination
Role
UX Designer(Mobile, HMD), Project Coordinator
🌳 Ideation Process
Objective: Build an interactive XR monument that visualizes global voices and emotions derived from social media in real-time.
To meet the technical requirements, the XR monument had to be an interactive, big data-based AR forum that leveraged SNS data and 5G technology. The forum also needed to be accessible across a variety of devices, including mobile phones (iOS & Android), tablets, kiosks, and a type of HMD, which required us to prepare at least four different types of software clients.
Concept: The core concept of the project draws inspiration from the movie "Inside Out" and utilizes an AI classification method to analyze and visualize people's thoughts and emotions.
When a user creates and uploads a post to the cloud, the AI engine analyzes and classifies it into one of seven emotions (i.e. happiness, anger, love, desire, worry, discontent, and sadness). The emotion is then visualized as a colored orb floating in the AR space, allowing users to see and interact with emotions in a novel and engaging way. This approach offers a unique perspective on how we can visualize and understand human emotions, and we believe it has the potential to inspire and inform users in meaningful ways.
Tech Stack & Method:
SNS data crawling, AI/machine‑learning classification
Web3D with Three.js, AR via webAR & Vuforia engine
3D animations and HMD augmentation (Nreal)
Team Management:
Partnered with an AI startup and media artists to support deep learning, data visualizations, and XR design
Served as project coordinator, managing 50+ experts, aligning stakeholders, and ensuring milestones were met
🌳 Design Process
System Architecture: Created a comprehensive system diagram and blueprint to bridge design intent and technical implementation across diverse teams.
By establishing a shared understanding of the project's goals and requirements, the team and collaborators were able to work more efficiently and effectively toward an aligned goal.
Data Management & Moderation
Content Filtering: Implemented text filters and moderation tools to comply with SNS policies and remove spam/inappropriate content across cultural/political contexts
Admin Platform: Built moderation dashboard to ensure quality and nuanced content control
🌳 Design & Deliverables
Interface Design: Managed the visual development for data visualization, intuitive orbit creation, and emotional classification flows for both mobile and headset users.
Also designed the data dashboard and feed gallery interface for mobile and a kiosk machine.
Outcome: Delivered a fully functional, cross-platform XR monument that utilized AI for emotion-based AR visualization.
Insights Gained:
Technical integration with machine learning and AR presents unique UX challenges.
Real-world AR design must adapt for outdoor conditions and multisensory data stability.
Orchestrating multidisciplinary teams requires strong visual communication tools and project coordination skills.