Josh Jang
← Work

RealityBridgeCopy a real object into XR.

Year
2025 · 1 week
Role
Lead design engineer · System architecture · Vision & XR
Tags
XR · Hardware · Software
Award
Best Use of Qualcomm Technologies in IoT · MIT Reality Hack 2025
Problem
Getting a real object into XR means modeling it in 3D by hand. It's slow.
Solution
Point a camera at an object, press Copy, and a 3D version appears in XR.
Outcome
Working prototype in one week: AI camera, button controller, and Unity XR.

Gallery

RealityBridge gallery 1
RealityBridge gallery 2
RealityBridge gallery 3
RealityBridge gallery 4

Details

Overview+

RealityBridge asks a simple question: what if reality itself was your XR authoring tool? Instead of modeling 3D assets from scratch, you point a camera at a real cup, book, or apple, press a button, and it appears in your virtual world. The system combines edge AI object detection on a Qualcomm RB3, physical copy/paste triggers via ESP32, Redis-based messaging, and Unity XR rendering into a single tangible interaction flow.

Scope+
  • Interaction Design
  • Edge AI Vision
  • Custom Hardware
  • Unity XR Integration
  • System Architecture