Project description
Inspired by the film that captivated audiences worldwide, The Jurassic World Dinotracker Augmented Reality App allows fans of all ages to discover, track, and interact with life-size dinosaurs they find in their real-life environments.
Leadership & Mentorship
- Lead Developer - In charge of major bug fixes and helping junior developers. There were a total of 6 developers on the project.
- Provided mentorship and guidance to junior developers, ensuring the successful completion of the project.
Core Feature Development: Hand Tracking
- Implemented the core hand tracking feature, allowing users to feed dinosaurs with their hand gestures.
- Hand tracking was a pioneering feature in AR at the time, requiring innovative approaches for both iOS and Android platforms.
iOS Implementation: CoreML Integration
- Utilized CoreML for hand tracking, which required processing the Camera Frame Data retrieved from the LightShip API.
- Created an Objective-C bridge to transmit the camera frame data to CoreML for processing and then sent the prediction back to Unity.
- This complex pipeline enabled real-time hand tracking and gesture recognition on iOS devices.
Android Implementation: MediaPipe Integration
- For Android, integrated MediaPipe to handle hand tracking, ensuring compatibility and performance across various devices.
- Implemented custom code to bridge MediaPipe's hand tracking outputs with Unity, enabling seamless AR interactions.
Project Impact
- Delivered Universal Jurassic: World Dominion Dinotracker AR App, showcasing expertise in cutting-edge AR development, system architecture, and cross-platform coding.
- The app's innovative features, particularly hand tracking, received positive feedback and contributed to the overall success of the project.