Mixed Reality Training for Maritime Students

Mixed Reality Training for Maritime Students

Hands-on MR engine training for students aboard a real vessel and in-class simulations
2023
Year
Mixed Reality
Tech
STC Group
Client
What’s ABInitio MR App?

The AB Initio project, in partnership with the STC Group, Maritime University of Rotterdam, and a European consortium, delivers a Mixed Reality training system designed to enhance maritime engineering education. Our contribution encompassed a HoloLens 2 application that allows students to interact with two ship engine types—onboard and in the classroom—using object recognition, interactive 3D models, quizzes, and performance analytics.

 

Client’s wants & needs
Mixed Reality engine training experience

Create a simulation that allows cadets to interact with two types of ship engines using HoloLens 2 — both onboard and in classroom settings.

Real-time object recognition

Enable the system to recognize real physical engines and overlay virtual instruction modules directly on top of them.

Curriculum-based interactive scenarios

Design training modules aligned with the Maritime University’s educational standards, including technical tasks and emergency procedures.

Progress tracking and analytics

Incorporate assessments, quizzes, and performance tracking to evaluate each cadet’s learning outcomes.

Consortium collaboration and integration

Ensure smooth integration with the broader AB Initio platform developed by the European training consortium.

How we did it?
01
Technical research and training plan analysis

We started by analyzing the structure and components of two real ship engines and reviewed the training curriculum provided by the Maritime University.

02
Co-creation of training scenarios

Together with instructors and marine engineers, we designed interactive training flows that replicate real-world procedures and emergency protocols.

03
UX design and HoloLens interface

We created intuitive user journeys for both on-deck and classroom use, including object recognition, virtual overlays, and interaction mechanics.

04
3D modeling and animation

We built accurate 3D models of the engines and animated their internal mechanics to support hands-on interaction and step-by-step learning.

05
Mixed Reality development

Using HoloLens 2, we implemented both spatial recognition (for engine overlay) and free placement (for classroom training), integrating quizzes, tasks, and instructional prompts.

06
Testing and delivery

We tested the solution in real maritime environments and classroom settings, ensuring smooth performance, educational clarity, and cross-consortium compatibility.

Challenges we overcame

Translating complex marine engine mechanics into a user-friendly MR experience

Ensuring technical accuracy while maintaining educational clarity and engagement

Aligning terminologies from engineers to an intuitive MR interface for students

Project results

The AB Initio system is actively used at the Maritime Academy for engine familiarization both onboard real training vessels and within classroom settings. Cadets gain hands‑on experience, and the consortium successfully delivered the project on schedule and to full specification.

Other AR Use Cases
Cases
Cases