Mixed Reality Assembly Scenario VR

The study aimed to examine the impact of three different training types, AR (Augmented Reality), VR (Virtual Reality), and video-based training, on both objective and subjective performance measures in a manual assembly task. The task involved assembling a LEGO-Mindstorms robot in 10 guided steps in a virtual environment. The RWTH IMA Institute conducted the study.

Responsibilities

• Planning and developing a VR experience in Unity 3D
• Iteratively improving the application with feedback by Lea Daling, M.Sc., and studies
• Implementing a Physics-based Attachment System
• Implementing diegetic UI for the E3 Block
• Implementing a custom story graph tool using the Unity Animator
• Implementing scripted animations for the assembly steps
• Assisting in the technical setup of studies

Team

Lea Daling, M.Sc. - Project Lead Anders Petruschke - AR Development Felix Voigtländer (Me) - VR Development

General Information

IMA RWTH Institute Aachen 2020

Platforms: Oculus Rift, Oculus Quest 2

Assets: Auto Hand, Oculus Integration Kit, 3DModels, QuickOutline

Tools: Unity, C#, Miro, Trello, VisualStudio, GitLab, GitKraken

Features

Attachable and detachable Lego blocks

By grabbing, moving the blocks to each other, and releasing a block the user can attach and detach lego blocks from each other.

Step by step tutorial

Each tutorial step is assisted via spoken audio, assembly animation to the right, and a PowerPoint slide at the front.

Assembly Animation

Each tutorial step that requires parts assembly is assisted via a scripted animation.

EV3 Menu interaction

The player can turn on and select the correct program on the EV3 computer