Overview

The XR Heavy Equipment Training project was designed to provide immersive training for heavy machinery operators. This application prepares workers by simulating essential vehicle checks and operational procedures in a virtual environment before they begin work. The training consists of two modes:

Training Mode: Users follow guided steps with visual and interactive cues to learn proper procedures.
Knowledge Test Mode: Users perform tasks without assistance, with final evaluation based on time and accuracy, ranking them against other operators.

Solution

The project improves the previous iteration by focusing on interactive functionality and an intuitive user experience. The simulation is structured to resemble real-world training while maintaining an accessible and streamlined flow. Users perform pre-operational checks using interactive 3D models, including:

• Checking oil levels by removing and cleaning a dipstick.
• Inspecting mirrors and adjusting them as needed.
• Verifying tire and bolt conditions.
• Examining hydraulic fluid levels and identifying leaks.
• Cleaning cameras and lights to ensure proper visibility.

The user interface was redesigned to be more minimalistic and immersive, improving the training flow and accessibility. The initial experience starts in a visually rich environment, allowing users to engage with the virtual truck before entering the main training sequence.

Key Features

• Realistic Pre-Operation Inspections: Simulates real-world procedures for machine checks.
• Adaptive Training & Testing: Offers guided learning and skill evaluation modes.
• Interactive 3D Models: Includes optimizations for performance and immersion.
• Enhanced UI/UX: A redesigned interface and environment for better engagement.
• Performance-Based Ranking: Tracks user progress and compares scores within a leaderboard.

Technical Details

Platform: VR: Meta Quest, OpenXR
Technologies: Unity, BNG framework, Amplify Shader Editor, Open XR, Blender, Figma
Optimization: High-quality yet lightweight 3D assets for smooth VR performance.

Outcome & Future Enhancements

This project serves as a strong foundation for expanding industrial XR training. Future improvements could include:

• More detailed scenarios.
• Expanded machine models for different equipment.
• Integration of voice guidance and AI-powered assessment.

By merging realism with interactive learning, this training solution enhances workforce preparedness and operational efficiency.