A Robust, Real-time, and 3D Human Motion Capture System through Multi-Cameras and AI

Introduction

The ability to reliably track 3D human motion in real-time is crucial for a wide range of applications across various fields, such as healthcare, entertainment, industry, and sports. Occupational ergonomics, as the intersection of industry and healthcare, could particularly benefit from such a solution, as recent reports indicate that physical and cognitive ergonomics issues at work contribute to major economic losses in Europe.

Current Challenges

However, the existing commercial human motion capture (MoCap) systems often exploit multiple markers or inertial measurement units (IMUs), which, in addition to their high costs, suffer from many technical and usability issues. These include:

• Lengthy set-up times
• Compromised user comfort and bothersome wearability needs
• Large drifts and inaccuracies over time in the case of IMU-based Mo-Cap systems

Some of these issues can be dealt with by using vision-based human skeletal trackers. However, they have high vulnerability to occlusions, and often, the missing or inaccurate 3D tracking capacity has severely depreciated their reliability for real-world applications.

Market Gap

These challenges leave us with no existing market solutions for marker-less (comfortable), robust, economic, and real-time 3D human motion tracking.

Project Overview

Real-Move aims to create such a solution by exploiting multi-camera views and AI algorithms. The system will be capable of:

1. Tracking multiple people in the scene with high accuracy
2. Providing application-driven data services such as human factors in addition to motion tracking data

Innovation Potential

Real-Move has the highest innovation potential to become a key player in the multi-billion Euros MoCap and workplace safety markets.

Socio-Economic Impact

In addition, by providing quick and easy access to vision-based risk monitoring tools, it can make a huge socio-economic impact by improving the quality of life of individuals at work while saving a large amount of money by cutting waste.