Skip to content

The Ultimate Solution for 3D Hand Interaction Controllers with Low-Cost Glove Design

Notifications You must be signed in to change notification settings

liziqi-matrixrealm/Mastery

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

Mastery——The Ultimate Solution for 3D Hand Interaction Controllers with Low-Cost Glove Design

 

video link

↑↑↑ Please click to see the demo video ↑↑↑

Note: the display hardware itself is limited to a maximum refresh rate of 60Hz.

Overview

Powered by 6-axis IMUs along with proprietary hardware and software algorithms, Mastery captures nearly all detailed movements of the human hand with high precision, all while keeping manufacturing costs low. It enables users to interact in VR environments in the most natural, effortless, and comfortable way possible, approaching the ideal for VR hand interaction control.

Unlike traditional controllers that rely on buttons, joysticks, and must be held, Mastery unlocks a new era of interaction by fully harnessing the hand’s natural movement. Just as smartphones replaced keypads with multi-touch screens, Mastery is revolutionizing VR control, making interactions more intuitive, precise, and boundlessly versatile.

Moreover, the glove form factor provides the ideal platform for a haptic feedback system(currently featuring vibration motors).

Weight

Approximately 100g per glove (excluding battery)

Power Consumption

Approximately 83mA @ 5.1V per glove (with significant room for improvement)

Features

Degrees of Freedom

Academically, the full range of motion of the hand is generally categorized as having 21 degrees of freedom (excluding the wrist) or 27 degrees of freedom (including the wrist). This solution truly encompasses the complete range of motion of the human hand, including numerous joint degrees of freedom often simplified or ignored in academic studies, resulting in unmatched detail-tracking capabilities.

Precision

Hand motion capture is an extremely complex system, and currently, no standard method exists to quantitatively measure error or to compare this solution quantitatively with others. By qualitatively analyzing the rendering results alongside recordings of real movements, it is apparent that this solution achieves a level of precision that far surpasses any known alternatives.

Latency

Process Time
Computation <1ms
Wireless (BLE 5.2 protocol) 7.5-12.5ms
Wired (USB 2.0 protocol) <1ms

Note: Video demonstrations use USB wired transmission, and the display hardware itself is limited to a maximum refresh rate of 60Hz.

Self-Calibration

In theory, users do not need to perform any manual calibration after purchase. Mastery can self-calibrate during regular use through adaptive algorithms. This approach differs from most known wearable hand-tracking devices, which require users to perform specific gestures—such as making a fist or spreading fingers—before each use (and sometimes even before every startup).

Pinch Detection

With the support of dedicated hardware, this technology enables accurate single-hand pinch detection at key points, such as the touch of two fingertips. Based on this, it can achieve millimeter-level precision, allowing accurate triggering of functions like button presses or sliding motions within a movement scale of 1 millimeter.

Compared to vision-based solutions that require the hand to stay within the camera's field of view and involve relatively larger pinch movements, this solution significantly enhances user experience and reduces user fatigue.

Stability

Unlike 9-axis IMU solutions, this solution is not affected by magnetic field-related factors.

Clearly, it is also immune to issues such as lighting and visual occlusion.

Wearability

Only two steps are needed: put on the glove and secure the Velcro around the wrist.

To accommodate different hand sizes, several standard elastic glove sizes are available. Finger thickness does not affect the fit; instead, the glove aims to match different finger lengths as closely as possible.

Cost

Based on a single glove

Categories Price (USD) Note
IMU Chips 7.3 Based on Taobao retail price
MCU, BLE Chips 2.5 Based on Taobao retail price
Other ICs and Electronic Components 4.5 Estimated
PCB, FPC 2.0 Estimated
Enclosure and Protective Structure 2.8 Estimated
Specialized Fabric Gloves 4.2 Estimated
Assembly and otheres 1.7 Estimated
Total 25.0

Note: The values are calculated in RMB and then converted into USD based on the information and exchange rate as of February 8, 2025.

Timeline

Time Event
2016.05 Started Mastery project.
2016.10 Developed the initial prototype, integrating industry-standard algorithms with an optimized sensor layout. At this stage, its performance surpassed all known similar solutions worldwide.
2018.01 Completed a major hardware architecture update.
2019.03 Completed major updates to software architecture and algorithms.
2019.05 Completed the 2019-milestone prototype, achieving motion capture performance that surpassed all known hand-tracking solutions at the time.
2019.08 Conceived a breakthrough approach to bypass the principle-based solution, significantly reducing material costs.
2019.11 Founded Matrix Realm Tech (Hangzhou) Ltd to further develop Mastery.
2020.01-2021.11 Refined hardware with enhanced industrial design and completely restructured the software architecture.
2021.12 Gained deeper theoretical insights into algorithms, leading to an initial solution for hand differences among users.
2022.01-2024.01 Worked on resolving production challenges and explored methods to reduce sensor material costs, though initial attempts were unsuccessful.
2024.05 Through extensive research, gained deeper expertise in IMU technology and mathematics, leading to significant improvements in both algorithms and hardware.
2024.10 Completed the 2024-milestone prototype, which perfectly validated the original mathematical theory and algorithm. This breakthrough eliminated the inherent flaws of the original approach while drastically reducing costs.

Developer

Li ZiQi – Founder of Matrix Realm Tech (Hangzhou) Ltd.

Graduated with a bachelor's degree in Measurement and control technology and instruments from Chongqing University (CQU) in 2014, ranked 1st in overall performance.

Expert in Human-Computer Interaction (HCI) with a strong foundation in mathematics, physics, and biology as they relate to HCI. Full-stack engineer with deep technical expertise in building and optimizing interactive systems.

Company

Matrix Realm Tech (Hangzhou) Ltd.

源域科技(杭州)有限公司

About

The Ultimate Solution for 3D Hand Interaction Controllers with Low-Cost Glove Design

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published