DreamVu HandTrack Outperforms Competitors in Hand Tracking Evaluation
News related to:DreamVu · 1 min read
DreamVu's HandTrack has outperformed two leading open-source models, HaMeR and WiLoR, in a hand tracking evaluation on the Ego-Exo4D dataset. The evaluation, which involved processing 65 clips and scoring 4,144 frames and 6,477 hands, demonstrated the superior performance of DreamVu's technology.
In terms of hand coverage, DreamVu HandTrack achieved a remarkable 98.02%, significantly higher than the 95.12% for HaMeR and 94.94% for WiLoR. The left/right accuracy was also a standout, with DreamVu HandTrack recording 99.80%, compared to 99.22% for WiLoR and 99.16% for HaMeR. Reference-joint coverage saw DreamVu HandTrack at 98.20%, followed closely by HaMeR at 95.63% and WiLoR at 95.47%.
Detection performance was also a key metric, with DreamVu HandTrack achieving a perfect 100.00% Detection Precision and a 99.49% Detection F1 score. HaMeR and WiLoR, on the other hand, scored 99.47% Precision and 98.13% F1, and 99.36% Precision and 98.02% F1, respectively.
The largest gain was in hand coverage, where DreamVu HandTrack found 98% of hands in the test footage, compared to about 95% for the other models. This improvement means fewer gaps and fewer mix-ups, leading to cleaner robot training data.
DreamVu HandTrack was trained on the company's own footage from a different type of camera, ensuring that it was not exposed to the Ego-Exo4D dataset during training or tuning. The evaluation was conducted on the hand pose validation set of Ego-Exo4D, a large research dataset of skilled human activity such as cooking, bike repair, and playing music, recorded with camera glasses.
In DreamVu's tests, HandTrack processes 1080p video at 36.4 frames per second, faster than the video plays. It also has a camera setting for glasses and fisheye cameras, making it versatile for various applications.
DreamVu designs and builds patented 360° 3D cameras for robots, and the software that runs on them. The company is headquartered in Philadelphia, PA, with offices in Palo Alto, CA, and R&D in Hyderabad, India.