Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild


input

Figure 1. Left: We generate a large-scale hand-object interaction dataset, named SimGrasp, using simulated structure light based depth sensor. Right: Trained only on SimGrasp, our methods can be directly transferred to the challenging real world datasets, i.e. HO3D and DexYCB, to track and reconstruct hand object interaction.