Hand Motion Capture - 手部动作捕捉
该 Demo 是为 Parkinson 项目开发的一个衍生作品,主要展示了通过设备摄像头实现手部动作捕捉的能力。项目使用 MediaPipe 对手部关节在三维空间中的坐标进行估计,并将这些数据传输至 Unity 端口进行处理。与 Parkinson 项目本身不同的是,在本 Demo 中,我将手部模型的骨骼系统与 MediaPipe 接收到的对应节点坐标进行绑定,同时通过代码明确指定各节点之间的父子层级关系。最后,通过在每一帧更新相邻节点之间的旋转信息(Quaternion),实现了接近实时动作捕捉效果的手部动画表现。
This demo, an ancillary product developed for the Parkinson project, showcases the capability of hand motion capture using a camera on the device. It employs MediaPipe to estimate the coordinates of hand joints in three-dimensional space, which are then transmitted to a Unity port. Unlike the Parkinson project, in this demo, I linked the hand model skeleton with the corresponding node coordinates received from MediaPipe, and meanwhile, specified the parent-child node relationships through code. Finally, the rotation information (Quaternion) of adjacent nodes is updated every frame to achieve an effect that closely approximates real-time motion capture.