Unreal Engine 5 Pose Recognition Plugin

Content

This plugin includes the ability to record and detect single poses, sequences of single poses and dynamic gestures. The system can recognize full body poses, but can also offer recognition separated into body areas: upper body, lower body, left hand right hand. The functionality works by comparing bone rotations. This makes the plugin compatible with regular animation blueprints, montages, and motion capture.

The plugin includes a single pose recognition actor component, a sequence pose recognition actor component and a dynamic pose recognition actor component.

The single pose recognition refers to the recording and detecting single poses. A single pose refers to one snapshot of a skeletal mesh bone rotations, which is recorded in a data asset and then compared to another skeletal mesh.

The sequence pose recognition refers to the recording and detecting sequences of single poses. A sequence refers to multiple snapshots of a skeletal mesh bone rotations which are organized in a list. The sequence is recorded in a data asset and then the steps are compared individually to another skeletal mesh.

The dynamic pose recognition refers to the recording and detecting one dynamic gesture. A dynamic gesture refers to one fluid motion performed by a skeletal mesh, which is recorded in a data asset and then compared to another fluid motion.

The plugin includes a single pose recognition character, a sequence pose recognition character, a dynamic pose recognition character, three test maps and game modes corresponding to one the three characters respectively.