Houdini 21.0 Machine Learning

ML-related nodes for animation and character

ML building blocks

ML Pose Serialize SOP

Extracts the transforms from a specified subset of joints and represents them collectively as a float point attribute. A joint group can be specified. Only joints from the joint group will have components of their transforms serialized.

ML Pose Deserialize SOP

Helps to convert a rig pose that was previously serialized using ML Pose Serialize back into a rig pose. It reconverts the transforms from a specified subset of joints from a float point attribute. A joint group can be specified. Only joints from the joint group will have components of their transforms deserialized.

ML Deform SOP

Uses a trained ML model to deform the skin of a character. It uses the same inputs as Bone Deform SOP with a fourth input for residual blend shapes. Each residual blend shape defines a displacement point in the skin mesh. Internally, the ML model predicts weights to combine the residual blend shapes to apply a correction to the rest skin.

APEX Add ML Deformer SOP

Allows a model trained using the ML Train Deformer recipe to be used in APEX rig.

Armature Deform SOP and Armature Capture SOP

Deform organic tissue repeatedly using skeleton poses. You can use these nodes to generate training data for an ML deformer and other applications outside of ML.

Machine Learning

General Support

Supervised ML pipeline tools

ML Recipes

Animation and character-specific ML tools

Volume-specific ML tools

Image-specific ML tools

Reference