ML Terrain
Film/TV , Gamedev

This demo is intended to be a full walkthrough of the process from creating an ML model, and using this ML model directly in Houdini. But it is also built with exploration in mind. Plug in your own terrain erosion HDAs, or heightfield patterns. Use higher or lower resolution to compare results. Test against massive terrain, or work with small fine tune details. Train a moon crater ML model, or alien world. Or simply just use existing real world lidar data.

The ONNX Machine Learning Terrain demo comes in two parts.

Part One | Training: (ONNX_teraining_Terrain.hip)
 Walk through a simple setup of how to leverage PDG, and a handful of terrain HDAs processors, to create hundreds or thousands of unique terrain assets. Feeding those terrain files into COPs to export image pairs which will be used by the TrainPix2Pix HDA, which will create a custom ONNX file.

Part Two | Inference: (ONNX_Paint_Terrain.hip) Use the newly created ONNX file(or use the one provided), with Houdini 20's new ONNX SOP. With the hip files basic heightfield set up, edit its shape and design with a Paint Texture Mask directly in the viewport, and watch the ML model generate a final detailed heightfield.

(2 responses)

CREATED BY

CODY SPAHR

Cody Spahr is a technical artist at SideFX, with a background in game dev.

More from Cody Spahr

COMMENTS

  • Vasilis Triantafyllou 5 months, 3 weeks ago  | 

    This is incredibly helpful, Thank you!

  • 2danimm 4 months, 4 weeks ago  | 

    Thanks a lot

  • Ed B 3 months ago  | 

    Why is no-one talking about this. What?!!!

  • alnh 2 months ago  | 

    Where is the actual tutorial? I've downloaded the example files from this page (https://www.sidefx.com/contentlibrary/ml-terrain/) but I don't see a tutorial video.

  • jlapre 1 month, 3 weeks ago  | 

    alnh, it looks like the documentation is in the Houdini files themselves, in the form of sticky notes inside the various SOPs.

  • jlapre 1 month, 3 weeks ago  | 

    After looking at the sticky notes in the hip files, I have to agree with alnh. It would be really helpful if there was a step by step tutorial.
    I'm not able to get the example files to work for me.

  • Cody Spahr 4 weeks, 1 day ago  | 

    A new video has been uploaded. Hopefully it gives a bit more insight into both the Training and the Inference HIP files.

Please log in to leave a comment.