Thoughts on NeuralVDB/AI Simulation Tech

   674   2   1
wyhinton1
Member
42 posts
Joined: 2月 2020
Offline
Some of you may have seen Nvidia's new NueralVDB tech [developer.nvidia.com] (100x memory footprint improvements over standard VDB). Obviously, I would love to see this make it's way into Houdini. I wouldn't be surprised if some larger studious have already managed to integrate this with Houdini, as it's apparently already being used in feature films.

From what I understand, it seems like NueralVDB files can work in existing of VDB piplelines, so should be a pretty simple update right?

Honestly I wonder why Houdini hasn't really embraced some of the new AI powered simulation approaches, as described in some of the videos on To Minute Papers [www.youtube.com]. I know the space is moving quickly, but isn't simulation one of Houdini's greatest strengths, so why not embrace these advances?

In a couple of years I think AI simulation tech will make working with (modest) simulations in anything less than real time feel antiquated. I really don't think you should need outrageous hardware to do fluid and volume simulations. I have a desktop with a decent CPU and GPU but the latency I get when working with volumes and fluids in Houdini is kind of a big put off from embracing these workflows.
Edited by wyhinton1 - 2022年10月5日 17:19:00
User Avatar
Member
96 posts
Joined: 1月 2008
Offline
I agree, it would be nice for Houdini not to lose its eye on innovation. Other than implementing most recent methods in neural graphics I would love to see Houdini enable users to make tools of their own. A Tensor Operator Context (TEOps) with automatic differentiation or a differentiable operators context (DIFOps) where every operator can compute gradients for backpropagation (like NVIDIAs Warp) would be great. If you look at Neural Fields, Differentiable Simulations, PINNs there is a lot out there that Houdinis toolset is not adapted to yet but will soon become relevant for vfx.
User Avatar
Member
4 posts
Joined: 1月 2018
Offline
I would love to see something similar to Nuke's CopyCAT node. So i could train and then use models inside Houdini without worring about export, TensorFlow or whatever relatet to programming. Lates say i create character with muscles and skin sliding, then run simulation of different poses over night, connect this AI node so it could learn all the deformations related to bones/KineFX and finally animate using trained model with realtime deformations! That would ROX of course it would be nice to train points against pixels (animated textures or video input) basicly train every possible data type inside Houdini against anything. To be honest iam learning Houdini becouse i strongly belive it will be possible in near future. Houdini is made for AI
Edited by oldteapot7 - 2022年10月18日 03:23:20
  • Quick Links