Search - User list
Full Version: White Water RAM usage
Root » Technical Discussion » White Water RAM usage
mois23
Hello there,

I've an annoying problem. I'm making a whiter water simulation. I noticed that if I enabled “density control” Houdini fills the ram and after several frames it crashes. If I disable it everything works fine.

I've read lot of posts regarding this problem. Here for example [forums.odforce.net]. It seems to be a Win10 issue, but no one posted a solution for that.

Is there definitely a way avoid this problem? Does MAC users have the same issue?

Houdini 17.5/Windows 10
mois23
Really? No one has a solution for that?
anon_user_37409885
Mac and Linux wont have this issue.
mois23
So annoying. The problem is I have a FX license on windows at work and Apprentice Version on Mac at home.

In case, Is it possible to keep the same FX license on dual boot Windows/Linux?

Otherwise, can I cache through filecache node with Apprentice version?

Are they going to fix this problem on Windows on 18 Version?
anon_user_37409885
dug this gemstone up for you:

On Windows, the use of the tbbmalloc_proxy library may now be disabled by setting the environment variable TBBMALLOC_PROXY_ENABLE to 0 (defaults to 1). Disabling tbbmalloc_proxy switches Houdini to use the system allocator which is about 1.8x slower under high thread contention but it allows better memory usage so that some simulations can be completed on machines with insufficient RAM under Windows.

Give it a whirl!
mois23
Hey goat. Thank you for your reply.

An update..

I tried to make same simulation on my Mac. RAM fills completely as well, but at least Houdini doesn’t crash. The problem is that whitewater uses all my 64GB of RAM just for 700.000 particles if I enable density control (I really need it because of the natural look of the foam).

Maybe the problem is that I’m making flip book for seeing the result? Do you think I can save lot of memory with command line?

In the meantime I’ll try your tip on Windows.

Fingers crossed.
anon_user_37409885
Dug a bit and did a test. Turning off OpenCL, on whitewatersolver1 inwhitewater_sim, reduced memory usage from 20GB to 8GB.

Hit up SideFx too as that seems very crazy.
mois23
goat
Dug a bit and did a test. Turning off OpenCL, on whitewatersolver1 inwhitewater_sim, reduced memory usage from 20GB to 8GB.

Hit up SideFx too as that seems very crazy.


Interesting! I'll make same test on windows and mac during the weekend. Hope to see the same result.

Thank you so much for your help!
mois23
An update.

I made a test on Windows. Enabling Density Control always fills RAM. Even switching off OpenCL. I even tried to cache out through command line and disabling TBBMALLOC_PROXY. Houdini uses averagely 58GB of RAM for 7 Million particles simulation (White Water Scale: 0.01).

Without density control I can push White Water Scale to 0.007 and it can simulate more than 20mln particles using just 40GB of RAM.

This is insane. I know that it's Windows fault. But this is unacceptable, anyway.

I've attached my project file..
jpdecristo
Hello i just find a posible solution for this bug just enter inside the solver there is a wrangle for density control in the bottom is a drop menu when you can select between 32 bits 64 bits and auto
i put 32 bits and is working much better even increased the resolution and consumes less ram
Htogrom
jpdecristo
Hello i just find a posible solution for this bug just enter inside the solver there is a wrangle for density control in the bottom is a drop menu when you can select between 32 bits 64 bits and auto
i put 32 bits and is working much better even increased the resolution and consumes less ram
Hi, can you share printscreen where exactly that wrangle is.
Thanks!
AdamJ
Poked around whitewater solver with performance monitor; looks like neighbour creation and killing dead sopsolvers are eating up memory on win10.

Fix that worked for me:

- Edit->Preferences->Object and Geometry->Sop Cache->Cull Level to 4 (this will unload nodes that have flag on)
- Go to /obj/whitewater_sim/whitewatersolver1/position_based_fluid/create_neighborhoods
select all nodes and RMB->Flags->Unload (this sets the actual unload flag you should see little trashcan icon on all nodes)
- bypass /obj/whitewater_sim/whitewatersolver1/kill sopsolver node
this is one is a headscratcher??? setting all nodes to unload had no effect; tried moving deletion into wrangle and bypassing blast sop no effect as well.. only way to stop it from chugging memory was to bypass it.

With above changes I was able to get similar memory numbers on win10 as I was getting on ubuntu 20.04.
jumax
Hi

Seems like this bug is still around. Following AdamJs steps able to keep the memory use to 80% of 64gb and sim 10 million. Its strange that it hasnt been addressed yet some of the posts I have seen with this issue, go back to version 17 and beyond.
Jebbel_Jebbel
Hi all,

I'm on 18.0.566 and am maxing out as well (64GB with a 2990WX for crying out loud). I'll do some testing with the above mentioned suggestions and will report back .

I had the same exact issue on H15 btw… tech support couldn't figure it out back then. it's a shame to see that it's still there
Jebbel_Jebbel
AdamJ
Poked around whitewater solver with performance monitor; looks like neighbour creation and killing dead sopsolvers are eating up memory on win10.

Fix that worked for me:

- Edit->Preferences->Object and Geometry->Sop Cache->Cull Level to 4 (this will unload nodes that have flag on)
- Go to /obj/whitewater_sim/whitewatersolver1/position_based_fluid/create_neighborhoods
select all nodes and RMB->Flags->Unload (this sets the actual unload flag you should see little trashcan icon on all nodes)
- bypass /obj/whitewater_sim/whitewatersolver1/kill sopsolver node
this is one is a headscratcher??? setting all nodes to unload had no effect; tried moving deletion into wrangle and bypassing blast sop no effect as well.. only way to stop it from chugging memory was to bypass it.

With above changes I was able to get similar memory numbers on win10 as I was getting on ubuntu 20.04.

btw..I'd be interested in your thought process here (read: how the hell did you figure this out?!)
paranoidx
jpdecristo
wrangle
Hi,
can you show where is the node, which I found only this at not very "bottom" like you mention. Thank you
mihatsu
AdamJ
Poked around whitewater solver with performance monitor; looks like neighbour creation and killing dead sopsolvers are eating up memory on win10.

Fix that worked for me:

- Edit->Preferences->Object and Geometry->Sop Cache->Cull Level to 4 (this will unload nodes that have flag on)
- Go to /obj/whitewater_sim/whitewatersolver1/position_based_fluid/create_neighborhoods
select all nodes and RMB->Flags->Unload (this sets the actual unload flag you should see little trashcan icon on all nodes)
- bypass /obj/whitewater_sim/whitewatersolver1/kill sopsolver node
this is one is a headscratcher??? setting all nodes to unload had no effect; tried moving deletion into wrangle and bypassing blast sop no effect as well.. only way to stop it from chugging memory was to bypass it.

With above changes I was able to get similar memory numbers on win10 as I was getting on ubuntu 20.04.


Thx! this worked! i have done my white water sims in linux because this problem.
R_Stewart
So glad I found this! I've spent weeks tweaking settings trying to balance the amount of particles and RAM usage.... Hope it works for me and I can bulk out my WW.


Thanks!
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Powered by DjangoBB