Tracking maxmimum memory usage per work item

   1511   2   1
User Avatar
Member
150 posts
Joined: Feb. 2009
Offline
when we use a rop fetch or a mantra TOP node task, I'm wondering if there's a way to record the maximum memory used by that process.

I would love to do something like store max memory used on the node data dictionary to be able to automatically limit the number of tasks.
https://openfirehawk.com/ [openfirehawk.com]
Support Open Firehawk - An open source cloud rendering project for Houdini on Patreon.
This project's goal is to provide an open source framework for cloud computing for heavy FX based workflows and allows end users to pay the lowest possible price for cloud resources.
User Avatar
Member
544 posts
Joined: Sept. 2012
Offline
Thanks Andrew - logged RFE 97653 to track it.
- Ken Xu
User Avatar
Member
603 posts
Joined: Sept. 2016
Offline
There are many ways to do this, but it would be a farm scheduler-specific thing since it would have to be affecting the load balancing algorithm on specific farm blades.

For example with Tractor there is the ‘At Most Slots’ and ‘Service Key Expression’ that could be data-driven by work item attributes to limit which blades and how many workitems are allowed to be executed in parallel. You could have jobs sending back performance stats result data, which could be stashed on disk to be used in adapting the next cook.
  • Quick Links