June 23, 2019 05:32:06
when we use a rop fetch or a mantra TOP node task, I'm wondering if there's a way to record the maximum memory used by that process.
I would love to do something like store max memory used on the node data dictionary to be able to automatically limit the number of tasks.
June 25, 2019 10:58:53
Thanks Andrew - logged RFE 97653 to track it.
June 26, 2019 10:50:06
There are many ways to do this, but it would be a farm scheduler-specific thing since it would have to be affecting the load balancing algorithm on specific farm blades.
For example with Tractor there is the ‘At Most Slots’ and ‘Service Key Expression’ that could be data-driven by work item attributes to limit which blades and how many workitems are allowed to be executed in parallel. You could have jobs sending back performance stats result data, which could be stashed on disk to be used in adapting the next cook.