Hi,

I was wondering if there's more documentation and/or examples on the Resume Partially Cached Batches option on the ROP Fetch and ROP Geometry node? (As in, what sort of mechanism does it provide, in more detail)

Specifically, I'm trying to set up a TOP network that could resume simulation from DOP checkpoint files and this toggle kinda sounds as something similar, but can't really get it to work.

(Sorry if this is already documented somewhere and I'm being ignorant)

Cheers
Imre

Hi Imre,

I'm not sure how to setup 'Resume Partially Cached Batches' parm on the rop fetch but this is a custom setup to resume cached sims.
We need to set 'dopnet' and 'rop_output' parms on the pythonprocessor before running the graph. it will also log the total time that took to cook the graph in the end.

Cheers
Amir

The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.

There should also log messages in the work item itself when it does that, something like:

10:54:35.150: Report cached results for sub items 0 to 3 10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0 10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0 10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0 10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0 10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0 10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0 10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0 10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0 10:54:35.157: Partial cook of batch from index=4 frame=5.0

I'll put together a more detailed example to include with the docs.

tpetrick
The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.

There should also log messages in the work item itself when it does that, something like:

10:54:35.150: Report cached results for sub items 0 to 3 10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0 10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0 10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0 10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0 10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0 10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0 10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0 10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0 10:54:35.157: Partial cook of batch from index=4 frame=5.0

I'll put together a more detailed example to include with the docs.

Hello
Does the detailed example got included in the docs?