Thanks for the explanation! Is there a recommended temp location that I can stage the hipFile (to not have to worry about the clean up as much)? I was thinking of using PDG_TEMP as the staging location, however it seems a little weird to set the PDG_DIR = PDG_TEMP in order for the hipFile to be copied to PDG_TEMP.
Another question: if we have a scheduler with Submit Graph as Job, it looks like all the schedulers execute this command:
hip_local = os.path.expandvars('$HIPFILE')
hip_remote = '__PDG_DIR__/' + os.path.basename(hip_local)
cmd = '"__PDG_HYTHON__" "__PDG_SCRIPTDIR__/top.py" --report none --hip "{}" --toppath {}'.format(
hip_remote,
node_name
)
In this case, if we've set PDG_DIR to the staged working directory (e.g. $HIP/stage), then it's going to execute the staged hipFile which will make “Reset $HIP on Cook” on the ROP Fetch (w/ the custom scheduler) useless because $HIP/$HIPFILE points to the staged hipfile instead of the original one. Is there a way to pass $HIP/$HIPFILE correctly when doing submitAsJob? Or maybe it's a different case altogether?
Thanks,