Function/Class that moves dependencies into working dir

   1151   1   0
User Avatar
Member
341 posts
Joined: March 2020
Offline
Hi
Something changed in v19, in v18.5 files, e.g rop.py was copied to a working dir specified in the scheduler, can't get that to work anymore in v19, what changed and except for the file dependencies parms in on the TOP nodes
Any examples what needs to be implemented in v19 to copy ?
I tried to use self.transferfile() but I don't know where that is implemented so cant find where its transfering the file


Cheers
Jens Martensson
Effects Supervisor @ Weta FX
User Avatar
Staff
586 posts
Joined: May 2014
Offline
Starting with H19.0, custom file transfer logic can be written as a standalone handler instead of in the scheduler: https://www.sidefx.com/docs/houdini/tops/custom_tags.html#custfiletransferhandlers [www.sidefx.com]

This is so that the custom logic can be used with built-in TOP schedulers, instead of needing a whole custom scheduler just to implement the file transfer logic. The old approach of supplying a custom tranferFile method on the scheduler should still work the same as before, however. The scheduler.transferFiles(..) method will call into the custom handlers if they exist, or fallback to the scheduler logic if it exists, and the finally use the built-in defaults if no customizations are applied.

What's the exact issue you're running into? Are you using a custom scheduler, or a built-in scheduler? If it's a custom scheduler, that sounds like a bug on our end with it not properly calling the scheduler method.

There's also a debug variable you can set to get verbose output about file transfers: https://www.sidefx.com/docs/houdini/ref/env.html#houdini_pdg_transfer_debug [www.sidefx.com]

Setting HOUDINI_PDG_TRANSFER_DEBUG=4 in the environment prints the maximum debug information.
Edited by tpetrick - Nov. 2, 2021 16:11:19
  • Quick Links