HQueue Cloud Rendering - Anybody got it working?

wooshum · Lurker Joined: 28 Jan 2011 Posts: 5 Location: Brisbane

Hi All,

As per usual I have left my uni project to the last minute, and was banking on using the HQueue Cloud service to get me over the line and... no dice.

Every time I try to roll the cloud render service the HQueue dialogue just hangs on the 'Launching a computer in the cloud' page. Have checked on my Amazon account and no instances are running. Tried on two different machines (OSX 10.6.8 and Windows 7) both running production build 12.0.634 with Apprentice HD licencing.

If anyone has a solution to this issue please help, pretty much you will be my hero.

FYI this issue has been raised recently by dgc289 on the amazon forums: https://forums.aws.amazon.com/thread.jspa?messageID=348890&#348890

Sorry if this is a duplicate topic - I cannot find his original post in this forum

wooshum · Lurker Joined: 28 Jan 2011 Posts: 5 Location: Brisbane

*BUMP*

Just going to bump this post up again to see if anyone has a solution.

jopa79 · Lurker Joined: 09 Sep 2011 Posts: 6

I have the same problem with hqueue cloud render.
When i launch the console the following line looks wrong to me.

hython: BUG in libdispatch client: Do not close random Unix descriptors

some suggestions ?

thx

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

jopa79 · Lurker Joined: 09 Sep 2011 Posts: 6

Hi Rob,

no, nothing happens. Sad

thx

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

What OS are you on?

Also, are you able to run hython from the terminal?

--Rob

jopa79 · Lurker Joined: 09 Sep 2011 Posts: 6

Hi Rob,

i'm running H12 1.125 on OS X 10.8.2. I can run hython from the houdini shell without getting errors. I checked all requirements, following the guide, file dependencies are all green but after hit "yes, procced" nothing happens.
cloudsubmit.log says "cloudsubmit starting up" but no web page coming up.

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

Ah. I had another user recently run into troubles with submitting cloud jobs from OSX >= 10.7. The problem had to do with a bug in Python >= 2.6.4 on OSX.

Try starting Houdini like so from the Houdini Shell.terminal app:

jopa79 · Lurker Joined: 09 Sep 2011 Posts: 6

Hi Rob,

thanks for your help, now i'm one step closer Wink

i think.
I start houdini with your workaround and my browser appears.
After more than 20 minutes of waiting nothing happens (Launching a computer in the cloud).
The EC2 Instance would not start (my scene file is just 1,5M). I click on the amazon console link and the EC2 Dashboard tells me that i have 0 running instances.

thanks...

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

Awesome. We're getting there.

If you see the web page, then that means that Houdini was able to get to a point where it spawned a daemon process called 'cloudsubmit' which is responsible for starting EC2 instances and managing render jobs on the cloud.

So if the EC2 dashboard reports 0 instances, then the cloudsubmit daemon must have hit a glitch when trying to start the instances. This can happen for a variety of reasons such as a network firewall configuration setting or if the EC2 Amazon account that you are using is not subscribed to the Houdini Cloud Rendering service.

To find out what the problem is, we need to examine cloudsubmit's log file. On Mac OSX, the log file is stored in a temporary directory somewhere under /var/folders.

Open a Terminal.app, and run this command to find the log file:

jopa79 · Lurker Joined: 09 Sep 2011 Posts: 6

Hi Rob,

...and this was my fault
"..EC2 Amazon account that you are using is not subscribed to the Houdini Cloud Rendering service.." Rolling Eyes

Now it works.

I'm guessing that python bug needs to be fixed by apple ?

thank you again.

Very Happy

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

Glad to hear it's working!

I no longer have the link but if I remember correctly, the bug was logged with the Python dev team.

Cheers,
Rob

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

hello there

i am also trying to use ec2 cloud computing and i also get stuck at the web page.
i am on win 7..
where do i find the log file on win7...
and also how do i subscribe my amazon ec2 account to Houdini Cloud Rendering service.

thanks your help will be really apreciated Smile

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

i found my log file with the following eror

"AuthFailure: Subscription to ProductCode 5D6864EE required."

my problem is to understand how to subscribe to an AMI or whatever it is called on amazon, after 2 hours it seems i am still unable to do so.
plz help

thank you

rvinluan · Developer Joined: 10 Jun 2005 Posts: 427

Hello,

Have you followed the HQueue Cloud user guide? http://www.sidefx.com/images/stories/news/HQueue_Cloud/hqueue_cloud_guide_09nov12.pdf

Page 4 of the PDF talks about how to register for the cloud service.

Cheers,
Rob

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

yes i followed the steps exactly...
every thing is fine but then i get that message in my log file.

"Please visit https://aws-portal.amazon.com/gp/aws/user/subscription/index.html?offeringCode=59D3AAF6
2012-12-22 03:03:50,473 ERROR: AuthFailure: Subscription to ProductCode 5D6864EE required."

i can go and lauch any instance of ubuntu or whatever, but i am not allowed to start manually a houdini instance, neither can i from houdini itself
i am using aprentice HD.

since i can lauch any other instance , i believe it isnt related to billing issues.

i have my shared key and secret etc, but it just wont work

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

what a fail...after posting my last comment i saw the obvious "please check amazon blabla", it took me further into the registration..
i ll try and see if it works

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

it is working but now i have no download progress

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

So it is rendering and downloading
but i ma quiet disappointed with the render time

i launched a simple scenes that takes 3 min for 100 frames on my
12 core machine (dual xeon 3.07ghz 48 mb ram)

hqueue with clouds tells me 45 min..with that setup:

10 machines 64 bit
min client per frame 10
max client per frame 10
frame per job 1
cpus per job 8.

anything i am doing wrong?

i apologise for beeing a bit pushy but i litterally lost all my night to figure out to make that work and the result is not what i expected.

protozoan · Posted: Sat Dec 22, 2012 8:31 am GMT Post subject:

sami.tawil · Socialite Joined: 19 Mar 2012 Posts: 90

thanks a lot for answering protozoan..

i actually closed my amazon account.
i ended up (sadly) exporting everything in c4d for rendering on rebusfarm(which is an amazing render service).
when i say sadly is not that c4d isn't good at rendering, but i was hoing to complet my first project on houdini in mantra...
next one i guess

On a side note i think it is time that some good company such as rebus farm, consider implementing mantra in their services.

If anyone knows some people providing good mantra rendering online i am open to suggestion

Thank you

SYmek · Houdini Guru Joined: 13 Mar 2003 Posts: 1241

SreckoM · Posted: Mon Dec 24, 2012 2:53 pm GMT Post subject:

This render farm supports Houdini www.xlrender.com

SreckoM · Posted: Sun Jan 13, 2013 5:17 pm GMT Post subject:

Where can I find log file on Win?