Hello, is there anyway to control what the background color is in Houdini when rendering with an alpha?

You can pick a background image to use on the camera. The image can be a solid color if you like. This kind of background is permanently in the rendered image. The renderview allows setting a background color for viewing purposes that is not permanent.