Try putting a plane/grid in the background to catch the glow/emission, render it out separately and comp it in using a compositing mode like Add, Screen, or Lighten.
Using Houdini Indie 20.0 Windows 11 64GB Ryzen 16 core. nVidia 3050RTX 8BG RAM.
Thanks and forgive me for not giving enough detail but the background image is actually a sequence and the scene is camera tracked according to those. Then your solution will not help, right? Or I am totally wrong?