Try putting a plane/grid in the background to catch the glow/emission, render it out separately and comp it in using a compositing mode like Add, Screen, or Lighten.
Thanks and forgive me for not giving enough detail but the background image is actually a sequence and the scene is camera tracked according to those. Then your solution will not help, right? Or I am totally wrong?