I built another Windows 7 guest and installed our shipping app without making any other changes to the guest, and the damn thing works fine, so it must be a combination of events 
I didn't do too much to the origonal image (drivers, windows update, optimisation script), so I'll install the apps in a different order and see if another app causes it ...