If you try to remove the pump without removing the solenoid you will break it. Also if you get a replacement pump, look at the back of the pump before you install it. Often they come with only one or two bolts holding it together and you need to transfer over the ones from your old pump.