first and foremost, why did you replace the fuel pump? what symptons were you experiencing? did the old fuel pump not give any pressure at all?
like frank asked, did you replace the fuel filter as well? hopefully the lines arent completely seized.. for future purposes, you should replace the filter any time you replace the pump. if you live in a state requiring ethanol, you should replace the filter once a year.
did you verify proper fuel pressure? in other words did you have somebody watch the fuel pressure gauge, while you were duplicating the specific driveability issue? the pressure gauge hose should be long enough to run between the bonnet and cowling, then duct tape it to the windshield.
verify you definitely have proper fuel pressure BEFORE swapping parts.
then always remember its a rover, so it may be due to a reverse light bulb being burned out!