Rear Cam Bearing Interference with Fuel Pump Pushrod

[drolston]

The rear cam bearing got installed back too far; about 1/16" into the hole where the fuel pump push rod drops onto the fuel pump lobe on the cam. Push rod is blocked. Engine is in the car working on an electric fuel pump, but I would like to have it go through the mechanical pump for redundancy.
Suggestions?
Any way to cut out the interfering material without putting shavings into the oil?
Turn down the fuel pump push rod end enough to pass by?
??