Connecting Rods Hitting Oil Pan Baffle?

[RHD]

I think the pan came loose when you first drove the car. The noise would have disappeared when the big end scoop wore through the pan.
Some pans need a good knock to get into place in the sump. Look for metal fragments in the oil. Best to drain the oil, remove the sump for a complete clean out and reinstall, making sure the pan fits snugly.

[Dodge]

When you took the baffle out did you pry it out on either end or did you do the drop the pan on the ground and pop it out?

When they get pry out on the ends it bends the tray and the rods hit, usually in the rear
of the tray.

If so pull it and bend the tray back into shape. If's that the case.