Muckman
Not a M0derator
I honestly think that would be fine. The part that you ground off doesn't even touch the cam. Set the cam in the cam journals and look and where the end of the cam lands on this cap. I would grind it more to get rid of that stress crack though. You want that completely gone.