The metal is damaged, you just cant see it. Take off the bumper and you will probably see the metal crumpled up a bit from being pushed in.
You would need to hammer it our from the inside, or drill some holes and get a dent puller to pull it out. Then fill them and repaint.