Removing sticky backed numbers from metal siding?

I bought my first house and it has cheap sticker numbers attached to metal siding. I would like to remove the numbers but how do I do that without damaging the paint on the siding?
Thank you.