Witch hazel and oddly enough camphor oil will help.

I like what Fyre posted! Im gonan give that a try!

good luck

Try exfoliating your arms everyday, and or change soap to an anti bacterial for your arms

I had the same problem and the exfoliating (scrubber sponge) got rid of it
You could try tea tree oil 2-3 times a day