You don't want to clean body oils from them. Gently use a q-tip to clean areas with dirt, otherwise leave alone. Oils make them shinier, prettier, and coat for protection.
A safe way to clean your jewelry is to use a toothbrush and baking soda. I've used toothpaste before, and it works to a point, but baking soda is better.
