Men love to sweat it out in the gym. But sweat and dirt can cause a lot of problems for your skin. Excessive sweat and dirt buildup can cause rashes and itching. With constant itching, your skin loses hydration and becomes drier. Dead skin cells can cause more problems, and you enter a vicious cycle of skin damage.