Headband deterioration can happen due to different factors such as the oils in your hair or skin, sweat, and most-commonly hair product. It's best to wipe down the headband before storing the headphones away for long periods.
See the related Q&A "What can I do about a peeling headband on my headphones?"