Probably less so for Curiosity than the other Martian rovers. It's powered by an RTG rather than solar panels, so the only difference between day and night is the temperature fluctuations, which is still significant.
Panels wear slowly, but just from being hit by photons, blasted by dust, etc. - but that’s not the problem - batteries are. They don’t last forever, and every cycle takes a little out of their lifetime.