The term pharmacologists use ist "desensitization", i.e. becoming less sensitive to the effects of capsaicin. It has to do with the effect of capsaicin on sensory nerve endings (heat and pain-sensitive ones, not those transmitting taste). As far as I konw, there is no permanent damage in humans. Just enjoy the stuff.