When you first start out your finger tips are like "omfg, what the hell is this, lets build defences!! Lots of defences!!", then after a while they become used to it and are like "nah, this aint so bad, lets take all this defences down a bit, but not too much *shifty eyes*".

LMAO!

My guess is that your body is trying to find a point of equillibrium, and is over and undercompensating your callouses in that attempt.

That makes sense. My fingers arnt actually painful, I just didnt want them to get to that point. My friends callous, wasnt fraying, it actually started to detach. But than he was like "f*ck you fingers!" so he started playing even harder, than it ripped off. He said it hurt like a bitch.

Ill try the fret lube out. Thanks guys.