Alright, I'll stop doing exercices around the first frets for now and find a more comfortable grip around the start of the neck, I just checked this a little bit and it does help.

And yeah, it really seems like something I should do for short bursts throughout the day and then rest my hand.

Thanks for the advice.