It's truly about making that real connection to your instrument, being able to play what you hear in your heard and to know the notes of the fretboard really well. After playing guitar for a few decades, I still have to look at the neck quite often to make sure I get it right. You play so much and that real connection has to be reestablished constantly. It truly is a never ending journey.
Keep at it, but practicing this way will only benefit you in the end. Good luck! :D
Douglas Showalter