It's an old conflict... Make sure your hand and fingers are properly placed but don't look at your fret hand. The first is imperative, the second is necessary for proper guitar and singing posture.

As matonanjin2 says, it will come. Then there will be new chords and riffs to learn. I find I make the best progress when I force myself not to look as soon as I can when practicing anything new. Surprisingly, I often find that my chord changes are actually faster when I'm not looking.

Good luck, have fun.