In general it's fine. But it can hinder your playing later. Let's go over the details.
First you need to make sure you have good position & posture. If you bend your wrist too far in any direction to get your fingers around the guitar you will severely curtail any natural strength & dexterity you have in your fretting hand. So make sure you have a slight, natural curve in your wrist.
Next, it can help if you don't try to keep your fingers in place. It's okay & often beneficial to release finger pressure on the lower frets, just enough to reach higher & make that higher fretted note ring properly. Don't completely lift your finger off the strings. Just release the pressure that was necessary to make the note sound. Maintain a little contact, just let the finger rest on the string without pressing it down. Otherwise it's wasted effort to raise your finger until it's completely off the string, only to have to bring it all the way back when you return to that fret.
The guiding principle is efficiency of motion. Aim to use the least amount of effort (motion and pressure) to get the notes to sound. Any more is wasted effort & can hinder your playing.
Make sense?
So adjust your wrist, hand & thumb placement just enough to slide your hand over in order to help get enough pressure on that next fret. It not necessary to hold on to those lower notes with so much pressure. Finally, go slow! Take your time, it's not necessary to blaze through this exercise. The goal is just to get all your fingers into the act of fretting notes, gaining a little finger independence, strength & dexterity so they'll eventually be ready to do all the things they have to do in order to play music on the guitar!
Hope this helps. Please ask more if necessary & best of success!
Christopher Schlegel
Guitar Tricks Instructor
Christopher Schlegel Lesson Directory