I think your problem is with muting , so how do you mute while sweeping ?

You could either use the fretting hand but it doesn't always work perfectly cuz of the harmonics (like in the 12th fret) , palm muting , or picking hand fingers muting.

Certainly you seem to lack muting on the g-string , so find a way that work for you to mute it and stick with it.