It's hard to say without seeing a picture. If you can play it with the other fingers, maybe just move on to the next thing to learn and try it with the big finger later on. Maybe you'll get different results, or maybe this is the best result you are going to get.
IMO, you won't do irreparable harm by going your own way on this, you just might have to re-learn it later.