Going to a store and trying a few is the definately recommended. I was all set to buy a Epiphone SG, went to shop and after strumming for 5 mins decided I didn't like it, ended up getting a Gretsch. The feel of the guitar will be different for everyone so trying a few is a must.
I would say that a more expensive guitar will most certain be better. It should stay in tune, not have a buzz, etc. The action will be better and you always change to make lower or higher to suit. Strings that come with them again should be better but you could re-string with a better make.
Cheaper makes like Squire and Epiphone make some great guitars that wont break the bank.
Cheers
Fender Strat Jimi Hendrix Series MIM
Epiphone 59 Les Paul
Pus a few others
Boss Katana Mk2 100 watts
Bugera V22 combo
Far too many pedals...