The first song I learned was Bob Dylan's 'Knocking on Heaven's Door', the chords and lyrics are quite simple and an easy one for playing/singing on your own in public for the first time. Something with simple lyrics is a good chic to start with.