Just go to a big record store and get all those bands/artists greatest hits... That would give you a good starting point so that you know what your favorite stuff by them would be. Then get the individual albums....

I'm more into finding new artists than rediscovering old ones.... so heres some stuff you should check out that haven't been listed.

The Mars Volta (very Led Zeppelin/Pink Floyd'ish. John Fruscianti (sp?) plays guitar on some of the tracks.)
Eric Sardinas - Black Pearls (Slide blues player, will blow your mind)
Queens of the Stone Age - Lullabies to Paralyze

Along with those check out
The Allman Brothers (Derek Trucks and Warren Haynes... wow)

A lot of stuff has been already so theres just a few more that you should check out.