Here's the cheapest I found quickly,

Behringer combo

Almost every brand has their own starter pack of some kind. Epiphone, Squier, Ibanez, and Peavey are brands (of both amps and guitars) I'd recommend 1st though. Just try not to go too cheap...like Wal-Mart toy store department. If it comes to that, I'd say just go hang out at a guitar or pawn shop for an hour every other day or so, playing your crudest attempts at music.

And you've already found a good place to start with tips on learning to play...lessons for free or lessons with sound for a $5 subscription. Click the lessons link above on this page.