So, as a multi-track session it sounds fine, but as soon as you make it into a stereo file it sounds bad?

It almost sounds as if all the treatment you do in the multi-track session gets skipped in the mix-down process, thus resulting in a distorted mess.