It won't hurt your cabinet or your speakers. Actually your amp is working harder at 4 ohms than 8, but like SPL said, you will be pushing half the power. Of course unless there is at least a 3 decibel difference in the sound, you won't notice.
So. If you throw a cat out of a car window, is it considered "kitty litter"?