You could try a gate or a feedback destroyer. Behringer make cheep rack mounted ones. I bet any sort of gating, downwards expansion guitar pedal would do the job like a Boss NS2.

Another think to try is a kill switch (you can use an A/B switch). Kill the signal to the amp and the cycle is broken. End of feedback.