I don't want to go to my graduation either, or even to my Year 12 Formal (I guess that's a "prom" in non-Australian English :o :D). I think it's just that doing something like that for school just wouldn't mean much to me. On the other hand, it could just be that I'm weird, which, knowing me, is a significant possibility.
But I wouldn't worry about it, in any event.