The pickup is mounted to a ring as you've seen. The screw goes through the middle of the spring into the base of the pickup. You'll need to unscrew the other side and put it all back together. It's easy enough, especially when you can see the other side setup for comparison...

Good Luck... :D