Not only will control and speed eventually come better with the wrist, but you risk developing tendonitus or something picking from the elbow... if you look at Yngwie he doesn't even use his wrist when picking, just his index finger and thumb. It's all about efficiency of motion to get true speed and control (I still pick from my wrist, finger and thumb is too advanced of a technique for most of us).