You need to hold you pick to that there is also a little bit of your thumb hanging over the edge that touches the string, but just a little bit. When you pick, it'll hit the string right after your pick does, and create the harmonic.
There are tutorials on the main page on this sorta thing, they will probably be of better help than my explaination.