Some questions for troubleshooting:
Did you use the same string gauge as old strings were?
Does that sound come from all the strings, or is it just some string(s)?
How are srings laying in the nut. Are they in the bottom of the slot, or are edges carrying the strings?