I have been playing years and I have given up on adjusting my own guitar. I pay to have a guitar tech do it.

but....if I were to adjust my own, I would put them as low as I could without causing a fret buzz when I played the guitar.

If you have never heard a fret buzz, you will know it when you do. It sounds just like the name.