I think they're both equally difficult.

I've found that writing lyrics that don't sound cliched and boring is really hard, but no harder than writing a new chord progression and coming up with a melody.

The important thing, as you say, is to be satisfied with what we as musicians write. Beyond that, who cares what anyone else thinks of our music.