I found Durlag's Tower harder as a whole, because you're at lower level and the place was riddled with traps.
I didn't find Watcher's Keep that difficult, then again, I'd beaten SoA with the party I took through it. I'm sure that if I played it at levels 9-10 it would be a lot more difficult.
------------------