It is most definitely worth fighting them. They have some very good items, and good experience too. You can come back later if you want, but if you've done the underdark you should be able to do it. Remember that they cast power word kill, and power word stun (I think). A good way (but a bit cheesy) is to put all your party in the hallway so you only have to kill a couple at a time. Arrows (+1 or 2) work well as well.
__________________
|