yeah u might not want to kill them if you are RPing a good aligned party so all you can really do is run away. personally I usually play evil parties, and i end up casting spells in town on purpose just to kill more cowled fools. they stop coming after awhile btw