You need to be more specific, dude. Where are you exactly? I'll take a wild guess and say that you're on level 2 of Irenicus's dungeon, after you meet Yoshimo. Do you mean the mephits and imps? Attack the portals themselves, when you destroy them the mephits will stop spawning.
------------------
