It will be hard, but it shouldn't be impossible. People have soloed without magic, and you will have dispel magic, true sight etc if you include an inquisitor. It might get a little boring though, and you'll probably find it annoying that your only healing for six people is a couple of lay hands, and all your group can only put 2 proficiency points in any weapon. I personally would find it very dull having six clones to deal with, but that's just me.
------------------
Goddess and Sorceress of the HADB, and her sidekick Pink