I think it would at best shave 5 or 6 minutes of running off; the vast majority of that time is swimming around Collasium (can't Vanish past/through spinning door) and in the Spire (can't Vanish into Erathsmedor's switch room [i.e. you've actually got to get the Shards]).
|