I've received the key and opened the 4 crypts, now how do I get out? I just keep swimming around and around.

There is a lever to open each underwater grates near where the crystal and the crypt key was. Open these gates and leave by jumping over the broken stairs or riding the mummy elevator roof to the top and leaving near the statue of Kerah.