If you look to your right while going north from ghostgate you should be able to see a steep path that leads to it. If you hit the Yassu mine while looking for it then it means you missed the turn and should head back south.
http://www.buttersky.com/morrowind/#ghostgate_shrine