Relax Dude!
We're all friendly here!
Between the broken stairs and the area where you got the crystal key there was a very large room. If you examine the one wall which has no exit, especially examine the left side of this area, you will find a depression in the wall that matches the crystal key. USE the crystal on the depression and the elevator will open!
Have fun!!
Wyv