Try swimming the waterways around the castle and you'll worm your way to the backdoor. There is a place behind the castle where the wall has crumbled and you can slip through, then you can release the castle's drawbridge and leave through the front door whenever you'd like.
-EH
|