MisterDrgn

Yes, the switch is at the top of of the right tower. I think it's there regardless of whether you've completed the Castle. It's kind of hard to see, so you might want to use Spirit Eye to locate it.
--MisterDrgn