If the big one gets to the door he blocks it so they can't follow. You should be able to do it without the golems following, as this is how i managed it.
------------------
'Cloudbringer for Spamturny General' - BK
-Powered by Tainly Corp
Your ad here? Call 112 -221 -123