You need +3 or better weapons, and it works best if it is a ranged weapon, cos the golem can't fit through the hidden door. The best weapon for the job early on is Azure Edge.
------------------
Nicodemus Deathslayer, Paladin of the Order of the Holy Flame