You can only harm clay golem with magical blunt weapons (e.g. mace, war hammer ... etc). As for iron golem, I am not sure but I think you need +3 or better magical weapons.
For walkthroughs, try the Ironworks main site or the BG Dungeon (
http://www.bgdungeon.com/bg2/walk.htm)