Sculz has a search & destroy AI, just like the lilies, so he's out there and he's looking for you..
..
And don't worry about the windmill...The posts keep people out..Once while I was fighting Sculz, my horse disappeared, (thats how I figured out his routine)...I was upset..So I tried to do a 'Don Quixote', just for grins..
...but I couldn't get in.