If you've gained access to the town then the goblins/docks quest is complete.
Not sure why the barbarian isn't at the tavern. Might be a bug. Have you installed any mods ? He's not essential to the plot though - a place to sell goodies and a chance to win something in a contest.
Talking to Ulbrec in the eastern part of town will give you access to the palisades, which is the next part of the main quest. His wife can give you info about the scroll.
There are several side quests in the town too, natch
