I can't seem to find him ANYWHERE in Vergan. The Quest Marker leads me to a little gathering of humans near the castle, opposite side where his house is, and he's not there (in fact, neither are the two arm-wrestling opponents, who are also indicated to be there). And I've checked his house both during the day and night, and he doesn't show up.

EDIT: Nevermind, I was thinking of a different quest/character.