The visit on the brothel is INDEED a part of a quest. However, when you first completed the quest, the borthel remains open, thus you always have the opportunity to get .. relaxed.
I think it is one of the cool little features, that helps make the game feel alive. And it DOES feel alive, because there are a LOT of these features.