I think I'm the anomoly here then. I go through all settlements as the last thing I do each turn and make sure I've got what I want set for each. This is mostly to verify I'm squeezing every possible florin out of the populace, but it also helps make sure I don't forget to build something or forget about an agent or army.

Once you get in the habit it takes only a few seconds per province, so its not that big of a drain on time. It also helps me spot rebels and heritics I'd otherwise miss.