No matter what a province yields, I ALWAYS make 20% farmland, watchtowers and a keep to have something to flee in.
If possible I also build a trading house and a port, but only if sufficient resources are available. If a mine can be built, I build it!
Apart from that I don't do much with low profit provinces, except perhaps build bigger castles and unit production buildings.