Maybe I am missing something.

There are places that I would like to build a fort or tower. I have lots of cash. It is in my own territory. It is on unimpeded land. Yet, in some instances, I cannot build. When I mouse over the icon, it reads that I cannot build these things.

I wonder why?