It sounds like you converted whatever level of castle you had to a city.

This destroys all incompatible buildings, chief among them stables.