I had the same thing happen. A stack appeared inside the border to a province I owned. When I went into the unit building menu in that province, all of the units stacked in my territory were there for recruitment! The province did not even have an inn if I remember correctly.