The only time it happened to me was when I was playing as the Byzantines. I had lost Greece to the Serbs, then later made peace and formed an alliance with them. The Serb Tzar married his princess to my prince. Later the Serbs died without an heir and I inherited Greece off them, but only Greece. So maybe it has something to do with the fact that I owned the territory before.