To answer my own question, this was because my trade partner lost the province with the gem resource.