If the Duke can take land at whim then I guess he could do it, but only by stripping the count of land and title, likely making himself an enemy.