To me Byzantium as we now call it had the most legitimate claim of being roman so I consider them to be a second roman empire. The Venetians in my book come second place since they were decended from roman refugees.