Byzantium was the name of the city that was rebuilt and greatly expanded by Constantine to form Constantinople, capital of the Eastern (half of the) Roman Empire. So yes, to call someone a Byzantine in the Middle Ages would be to call them a citizen of the city of Byzantium/Constantinople/Istanbul(modern day).