Why assaulting them, facing elephants in streets, where you can't use anything useful against them?

Wait until they sally forth. They would be lowered in nuimbers by the siege, and you can deploy all your missile power against elephants, and properly use pike shields against them. Of course i suffered losses this way and spent much time, but i won every battle against them.