This is indeed typical ai-behaviour

I wonder if there is a console command that lets you merge 2 armies